2024-09-16T00:42:13.545 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T00:42:13.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T00:42:13.671 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906421' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6l8Q65JjzmPw/MNlqhgpFlQFdqJOVlAhatK3JSaoNJt8jFlwR3b/nhy3E1Db6DE3TabO+gQ2jIU06z7cNHwN4= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJm/i4/YGdcLedxsFEpYv4LVdGckqGL5nymugiUEjEKB/rHCszCgSS/6X9dg7MZJthzgL303eJkMS+noLDFVKFM= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdg5pc3+uNRhBudrW0BKhFq8Iw0xgpHjMe/V1BqBaQ6e2ZZpTBaESqhywvpd9Vh6H8ZkqZl3nHXgmZ+oIiRmDk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T00:42:13.671 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T00:42:13.672 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T00:42:13.672 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T00:42:13.674 INFO:teuthology.task.internal:Checking packages... 2024-09-16T00:42:13.696 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T00:42:13.697 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T00:42:13.697 INFO:teuthology.packaging:ref: None 2024-09-16T00:42:13.697 INFO:teuthology.packaging:tag: None 2024-09-16T00:42:13.697 INFO:teuthology.packaging:branch: squid 2024-09-16T00:42:13.697 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:42:13.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T00:42:13.933 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T00:42:13.935 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T00:42:13.941 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T00:42:13.941 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T00:42:13.948 INFO:teuthology.task.internal:Saving configuration 2024-09-16T00:42:13.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T00:42:13.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T00:42:14.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:51.201715', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6l8Q65JjzmPw/MNlqhgpFlQFdqJOVlAhatK3JSaoNJt8jFlwR3b/nhy3E1Db6DE3TabO+gQ2jIU06z7cNHwN4='} 2024-09-16T00:42:14.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:51.203772', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJm/i4/YGdcLedxsFEpYv4LVdGckqGL5nymugiUEjEKB/rHCszCgSS/6X9dg7MZJthzgL303eJkMS+noLDFVKFM='} 2024-09-16T00:42:14.046 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:36:51.202874', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdg5pc3+uNRhBudrW0BKhFq8Iw0xgpHjMe/V1BqBaQ6e2ZZpTBaESqhywvpd9Vh6H8ZkqZl3nHXgmZ+oIiRmDk='} 2024-09-16T00:42:14.046 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T00:42:14.052 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-16T00:42:14.052 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-16T00:42:14.053 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-16T00:42:14.053 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T00:42:14.156 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fecd9017be0>, signals=[15]) 2024-09-16T00:42:14.156 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T00:42:14.162 INFO:teuthology.task.internal:Opening connections... 2024-09-16T00:42:14.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T00:42:14.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:42:14.240 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-09-16T00:42:14.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:42:14.321 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-16T00:42:14.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:42:14.408 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T00:42:14.415 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-16T00:42:14.433 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-16T00:42:14.434 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-16T00:42:14.491 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:42:14.492 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:42:14.493 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-16T00:42:14.514 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-09-16T00:42:14.532 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-09-16T00:42:14.533 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-09-16T00:42:14.590 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:42:14.591 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:42:14.592 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:42:14.592 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-09-16T00:42:14.614 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-16T00:42:14.632 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-16T00:42:14.632 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-16T00:42:14.689 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-16T00:42:14.689 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-16T00:42:14.689 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:42:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:42:14.691 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-16T00:42:14.714 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T00:42:14.724 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T00:42:14.733 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T00:42:14.734 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:42:14.736 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:42:14.738 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:42:14.755 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T00:42:14.761 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T00:42:14.761 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:42:14.794 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:42:14.797 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:42:15.020 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T00:42:15.102 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T00:42:15.117 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T00:42:15.117 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T00:42:15.117 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:42:15.118 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:42:15.118 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:42:15.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:42:15.135 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-16T00:42:15.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:42:15.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:42:15.137 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-16T00:42:15.138 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-16T00:42:15.192 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:42:15.193 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-16T00:42:15.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-16T00:42:15.195 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:42:15.195 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-503.el9.x86_64 2024-09-16T00:42:15.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-09-16T00:42:15.196 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:42:15.197 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-503.el9.x86_64 2024-09-16T00:42:15.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-09-16T00:42:17.552 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T00:42:17.556 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T00:42:18.740 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-16T00:42:20.403 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-16T00:42:21.524 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-16T00:42:24.945 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-16T00:42:25.825 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-16T00:42:25.951 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-16T00:42:26.379 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-16T00:42:27.259 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-16T00:42:27.342 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-16T00:42:28.280 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-16T00:42:30.627 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.5 MB 00:00 2024-09-16T00:42:31.970 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 19 kB 00:00 2024-09-16T00:42:32.740 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T00:42:32.821 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T00:42:33.952 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T00:42:34.836 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:42:34.836 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:42:34.936 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-16T00:42:34.947 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-09-16T00:42:34.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:42:34.949 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 79 M 2024-09-16T00:42:34.949 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 126 M 2024-09-16T00:42:34.949 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-16T00:42:35.598 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-16T00:42:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:42:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:42:36.099 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-16T00:42:36.114 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-16T00:42:36.114 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-16T00:42:36.114 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-16T00:42:36.114 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-16T00:42:36.114 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-16T00:42:36.115 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-16T00:42:36.279 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 156 kB/s | 23 kB 00:00 2024-09-16T00:42:36.589 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-16T00:42:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-16T00:42:37.131 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-16T00:42:37.671 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-09-16T00:42:37.840 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-16T00:42:37.840 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:42:37.840 INFO:teuthology.orchestra.run.smithi088.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-16T00:42:38.157 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-16T00:42:38.157 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:42:38.157 INFO:teuthology.orchestra.run.smithi017.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-16T00:42:38.157 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-16T00:42:38.530 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-16T00:42:38.863 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-16T00:42:38.898 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-16T00:42:38.899 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-16T00:42:39.240 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-16T00:42:39.240 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-16T00:42:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-16T00:42:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-16T00:42:40.161 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:42:40.161 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:42:40.224 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-16T00:42:40.224 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-16T00:42:40.263 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:42:40.267 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2024-09-16T00:42:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:42:40.269 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 79 M 2024-09-16T00:42:40.269 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 126 M 2024-09-16T00:42:40.269 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-16T00:42:40.631 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 270 kB/s | 23 kB 00:00 2024-09-16T00:42:41.173 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-16T00:42:41.748 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-16T00:42:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-16T00:42:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:42:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-16T00:42:42.316 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-16T00:42:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-16T00:42:42.962 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-16T00:42:43.047 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:42:43.134 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:43.318 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-16T00:42:43.318 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-16T00:42:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:42:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:44.291 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-16T00:42:44.291 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-16T00:42:45.935 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:46.078 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:46.319 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:46.448 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:46.735 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-16T00:42:47.398 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:42:47.483 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:42:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:50.907 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:51.003 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:51.580 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:51.624 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:55.250 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:42:55.296 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:55.936 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:42:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:00.144 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:34.268 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:34.678 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:34.678 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:43:34.678 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:43:34.678 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:43:35.525 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:43:35.526 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-16T00:43:35.566 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:35.879 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:35.964 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:35.964 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:35.965 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:43:35.965 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:43:35.965 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:43:35.965 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-16T00:43:35.965 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:43:35.965 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:36.011 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:36.011 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:43:36.012 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:43:36.012 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:43:36.024 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:36.024 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:36.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 82.el9 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8274670 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:43:36.064 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:43:36.065 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:43:36.066 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:43:36.066 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:43:36.066 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:43:36.691 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-09-16T00:43:36.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:36.847 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:43:36.847 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-16T00:43:36.847 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:36.848 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:36.848 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:43:36.848 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:36.848 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:43:36.848 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-16T00:43:37.156 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:37.241 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:37.242 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:37.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:43:37.242 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:43:37.242 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:43:37.242 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T00:43:37.242 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:43:37.242 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:37.301 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:37.301 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:37.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-16T00:43:37.332 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-16T00:43:37.332 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-16T00:43:37.333 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:43:37.334 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:43:37.335 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:43:37.335 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:43:37.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:43:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-16T00:43:38.031 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:43:38.063 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-09-16T00:43:38.065 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-09-16T00:43:38.080 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.Ivo5FUTOGK 2024-09-16T00:43:38.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ivo5FUTOGK 2024-09-16T00:43:38.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.Ivo5FUTOGK 2024-09-16T00:43:38.280 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.Ivo5FUTOGK is 6KB 2024-09-16T00:43:38.329 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.Ivo5FUTOGK 2024-09-16T00:43:38.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:43:38.416 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:43:38.416 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:43:38.416 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:43:38.417 INFO:teuthology.orchestra.run.smithi088.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:43:38.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:43:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:38.501 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:38.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-09-16T00:43:38.852 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:38.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:43:38.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:43:38.852 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:43:39.244 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:43:39.275 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-16T00:43:39.279 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-16T00:43:39.295 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.HlWiCZcbAv 2024-09-16T00:43:39.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HlWiCZcbAv 2024-09-16T00:43:39.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.HlWiCZcbAv 2024-09-16T00:43:39.509 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.HlWiCZcbAv is 6KB 2024-09-16T00:43:39.557 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.HlWiCZcbAv 2024-09-16T00:43:39.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:43:39.639 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:43:39.639 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:43:39.639 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:43:39.639 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:43:39.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:43:39.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:43:39.774 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:43:39.774 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-16T00:43:39.774 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:39.774 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:39.775 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:43:39.775 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:43:39.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:43:39.775 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-16T00:43:39.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-16T00:43:40.156 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:40.246 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:40.247 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:40.247 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:43:40.247 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:43:40.247 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:43:40.247 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-16T00:43:40.247 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:43:40.248 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:43:40.307 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:43:40.307 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:43:40.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.06 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 82.el9 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Group : Unspecified 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 8274670 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2024-09-16T00:43:40.340 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : builder@centos.org 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2024-09-16T00:43:40.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:43:40.342 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:43:40.342 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:43:40.343 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:43:40.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:43:40.961 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-16T00:43:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:43:42.313 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-16T00:43:42.315 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-16T00:43:42.331 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.URBIfEoQYx 2024-09-16T00:43:42.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.URBIfEoQYx 2024-09-16T00:43:42.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.URBIfEoQYx 2024-09-16T00:43:42.539 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.URBIfEoQYx is 6KB 2024-09-16T00:43:42.587 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.URBIfEoQYx 2024-09-16T00:43:42.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:43:42.665 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:43:42.666 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:43:42.666 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:43:42.666 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:43:42.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:43:42.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-16T00:44:08.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-16T00:44:08.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:44:08.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:09.804 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T00:44:09.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:44:09.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:12.813 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-16T00:44:12.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:44:12.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:27.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-16T00:44:28.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-16T00:44:31.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-16T00:44:36.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:44:36.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:37.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:44:37.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:39.136 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-16T00:44:40.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:44:40.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:40.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-16T00:44:43.232 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-16T00:44:51.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:44:51.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:52.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:44:52.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:44:54.209 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-16T00:44:55.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:44:55.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:45:09.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:45:09.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:45:24.295 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-16T00:45:24.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:45:24.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:45:24.746 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-16T00:45:24.761 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:45:24.761 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:45:24.761 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:45:24.761 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:45:25.762 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T00:45:25.762 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T00:45:25.858 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-16T00:45:25.883 DEBUG:teuthology.parallel:result is None 2024-09-16T00:45:41.192 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-16T00:45:41.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:45:41.545 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:45:41.545 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-16T00:45:41.562 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:45:41.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:45:41.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:45:41.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:45:42.562 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-16T00:45:42.563 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T00:45:42.629 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-09-16T00:45:42.657 DEBUG:teuthology.parallel:result is None 2024-09-16T00:45:55.240 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T00:46:10.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:46:10.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:46:10.634 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-16T00:46:10.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:46:11.000 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:46:11.000 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-16T00:46:11.016 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:46:11.016 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:46:11.016 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:46:11.016 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:46:12.017 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-16T00:46:12.017 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T00:46:12.101 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-16T00:46:12.127 DEBUG:teuthology.parallel:result is None 2024-09-16T00:46:12.127 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T00:46:12.134 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T00:46:12.134 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:46:12.137 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:46:12.140 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:46:12.158 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T00:46:12.165 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T00:46:12.210 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T00:46:12.210 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:46:12.213 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:46:12.216 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:46:12.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T00:46:12.263 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T00:46:12.263 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:46:12.280 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:46:12.282 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:46:12.315 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.316 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.327 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.328 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.339 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:46:12.341 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T00:46:12.348 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T00:46:12.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:46:12.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:46:12.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:46:12.403 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T00:46:12.412 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T00:46:12.412 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:46:12.443 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:46:12.446 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:46:12.463 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:12.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:12.595 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:12.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:12.721 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:46:12.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:46:12.789 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:12.827 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:12.898 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:12.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:12.984 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:46:12.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:46:13.050 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:13.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:46:13.152 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:13.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:46:13.280 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:46:13.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:46:13.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-16T00:46:13.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-09-16T00:46:13.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-16T00:46:13.400 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:46:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:46:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:46:13.942 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T00:46:13.954 INFO:teuthology.task.internal:Starting timer... 2024-09-16T00:46:13.954 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T00:46:13.970 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T00:46:13.983 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T00:46:13.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-16T00:46:14.051 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-16T00:46:14.053 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-09-16T00:46:14.111 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-09-16T00:46:14.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-16T00:46:14.177 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-16T00:46:14.178 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T00:46:14.179 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-16T00:46:14.203 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-16T00:46:14.203 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-09-16T00:46:14.222 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-09-16T00:46:14.222 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-16T00:46:14.244 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-16T00:46:14.245 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-09-16T00:46:14.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:46:14.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:46:14.274 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:46:14.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:46:14.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:46:14.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:46:14.329 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T00:46:14.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:46:14.361 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:46:14.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:46:14.425 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T00:46:14.436 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T00:46:14.448 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T00:46:14.449 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi088.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T00:50:01.542 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-16T00:50:01.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:50:01.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:50:01.641 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-16T00:50:01.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-16T00:50:01.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:50:01.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:50:01.802 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-16T00:50:01.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-16T00:50:01.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:50:01.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:50:01.963 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-16T00:50:02.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-16T00:50:02.052 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T00:50:02.068 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T00:50:02.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:50:02.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:50:02.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:50:02.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:50:02.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:50:02.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:50:02.100 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:50:02.103 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:50:02.115 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:50:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:50:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:50:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-09-16T00:50:02.142 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:50:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-16T00:50:02.149 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-09-16T00:50:02.158 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-16T00:50:02.164 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:50:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-16T00:50:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:50:02.178 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:50:02.180 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-16T00:50:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:50:02.195 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:50:02.209 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:50:02.234 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.262 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.272 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:50:02.273 INFO:teuthology.run_tasks:Running task install... 2024-09-16T00:50:02.285 DEBUG:teuthology.task.install:project ceph 2024-09-16T00:50:02.285 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T00:50:02.285 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T00:50:02.286 INFO:teuthology.task.install:Using flavor: default 2024-09-16T00:50:02.294 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T00:50:02.294 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T00:50:02.294 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:50:02.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:02.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:50:02.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:02.299 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T00:50:02.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:50:02.453 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:50:02.454 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:50:02.458 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:50:02.458 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:50:02.462 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T00:50:02.462 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T00:50:02.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:50:02.572 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:50:02.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:50:02.577 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:50:02.578 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:50:02.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:50:02.580 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:50:02.580 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:50:02.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:50:02.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:50:02.601 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:50:02.607 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:50:02.608 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:50:02.608 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T00:50:02.608 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:50:02.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:50:02.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:50:02.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:50:02.746 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:50:02.747 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:50:02.752 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:50:02.812 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-16T00:50:02.813 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-09-16T00:50:02.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-09-16T00:50:02.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-16T00:50:02.816 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-16T00:50:02.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-16T00:50:03.046 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-16T00:50:03.057 INFO:teuthology.orchestra.run.smithi088.stdout:45 files removed 2024-09-16T00:50:03.062 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-16T00:50:03.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:50:03.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:50:03.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T00:50:03.632 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 311 kB/s | 83 kB 00:00 2024-09-16T00:50:03.646 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 301 kB/s | 83 kB 00:00 2024-09-16T00:50:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 303 kB/s | 83 kB 00:00 2024-09-16T00:50:03.955 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-16T00:50:03.958 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-09-16T00:50:03.974 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 45 kB/s | 12 kB 00:00 2024-09-16T00:50:04.389 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-09-16T00:50:04.391 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-09-16T00:50:04.392 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-09-16T00:50:05.125 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T00:50:05.983 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-16T00:50:06.175 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-16T00:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-16T00:50:08.140 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-16T00:50:08.426 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-16T00:50:12.335 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-16T00:50:12.852 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-16T00:50:13.658 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-16T00:50:13.878 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-16T00:50:14.420 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-16T00:50:14.666 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T00:50:15.198 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T00:50:15.208 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-16T00:50:16.004 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T00:50:20.372 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T00:50:20.513 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-16T00:50:21.426 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T00:50:22.799 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.800 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.813 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:50:22.814 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.814 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:50:22.814 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.816 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:50:22.818 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.819 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.884 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.885 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.885 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-16T00:50:22.899 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:50:22.899 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:50:22.900 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:50:22.901 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.903 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:50:22.906 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.907 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:50:22.913 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-16T00:50:22.913 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-16T00:50:22.913 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-16T00:50:22.913 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:50:22.914 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:50:22.915 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:50:22.916 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:50:22.917 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:50:22.918 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:50:22.919 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:50:22.920 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:50:22.921 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:50:22.922 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:50:22.923 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:50:22.924 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:50:22.925 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:50:22.927 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:50:22.928 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:50:22.929 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:50:22.930 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout:Install 148 Packages 2024-09-16T00:50:22.932 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 8 Packages 2024-09-16T00:50:22.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:50:22.933 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 226 M 2024-09-16T00:50:22.933 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-16T00:50:22.973 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:50:22.999 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:50:23.000 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:50:23.001 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:50:23.002 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-16T00:50:23.003 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:50:23.004 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:50:23.005 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:50:23.006 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:50:23.007 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:50:23.008 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:50:23.009 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:50:23.010 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:50:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:50:23.012 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:50:23.013 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:50:23.014 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-16T00:50:23.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:50:23.016 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 226 M 2024-09-16T00:50:23.016 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-16T00:50:23.614 INFO:teuthology.orchestra.run.smithi154.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-16T00:50:23.731 INFO:teuthology.orchestra.run.smithi017.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-16T00:50:23.847 INFO:teuthology.orchestra.run.smithi154.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-16T00:50:23.868 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:23.869 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T00:50:23.880 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T00:50:23.881 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T00:50:23.882 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T00:50:23.883 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T00:50:23.884 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T00:50:23.887 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T00:50:23.888 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T00:50:23.922 INFO:teuthology.orchestra.run.smithi154.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-16T00:50:23.948 INFO:teuthology.orchestra.run.smithi154.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.4 MB/s | 145 kB 00:00 2024-09-16T00:50:23.949 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================== 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================== 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T00:50:23.970 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T00:50:23.971 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T00:50:23.972 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T00:50:23.973 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T00:50:23.974 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T00:50:23.975 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T00:50:23.976 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T00:50:23.977 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:50:23.978 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:50:23.979 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:50:23.980 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:50:23.981 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-09-16T00:50:23.982 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================== 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:Install 148 Packages 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 8 Packages 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 226 M 2024-09-16T00:50:23.983 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-09-16T00:50:24.048 INFO:teuthology.orchestra.run.smithi154.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 2.4 MB 00:00 2024-09-16T00:50:24.157 INFO:teuthology.orchestra.run.smithi154.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-16T00:50:24.207 INFO:teuthology.orchestra.run.smithi017.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.8 MB/s | 896 kB 00:00 2024-09-16T00:50:24.265 INFO:teuthology.orchestra.run.smithi154.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-16T00:50:24.290 INFO:teuthology.orchestra.run.smithi017.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-16T00:50:24.452 INFO:teuthology.orchestra.run.smithi088.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-16T00:50:24.874 INFO:teuthology.orchestra.run.smithi154.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 17 MB/s | 11 MB 00:00 2024-09-16T00:50:24.941 INFO:teuthology.orchestra.run.smithi154.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 379 kB/s | 25 kB 00:00 2024-09-16T00:50:24.999 INFO:teuthology.orchestra.run.smithi017.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-16T00:50:25.035 INFO:teuthology.orchestra.run.smithi088.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-16T00:50:25.102 INFO:teuthology.orchestra.run.smithi088.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.1 MB/s | 145 kB 00:00 2024-09-16T00:50:25.141 INFO:teuthology.orchestra.run.smithi154.stdout:(10/156): ceph-common-19.1.1-326.g8921c8ef.el9. 13 MB/s | 21 MB 00:01 2024-09-16T00:50:25.207 INFO:teuthology.orchestra.run.smithi017.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-16T00:50:25.208 INFO:teuthology.orchestra.run.smithi154.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.4 MB/s | 228 kB 00:00 2024-09-16T00:50:25.283 INFO:teuthology.orchestra.run.smithi154.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 361 kB/s | 27 kB 00:00 2024-09-16T00:50:25.349 INFO:teuthology.orchestra.run.smithi017.stdout:(6/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-16T00:50:25.350 INFO:teuthology.orchestra.run.smithi154.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 475 kB/s | 32 kB 00:00 2024-09-16T00:50:25.450 INFO:teuthology.orchestra.run.smithi154.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 7.4 MB/s | 751 kB 00:00 2024-09-16T00:50:25.534 INFO:teuthology.orchestra.run.smithi154.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-16T00:50:25.618 INFO:teuthology.orchestra.run.smithi154.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.5 MB/s | 127 kB 00:00 2024-09-16T00:50:25.725 INFO:teuthology.orchestra.run.smithi154.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 4.6 MB/s | 506 kB 00:00 2024-09-16T00:50:25.961 INFO:teuthology.orchestra.run.smithi088.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 2.8 MB/s | 2.4 MB 00:00 2024-09-16T00:50:25.966 INFO:teuthology.orchestra.run.smithi017.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 6.2 MB/s | 4.7 MB 00:00 2024-09-16T00:50:26.118 INFO:teuthology.orchestra.run.smithi154.stdout:(18/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 8.6 MB/s | 17 MB 00:01 2024-09-16T00:50:26.136 INFO:teuthology.orchestra.run.smithi088.stdout:(5/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-09-16T00:50:26.243 INFO:teuthology.orchestra.run.smithi154.stdout:(19/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-16T00:50:26.260 INFO:teuthology.orchestra.run.smithi154.stdout:(20/156): python3-ceph-argparse-19.1.1-326.g892 319 kB/s | 45 kB 00:00 2024-09-16T00:50:26.327 INFO:teuthology.orchestra.run.smithi154.stdout:(21/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-16T00:50:26.352 INFO:teuthology.orchestra.run.smithi154.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.7 MB/s | 161 kB 00:00 2024-09-16T00:50:26.395 INFO:teuthology.orchestra.run.smithi088.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 3.5 MB/s | 1.5 MB 00:00 2024-09-16T00:50:26.421 INFO:teuthology.orchestra.run.smithi154.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 3.4 MB/s | 320 kB 00:00 2024-09-16T00:50:26.453 INFO:teuthology.orchestra.run.smithi154.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.9 MB/s | 300 kB 00:00 2024-09-16T00:50:26.520 INFO:teuthology.orchestra.run.smithi154.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 994 kB/s | 99 kB 00:00 2024-09-16T00:50:26.545 INFO:teuthology.orchestra.run.smithi154.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 927 kB/s | 85 kB 00:00 2024-09-16T00:50:26.937 INFO:teuthology.orchestra.run.smithi154.stdout:(27/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 7.4 MB/s | 3.1 MB 00:00 2024-09-16T00:50:27.021 INFO:teuthology.orchestra.run.smithi154.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 383 kB/s | 32 kB 00:00 2024-09-16T00:50:27.079 INFO:teuthology.orchestra.run.smithi154.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.5 MB/s | 146 kB 00:00 2024-09-16T00:50:27.095 INFO:teuthology.orchestra.run.smithi088.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 4.9 MB/s | 4.7 MB 00:00 2024-09-16T00:50:27.115 INFO:teuthology.orchestra.run.smithi154.stdout:(30/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 300 kB/s | 170 kB 00:00 2024-09-16T00:50:27.133 INFO:teuthology.orchestra.run.smithi017.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 9.1 MB/s | 11 MB 00:01 2024-09-16T00:50:27.208 INFO:teuthology.orchestra.run.smithi017.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 337 kB/s | 25 kB 00:00 2024-09-16T00:50:27.513 INFO:teuthology.orchestra.run.smithi154.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 8.2 MB/s | 3.6 MB 00:00 2024-09-16T00:50:27.622 INFO:teuthology.orchestra.run.smithi154.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.3 MB/s | 249 kB 00:00 2024-09-16T00:50:27.970 INFO:teuthology.orchestra.run.smithi088.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 5.6 MB/s | 21 MB 00:03 2024-09-16T00:50:28.037 INFO:teuthology.orchestra.run.smithi088.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 377 kB/s | 25 kB 00:00 2024-09-16T00:50:28.115 INFO:teuthology.orchestra.run.smithi154.stdout:(33/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 15 MB/s | 49 MB 00:03 2024-09-16T00:50:28.139 INFO:teuthology.orchestra.run.smithi154.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 95 kB/s | 49 kB 00:00 2024-09-16T00:50:28.181 INFO:teuthology.orchestra.run.smithi154.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 247 kB/s | 16 kB 00:00 2024-09-16T00:50:28.206 INFO:teuthology.orchestra.run.smithi154.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-16T00:50:28.273 INFO:teuthology.orchestra.run.smithi154.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 274 kB/s | 18 kB 00:00 2024-09-16T00:50:28.307 INFO:teuthology.orchestra.run.smithi154.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-16T00:50:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:(10/156): ceph-common-19.1.1-326.g8921c8ef.el9. 4.5 MB/s | 21 MB 00:04 2024-09-16T00:50:28.398 INFO:teuthology.orchestra.run.smithi154.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 5.8 MB/s | 7.4 MB 00:01 2024-09-16T00:50:28.399 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] fuse-2.9.9-16.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-16.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-16T00:50:28.399 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-16T00:50:28.412 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-16T00:50:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] fuse-2.9.9-16.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-16.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-16T00:50:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-16T00:50:28.426 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-16T00:50:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 2.1 MB/s | 228 kB 00:00 2024-09-16T00:50:28.484 INFO:teuthology.orchestra.run.smithi017.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 542 kB/s | 27 kB 00:00 2024-09-16T00:50:28.507 INFO:teuthology.orchestra.run.smithi154.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 341 kB/s | 80 kB 00:00 2024-09-16T00:50:28.534 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-cffi-1.14.5-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.14.5-5.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-16T00:50:28.534 INFO:teuthology.orchestra.run.smithi017.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 637 kB/s | 32 kB 00:00 2024-09-16T00:50:28.566 INFO:teuthology.orchestra.run.smithi154.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-16T00:50:28.566 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-cffi-1.14.5-5.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.14.5-5.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-16T00:50:28.599 INFO:teuthology.orchestra.run.smithi154.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-16T00:50:28.600 INFO:teuthology.orchestra.run.smithi154.stdout:[MIRROR] python3-cryptography-36.0.1-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-cryptography-36.0.1-4.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-16T00:50:28.629 INFO:teuthology.orchestra.run.smithi088.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 6.9 MB/s | 11 MB 00:01 2024-09-16T00:50:28.641 INFO:teuthology.orchestra.run.smithi154.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-16T00:50:28.651 INFO:teuthology.orchestra.run.smithi017.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-16T00:50:28.675 INFO:teuthology.orchestra.run.smithi154.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-16T00:50:28.696 INFO:teuthology.orchestra.run.smithi088.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.4 MB/s | 228 kB 00:00 2024-09-16T00:50:28.710 INFO:teuthology.orchestra.run.smithi154.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-16T00:50:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.1 MB/s | 163 kB 00:00 2024-09-16T00:50:28.742 INFO:teuthology.orchestra.run.smithi154.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-16T00:50:28.770 INFO:teuthology.orchestra.run.smithi154.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-16T00:50:28.771 INFO:teuthology.orchestra.run.smithi088.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 360 kB/s | 27 kB 00:00 2024-09-16T00:50:28.793 INFO:teuthology.orchestra.run.smithi154.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-16T00:50:28.794 INFO:teuthology.orchestra.run.smithi017.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.9 MB/s | 127 kB 00:00 2024-09-16T00:50:28.846 INFO:teuthology.orchestra.run.smithi088.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 424 kB/s | 32 kB 00:00 2024-09-16T00:50:28.944 INFO:teuthology.orchestra.run.smithi017.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 3.3 MB/s | 506 kB 00:00 2024-09-16T00:50:28.960 INFO:teuthology.orchestra.run.smithi154.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-16T00:50:28.996 INFO:teuthology.orchestra.run.smithi088.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 4.9 MB/s | 751 kB 00:00 2024-09-16T00:50:29.001 INFO:teuthology.orchestra.run.smithi154.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-16T00:50:29.043 INFO:teuthology.orchestra.run.smithi154.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-16T00:50:29.063 INFO:teuthology.orchestra.run.smithi088.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-16T00:50:29.111 INFO:teuthology.orchestra.run.smithi154.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-16T00:50:29.127 INFO:teuthology.orchestra.run.smithi154.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-16T00:50:29.133 INFO:teuthology.orchestra.run.smithi088.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.9 MB/s | 127 kB 00:00 2024-09-16T00:50:29.152 INFO:teuthology.orchestra.run.smithi154.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-16T00:50:29.169 INFO:teuthology.orchestra.run.smithi154.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-16T00:50:29.195 INFO:teuthology.orchestra.run.smithi154.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-16T00:50:29.238 INFO:teuthology.orchestra.run.smithi154.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T00:50:29.262 INFO:teuthology.orchestra.run.smithi154.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-16T00:50:29.297 INFO:teuthology.orchestra.run.smithi088.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 3.0 MB/s | 506 kB 00:00 2024-09-16T00:50:29.412 INFO:teuthology.orchestra.run.smithi154.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-16T00:50:29.462 INFO:teuthology.orchestra.run.smithi154.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-16T00:50:29.479 INFO:teuthology.orchestra.run.smithi154.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-16T00:50:29.505 INFO:teuthology.orchestra.run.smithi154.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T00:50:29.564 INFO:teuthology.orchestra.run.smithi154.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-16T00:50:29.588 INFO:teuthology.orchestra.run.smithi154.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-16T00:50:29.598 INFO:teuthology.orchestra.run.smithi088.stdout:(18/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 5.3 MB/s | 17 MB 00:03 2024-09-16T00:50:29.605 INFO:teuthology.orchestra.run.smithi154.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 916 kB/s | 38 kB 00:00 2024-09-16T00:50:29.673 INFO:teuthology.orchestra.run.smithi088.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 605 kB/s | 45 kB 00:00 2024-09-16T00:50:29.756 INFO:teuthology.orchestra.run.smithi088.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-16T00:50:29.806 INFO:teuthology.orchestra.run.smithi154.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2024-09-16T00:50:29.857 INFO:teuthology.orchestra.run.smithi088.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.6 MB/s | 161 kB 00:00 2024-09-16T00:50:30.123 INFO:teuthology.orchestra.run.smithi154.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-16T00:50:30.187 INFO:teuthology.orchestra.run.smithi017.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 4.3 MB/s | 5.3 MB 00:01 2024-09-16T00:50:30.269 INFO:teuthology.orchestra.run.smithi017.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 542 kB/s | 45 kB 00:00 2024-09-16T00:50:30.290 INFO:teuthology.orchestra.run.smithi154.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-16T00:50:30.299 INFO:teuthology.orchestra.run.smithi088.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 5.3 MB/s | 5.3 MB 00:01 2024-09-16T00:50:30.345 INFO:teuthology.orchestra.run.smithi017.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-16T00:50:30.349 INFO:teuthology.orchestra.run.smithi154.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T00:50:30.428 INFO:teuthology.orchestra.run.smithi017.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-16T00:50:30.457 INFO:teuthology.orchestra.run.smithi088.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 300 kB 00:00 2024-09-16T00:50:30.491 INFO:teuthology.orchestra.run.smithi088.stdout:(24/156): python3-rados-19.1.1-326.g8921c8ef.el 505 kB/s | 320 kB 00:00 2024-09-16T00:50:30.498 INFO:teuthology.orchestra.run.smithi154.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-09-16T00:50:30.541 INFO:teuthology.orchestra.run.smithi088.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.2 MB/s | 99 kB 00:00 2024-09-16T00:50:30.575 INFO:teuthology.orchestra.run.smithi088.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-16T00:50:30.625 INFO:teuthology.orchestra.run.smithi088.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-16T00:50:30.667 INFO:teuthology.orchestra.run.smithi088.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 767 kB/s | 32 kB 00:00 2024-09-16T00:50:30.670 INFO:teuthology.orchestra.run.smithi017.stdout:(22/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 3.2 MB/s | 17 MB 00:05 2024-09-16T00:50:30.696 INFO:teuthology.orchestra.run.smithi017.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 1.2 MB/s | 320 kB 00:00 2024-09-16T00:50:30.717 INFO:teuthology.orchestra.run.smithi088.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-16T00:50:30.723 INFO:teuthology.orchestra.run.smithi154.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-16T00:50:30.746 INFO:teuthology.orchestra.run.smithi017.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 99 kB 00:00 2024-09-16T00:50:30.766 INFO:teuthology.orchestra.run.smithi154.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-09-16T00:50:30.783 INFO:teuthology.orchestra.run.smithi154.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-16T00:50:30.788 INFO:teuthology.orchestra.run.smithi017.stdout:(25/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.5 MB/s | 300 kB 00:00 2024-09-16T00:50:30.813 INFO:teuthology.orchestra.run.smithi017.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-16T00:50:30.833 INFO:teuthology.orchestra.run.smithi154.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-16T00:50:30.925 INFO:teuthology.orchestra.run.smithi154.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-16T00:50:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-16T00:50:31.034 INFO:teuthology.orchestra.run.smithi088.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 3.1 MB 00:00 2024-09-16T00:50:31.059 INFO:teuthology.orchestra.run.smithi154.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-16T00:50:31.109 INFO:teuthology.orchestra.run.smithi154.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-16T00:50:31.184 INFO:teuthology.orchestra.run.smithi154.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-16T00:50:31.231 INFO:teuthology.orchestra.run.smithi017.stdout:(27/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 12 MB/s | 49 MB 00:04 2024-09-16T00:50:31.234 INFO:teuthology.orchestra.run.smithi154.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-16T00:50:31.247 INFO:teuthology.orchestra.run.smithi017.stdout:(28/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 393 kB/s | 170 kB 00:00 2024-09-16T00:50:31.314 INFO:teuthology.orchestra.run.smithi017.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 382 kB/s | 32 kB 00:00 2024-09-16T00:50:31.389 INFO:teuthology.orchestra.run.smithi017.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.0 MB/s | 146 kB 00:00 2024-09-16T00:50:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.3 MB/s | 5.8 MB 00:01 2024-09-16T00:50:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-16T00:50:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-16T00:50:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T00:50:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-16T00:50:31.743 INFO:teuthology.orchestra.run.smithi088.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 3.5 MB/s | 3.6 MB 00:01 2024-09-16T00:50:31.770 INFO:teuthology.orchestra.run.smithi154.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-16T00:50:31.815 INFO:teuthology.orchestra.run.smithi017.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 7.1 MB/s | 3.6 MB 00:00 2024-09-16T00:50:31.820 INFO:teuthology.orchestra.run.smithi154.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-16T00:50:31.845 INFO:teuthology.orchestra.run.smithi154.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-16T00:50:31.868 INFO:teuthology.orchestra.run.smithi088.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.0 MB/s | 249 kB 00:00 2024-09-16T00:50:31.895 INFO:teuthology.orchestra.run.smithi154.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T00:50:31.898 INFO:teuthology.orchestra.run.smithi017.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.9 MB/s | 249 kB 00:00 2024-09-16T00:50:31.920 INFO:teuthology.orchestra.run.smithi154.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-16T00:50:31.926 INFO:teuthology.orchestra.run.smithi088.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 846 kB/s | 49 kB 00:00 2024-09-16T00:50:31.938 INFO:teuthology.orchestra.run.smithi154.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-16T00:50:31.965 INFO:teuthology.orchestra.run.smithi017.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 742 kB/s | 49 kB 00:00 2024-09-16T00:50:31.979 INFO:teuthology.orchestra.run.smithi154.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-16T00:50:31.993 INFO:teuthology.orchestra.run.smithi088.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 246 kB/s | 16 kB 00:00 2024-09-16T00:50:32.021 INFO:teuthology.orchestra.run.smithi154.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-16T00:50:32.065 INFO:teuthology.orchestra.run.smithi017.stdout:(34/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 2.4 MB/s | 3.1 MB 00:01 2024-09-16T00:50:32.080 INFO:teuthology.orchestra.run.smithi154.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-16T00:50:32.083 INFO:teuthology.orchestra.run.smithi017.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 141 kB/s | 16 kB 00:00 2024-09-16T00:50:32.119 INFO:teuthology.orchestra.run.smithi088.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 2.2 MB/s | 285 kB 00:00 2024-09-16T00:50:32.130 INFO:teuthology.orchestra.run.smithi154.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 722 kB/s | 36 kB 00:00 2024-09-16T00:50:32.172 INFO:teuthology.orchestra.run.smithi154.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T00:50:32.182 INFO:teuthology.orchestra.run.smithi017.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 2.4 MB/s | 285 kB 00:00 2024-09-16T00:50:32.208 INFO:teuthology.orchestra.run.smithi017.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-16T00:50:32.250 INFO:teuthology.orchestra.run.smithi017.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 272 kB/s | 18 kB 00:00 2024-09-16T00:50:32.255 INFO:teuthology.orchestra.run.smithi154.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-16T00:50:32.306 INFO:teuthology.orchestra.run.smithi154.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T00:50:32.308 INFO:teuthology.orchestra.run.smithi017.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 797 kB/s | 80 kB 00:00 2024-09-16T00:50:32.356 INFO:teuthology.orchestra.run.smithi154.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-16T00:50:32.367 INFO:teuthology.orchestra.run.smithi017.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T00:50:32.377 INFO:teuthology.orchestra.run.smithi088.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 5.5 MB/s | 7.4 MB 00:01 2024-09-16T00:50:32.407 INFO:teuthology.orchestra.run.smithi154.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T00:50:32.425 INFO:teuthology.orchestra.run.smithi017.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-16T00:50:32.436 INFO:teuthology.orchestra.run.smithi088.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 2.4 MB/s | 765 kB 00:00 2024-09-16T00:50:32.448 INFO:teuthology.orchestra.run.smithi154.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T00:50:32.459 INFO:teuthology.orchestra.run.smithi017.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-16T00:50:32.461 INFO:teuthology.orchestra.run.smithi088.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 218 kB/s | 18 kB 00:00 2024-09-16T00:50:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-16T00:50:32.535 INFO:teuthology.orchestra.run.smithi017.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-16T00:50:32.540 INFO:teuthology.orchestra.run.smithi154.stdout:(102/156): python3-numpy-1.20.1-5.el9.x86_64.rp 3.9 MB/s | 5.1 MB 00:01 2024-09-16T00:50:32.553 INFO:teuthology.orchestra.run.smithi088.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-16T00:50:32.560 INFO:teuthology.orchestra.run.smithi017.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-16T00:50:32.566 INFO:teuthology.orchestra.run.smithi154.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-16T00:50:32.585 INFO:teuthology.orchestra.run.smithi017.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-16T00:50:32.610 INFO:teuthology.orchestra.run.smithi017.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-16T00:50:32.612 INFO:teuthology.orchestra.run.smithi088.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T00:50:32.616 INFO:teuthology.orchestra.run.smithi154.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T00:50:32.641 INFO:teuthology.orchestra.run.smithi154.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-16T00:50:32.645 INFO:teuthology.orchestra.run.smithi088.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-16T00:50:32.658 INFO:teuthology.orchestra.run.smithi154.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-16T00:50:32.671 INFO:teuthology.orchestra.run.smithi088.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-16T00:50:32.713 INFO:teuthology.orchestra.run.smithi088.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-16T00:50:32.738 INFO:teuthology.orchestra.run.smithi088.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-16T00:50:32.759 INFO:teuthology.orchestra.run.smithi154.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-16T00:50:32.764 INFO:teuthology.orchestra.run.smithi088.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-16T00:50:32.776 INFO:teuthology.orchestra.run.smithi154.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-16T00:50:32.778 INFO:teuthology.orchestra.run.smithi017.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-16T00:50:32.789 INFO:teuthology.orchestra.run.smithi088.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-16T00:50:32.801 INFO:teuthology.orchestra.run.smithi154.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T00:50:32.811 INFO:teuthology.orchestra.run.smithi017.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-16T00:50:32.814 INFO:teuthology.orchestra.run.smithi088.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-16T00:50:32.826 INFO:teuthology.orchestra.run.smithi154.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-16T00:50:32.845 INFO:teuthology.orchestra.run.smithi017.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-16T00:50:32.851 INFO:teuthology.orchestra.run.smithi154.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T00:50:32.887 INFO:teuthology.orchestra.run.smithi017.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-16T00:50:32.910 INFO:teuthology.orchestra.run.smithi154.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-16T00:50:32.920 INFO:teuthology.orchestra.run.smithi017.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-16T00:50:32.944 INFO:teuthology.orchestra.run.smithi154.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-16T00:50:32.969 INFO:teuthology.orchestra.run.smithi154.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-16T00:50:32.979 INFO:teuthology.orchestra.run.smithi017.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-16T00:50:32.994 INFO:teuthology.orchestra.run.smithi154.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T00:50:33.028 INFO:teuthology.orchestra.run.smithi154.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 423 kB/s | 14 kB 00:00 2024-09-16T00:50:33.053 INFO:teuthology.orchestra.run.smithi154.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-16T00:50:33.054 INFO:teuthology.orchestra.run.smithi017.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-16T00:50:33.078 INFO:teuthology.orchestra.run.smithi154.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T00:50:33.081 INFO:teuthology.orchestra.run.smithi088.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-16T00:50:33.096 INFO:teuthology.orchestra.run.smithi017.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-16T00:50:33.104 INFO:teuthology.orchestra.run.smithi154.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-16T00:50:33.114 INFO:teuthology.orchestra.run.smithi088.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-16T00:50:33.140 INFO:teuthology.orchestra.run.smithi088.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-16T00:50:33.154 INFO:teuthology.orchestra.run.smithi154.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-16T00:50:33.157 INFO:teuthology.orchestra.run.smithi088.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-16T00:50:33.179 INFO:teuthology.orchestra.run.smithi154.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-16T00:50:33.188 INFO:teuthology.orchestra.run.smithi017.stdout:(56/156): ceph-mgr-diskprediction-local-19.1.1- 4.1 MB/s | 7.4 MB 00:01 2024-09-16T00:50:33.205 INFO:teuthology.orchestra.run.smithi154.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-16T00:50:33.207 INFO:teuthology.orchestra.run.smithi088.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-16T00:50:33.213 INFO:teuthology.orchestra.run.smithi017.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 70 kB/s | 11 kB 00:00 2024-09-16T00:50:33.224 INFO:teuthology.orchestra.run.smithi088.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-16T00:50:33.230 INFO:teuthology.orchestra.run.smithi154.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-16T00:50:33.239 INFO:teuthology.orchestra.run.smithi017.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-16T00:50:33.255 INFO:teuthology.orchestra.run.smithi154.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-16T00:50:33.264 INFO:teuthology.orchestra.run.smithi017.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-16T00:50:33.280 INFO:teuthology.orchestra.run.smithi154.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-16T00:50:33.306 INFO:teuthology.orchestra.run.smithi154.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-16T00:50:33.322 INFO:teuthology.orchestra.run.smithi017.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-16T00:50:33.331 INFO:teuthology.orchestra.run.smithi154.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-16T00:50:33.348 INFO:teuthology.orchestra.run.smithi017.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-16T00:50:33.381 INFO:teuthology.orchestra.run.smithi154.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-16T00:50:33.398 INFO:teuthology.orchestra.run.smithi017.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-16T00:50:33.406 INFO:teuthology.orchestra.run.smithi154.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:50:33.432 INFO:teuthology.orchestra.run.smithi154.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T00:50:33.440 INFO:teuthology.orchestra.run.smithi017.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-16T00:50:33.457 INFO:teuthology.orchestra.run.smithi154.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T00:50:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:(64/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-16T00:50:33.491 INFO:teuthology.orchestra.run.smithi154.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-16T00:50:33.491 INFO:teuthology.orchestra.run.smithi017.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-16T00:50:33.508 INFO:teuthology.orchestra.run.smithi017.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 572 kB/s | 38 kB 00:00 2024-09-16T00:50:33.525 INFO:teuthology.orchestra.run.smithi154.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 491 kB/s | 16 kB 00:00 2024-09-16T00:50:33.550 INFO:teuthology.orchestra.run.smithi154.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-16T00:50:33.575 INFO:teuthology.orchestra.run.smithi154.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-16T00:50:33.600 INFO:teuthology.orchestra.run.smithi017.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-16T00:50:33.600 INFO:teuthology.orchestra.run.smithi154.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-16T00:50:33.626 INFO:teuthology.orchestra.run.smithi154.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-16T00:50:33.651 INFO:teuthology.orchestra.run.smithi154.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T00:50:33.666 INFO:teuthology.orchestra.run.smithi017.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-16T00:50:33.674 INFO:teuthology.orchestra.run.smithi088.stdout:(54/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 8.6 MB/s | 49 MB 00:05 2024-09-16T00:50:33.676 INFO:teuthology.orchestra.run.smithi154.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T00:50:33.691 INFO:teuthology.orchestra.run.smithi088.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 39 kB/s | 18 kB 00:00 2024-09-16T00:50:33.693 INFO:teuthology.orchestra.run.smithi154.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 854 kB/s | 36 kB 00:00 2024-09-16T00:50:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-16T00:50:33.718 INFO:teuthology.orchestra.run.smithi154.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-16T00:50:33.744 INFO:teuthology.orchestra.run.smithi154.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-16T00:50:33.750 INFO:teuthology.orchestra.run.smithi088.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-16T00:50:33.750 INFO:teuthology.orchestra.run.smithi017.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-16T00:50:33.767 INFO:teuthology.orchestra.run.smithi088.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-16T00:50:33.769 INFO:teuthology.orchestra.run.smithi154.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-16T00:50:33.786 INFO:teuthology.orchestra.run.smithi154.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-16T00:50:33.792 INFO:teuthology.orchestra.run.smithi088.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T00:50:33.820 INFO:teuthology.orchestra.run.smithi154.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-16T00:50:33.845 INFO:teuthology.orchestra.run.smithi154.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T00:50:33.859 INFO:teuthology.orchestra.run.smithi017.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-09-16T00:50:33.895 INFO:teuthology.orchestra.run.smithi154.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-16T00:50:33.901 INFO:teuthology.orchestra.run.smithi017.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-16T00:50:33.917 INFO:teuthology.orchestra.run.smithi088.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-16T00:50:33.959 INFO:teuthology.orchestra.run.smithi088.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-16T00:50:33.968 INFO:teuthology.orchestra.run.smithi017.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.8 MB/s | 4.9 MB 00:00 2024-09-16T00:50:33.993 INFO:teuthology.orchestra.run.smithi017.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 655 kB/s | 87 kB 00:00 2024-09-16T00:50:34.001 INFO:teuthology.orchestra.run.smithi088.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T00:50:34.035 INFO:teuthology.orchestra.run.smithi088.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-09-16T00:50:34.035 INFO:teuthology.orchestra.run.smithi017.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 919 kB/s | 61 kB 00:00 2024-09-16T00:50:34.060 INFO:teuthology.orchestra.run.smithi088.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-16T00:50:34.094 INFO:teuthology.orchestra.run.smithi088.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-16T00:50:34.110 INFO:teuthology.orchestra.run.smithi017.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-16T00:50:34.111 INFO:teuthology.orchestra.run.smithi088.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-16T00:50:34.135 INFO:teuthology.orchestra.run.smithi017.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-16T00:50:34.178 INFO:teuthology.orchestra.run.smithi017.stdout:(78/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-16T00:50:34.195 INFO:teuthology.orchestra.run.smithi017.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 305 kB/s | 26 kB 00:00 2024-09-16T00:50:34.212 INFO:teuthology.orchestra.run.smithi017.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 252 kB/s | 19 kB 00:00 2024-09-16T00:50:34.212 INFO:teuthology.orchestra.run.smithi154.stdout:(148/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-16T00:50:34.254 INFO:teuthology.orchestra.run.smithi017.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-16T00:50:34.261 INFO:teuthology.orchestra.run.smithi088.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-16T00:50:34.270 INFO:teuthology.orchestra.run.smithi017.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-16T00:50:34.353 INFO:teuthology.orchestra.run.smithi088.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-16T00:50:34.363 INFO:teuthology.orchestra.run.smithi017.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-16T00:50:34.388 INFO:teuthology.orchestra.run.smithi017.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-16T00:50:34.396 INFO:teuthology.orchestra.run.smithi154.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-16T00:50:34.413 INFO:teuthology.orchestra.run.smithi017.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-16T00:50:34.429 INFO:teuthology.orchestra.run.smithi088.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-16T00:50:34.438 INFO:teuthology.orchestra.run.smithi017.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-16T00:50:34.446 INFO:teuthology.orchestra.run.smithi154.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 5.7 MB/s | 3.4 MB 00:00 2024-09-16T00:50:34.464 INFO:teuthology.orchestra.run.smithi017.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-09-16T00:50:34.487 INFO:teuthology.orchestra.run.smithi088.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T00:50:34.496 INFO:teuthology.orchestra.run.smithi154.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-09-16T00:50:34.505 INFO:teuthology.orchestra.run.smithi017.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-16T00:50:34.521 INFO:teuthology.orchestra.run.smithi154.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 541 kB/s | 41 kB 00:00 2024-09-16T00:50:34.531 INFO:teuthology.orchestra.run.smithi017.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-16T00:50:34.556 INFO:teuthology.orchestra.run.smithi017.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-16T00:50:34.564 INFO:teuthology.orchestra.run.smithi154.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-09-16T00:50:34.597 INFO:teuthology.orchestra.run.smithi154.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-16T00:50:34.598 INFO:teuthology.orchestra.run.smithi017.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-16T00:50:34.623 INFO:teuthology.orchestra.run.smithi017.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 582 kB/s | 54 kB 00:00 2024-09-16T00:50:34.647 INFO:teuthology.orchestra.run.smithi154.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-16T00:50:34.654 INFO:teuthology.orchestra.run.smithi088.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-16T00:50:34.674 INFO:teuthology.orchestra.run.smithi017.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-16T00:50:34.699 INFO:teuthology.orchestra.run.smithi017.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-16T00:50:34.706 INFO:teuthology.orchestra.run.smithi154.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-16T00:50:34.711 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:50:34.711 INFO:teuthology.orchestra.run.smithi154.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-16T00:50:34.729 INFO:teuthology.orchestra.run.smithi088.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-09-16T00:50:34.758 INFO:teuthology.orchestra.run.smithi017.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-16T00:50:34.763 INFO:teuthology.orchestra.run.smithi088.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-16T00:50:34.783 INFO:teuthology.orchestra.run.smithi017.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 429 kB/s | 36 kB 00:00 2024-09-16T00:50:34.813 INFO:teuthology.orchestra.run.smithi088.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-16T00:50:34.842 INFO:teuthology.orchestra.run.smithi017.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-16T00:50:34.867 INFO:teuthology.orchestra.run.smithi017.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-16T00:50:34.872 INFO:teuthology.orchestra.run.smithi088.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-16T00:50:34.955 INFO:teuthology.orchestra.run.smithi088.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-16T00:50:34.998 INFO:teuthology.orchestra.run.smithi088.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-16T00:50:35.023 INFO:teuthology.orchestra.run.smithi088.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-16T00:50:35.036 INFO:teuthology.orchestra.run.smithi017.stdout:(99/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-16T00:50:35.048 INFO:teuthology.orchestra.run.smithi088.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-16T00:50:35.059 INFO:teuthology.orchestra.run.smithi017.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 266 kB/s | 58 kB 00:00 2024-09-16T00:50:35.085 INFO:teuthology.orchestra.run.smithi017.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 441 kB/s | 96 kB 00:00 2024-09-16T00:50:35.110 INFO:teuthology.orchestra.run.smithi017.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-16T00:50:35.123 INFO:teuthology.orchestra.run.smithi088.stdout:(79/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-09-16T00:50:35.135 INFO:teuthology.orchestra.run.smithi017.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 592 kB/s | 45 kB 00:00 2024-09-16T00:50:35.148 INFO:teuthology.orchestra.run.smithi088.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-09-16T00:50:35.174 INFO:teuthology.orchestra.run.smithi088.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-16T00:50:35.185 INFO:teuthology.orchestra.run.smithi017.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T00:50:35.199 INFO:teuthology.orchestra.run.smithi088.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-16T00:50:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-16T00:50:35.241 INFO:teuthology.orchestra.run.smithi088.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-16T00:50:35.244 INFO:teuthology.orchestra.run.smithi017.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-16T00:50:35.266 INFO:teuthology.orchestra.run.smithi088.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-16T00:50:35.333 INFO:teuthology.orchestra.run.smithi088.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-16T00:50:35.344 INFO:teuthology.orchestra.run.smithi017.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-16T00:50:35.350 INFO:teuthology.orchestra.run.smithi088.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-09-16T00:50:35.375 INFO:teuthology.orchestra.run.smithi088.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 576 kB/s | 77 kB 00:00 2024-09-16T00:50:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T00:50:35.401 INFO:teuthology.orchestra.run.smithi088.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-16T00:50:35.403 INFO:teuthology.orchestra.run.smithi017.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-16T00:50:35.426 INFO:teuthology.orchestra.run.smithi088.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-16T00:50:35.428 INFO:teuthology.orchestra.run.smithi017.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T00:50:35.451 INFO:teuthology.orchestra.run.smithi088.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-16T00:50:35.454 INFO:teuthology.orchestra.run.smithi017.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-16T00:50:35.468 INFO:teuthology.orchestra.run.smithi088.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-09-16T00:50:35.485 INFO:teuthology.orchestra.run.smithi088.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 911 kB/s | 54 kB 00:00 2024-09-16T00:50:35.496 INFO:teuthology.orchestra.run.smithi017.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-16T00:50:35.519 INFO:teuthology.orchestra.run.smithi088.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-16T00:50:35.529 INFO:teuthology.orchestra.run.smithi017.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-16T00:50:35.535 INFO:teuthology.orchestra.run.smithi088.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-16T00:50:35.554 INFO:teuthology.orchestra.run.smithi017.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-16T00:50:35.578 INFO:teuthology.orchestra.run.smithi088.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-16T00:50:35.580 INFO:teuthology.orchestra.run.smithi017.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T00:50:35.595 INFO:teuthology.orchestra.run.smithi088.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-16T00:50:35.605 INFO:teuthology.orchestra.run.smithi017.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 561 kB/s | 14 kB 00:00 2024-09-16T00:50:35.628 INFO:teuthology.orchestra.run.smithi088.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-16T00:50:35.630 INFO:teuthology.orchestra.run.smithi017.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-16T00:50:35.654 INFO:teuthology.orchestra.run.smithi088.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-16T00:50:35.664 INFO:teuthology.orchestra.run.smithi017.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-16T00:50:35.679 INFO:teuthology.orchestra.run.smithi088.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T00:50:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-16T00:50:35.712 INFO:teuthology.orchestra.run.smithi088.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-16T00:50:35.812 INFO:teuthology.orchestra.run.smithi088.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T00:50:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-16T00:50:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 35 MB/s | 2.0 MB 00:00 2024-09-16T00:50:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:(122/156): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-16T00:50:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2024-09-16T00:50:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-16T00:50:35.888 INFO:teuthology.orchestra.run.smithi088.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-16T00:50:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 313 kB/s | 18 kB 00:00 2024-09-16T00:50:35.905 INFO:teuthology.orchestra.run.smithi088.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-16T00:50:35.916 INFO:teuthology.orchestra.run.smithi017.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 790 kB/s | 19 kB 00:00 2024-09-16T00:50:35.942 INFO:teuthology.orchestra.run.smithi017.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-16T00:50:35.949 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-16T00:50:35.955 INFO:teuthology.orchestra.run.smithi088.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T00:50:35.967 INFO:teuthology.orchestra.run.smithi017.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-16T00:50:35.989 INFO:teuthology.orchestra.run.smithi088.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-16T00:50:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:50:36.006 INFO:teuthology.orchestra.run.smithi088.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-16T00:50:36.017 INFO:teuthology.orchestra.run.smithi017.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T00:50:36.043 INFO:teuthology.orchestra.run.smithi017.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T00:50:36.077 INFO:teuthology.orchestra.run.smithi017.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-16T00:50:36.102 INFO:teuthology.orchestra.run.smithi017.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-16T00:50:36.102 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-16T00:50:36.103 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-16T00:50:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-16T00:50:36.127 INFO:teuthology.orchestra.run.smithi017.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T00:50:36.131 INFO:teuthology.orchestra.run.smithi088.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.4 MB/s | 26 kB 00:00 2024-09-16T00:50:36.148 INFO:teuthology.orchestra.run.smithi088.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-16T00:50:36.152 INFO:teuthology.orchestra.run.smithi017.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-16T00:50:36.174 INFO:teuthology.orchestra.run.smithi088.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T00:50:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-16T00:50:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-16T00:50:36.203 INFO:teuthology.orchestra.run.smithi017.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-16T00:50:36.228 INFO:teuthology.orchestra.run.smithi017.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-09-16T00:50:36.232 INFO:teuthology.orchestra.run.smithi088.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-16T00:50:36.254 INFO:teuthology.orchestra.run.smithi017.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-16T00:50:36.266 INFO:teuthology.orchestra.run.smithi088.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-16T00:50:36.279 INFO:teuthology.orchestra.run.smithi017.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-16T00:50:36.291 INFO:teuthology.orchestra.run.smithi088.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-16T00:50:36.304 INFO:teuthology.orchestra.run.smithi017.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-16T00:50:36.316 INFO:teuthology.orchestra.run.smithi088.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T00:50:36.330 INFO:teuthology.orchestra.run.smithi017.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-16T00:50:36.350 INFO:teuthology.orchestra.run.smithi088.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 537 kB/s | 14 kB 00:00 2024-09-16T00:50:36.355 INFO:teuthology.orchestra.run.smithi017.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-16T00:50:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-16T00:50:36.383 INFO:teuthology.orchestra.run.smithi088.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-16T00:50:36.405 INFO:teuthology.orchestra.run.smithi017.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-16T00:50:36.409 INFO:teuthology.orchestra.run.smithi088.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 14 MB/s | 358 kB 00:00 2024-09-16T00:50:36.431 INFO:teuthology.orchestra.run.smithi017.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-16T00:50:36.434 INFO:teuthology.orchestra.run.smithi088.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-16T00:50:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.6 MB/s | 220 kB 00:00 2024-09-16T00:50:36.481 INFO:teuthology.orchestra.run.smithi017.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-16T00:50:36.501 INFO:teuthology.orchestra.run.smithi088.stdout:(121/156): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-09-16T00:50:36.552 INFO:teuthology.orchestra.run.smithi088.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-16T00:50:36.594 INFO:teuthology.orchestra.run.smithi088.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-09-16T00:50:36.619 INFO:teuthology.orchestra.run.smithi088.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-09-16T00:50:36.644 INFO:teuthology.orchestra.run.smithi088.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-16T00:50:36.678 INFO:teuthology.orchestra.run.smithi088.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2024-09-16T00:50:36.703 INFO:teuthology.orchestra.run.smithi088.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-09-16T00:50:36.720 INFO:teuthology.orchestra.run.smithi088.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-09-16T00:50:36.723 INFO:teuthology.orchestra.run.smithi017.stdout:(148/156): librados2-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-16T00:50:36.745 INFO:teuthology.orchestra.run.smithi088.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T00:50:36.771 INFO:teuthology.orchestra.run.smithi088.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T00:50:36.788 INFO:teuthology.orchestra.run.smithi088.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-16T00:50:36.830 INFO:teuthology.orchestra.run.smithi088.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-16T00:50:36.846 INFO:teuthology.orchestra.run.smithi088.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-16T00:50:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T00:50:36.890 INFO:teuthology.orchestra.run.smithi017.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-09-16T00:50:36.897 INFO:teuthology.orchestra.run.smithi088.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-16T00:50:36.914 INFO:teuthology.orchestra.run.smithi088.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-16T00:50:36.923 INFO:teuthology.orchestra.run.smithi017.stdout:(150/156): protobuf-compiler-3.14.0-13.el9.x86_ 476 kB/s | 863 kB 00:01 2024-09-16T00:50:36.931 INFO:teuthology.orchestra.run.smithi088.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-16T00:50:36.948 INFO:teuthology.orchestra.run.smithi088.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-16T00:50:36.965 INFO:teuthology.orchestra.run.smithi017.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-16T00:50:36.973 INFO:teuthology.orchestra.run.smithi088.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-16T00:50:36.990 INFO:teuthology.orchestra.run.smithi088.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 852 kB/s | 36 kB 00:00 2024-09-16T00:50:36.992 INFO:teuthology.orchestra.run.smithi017.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 594 kB/s | 41 kB 00:00 2024-09-16T00:50:37.015 INFO:teuthology.orchestra.run.smithi088.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-16T00:50:37.018 INFO:teuthology.orchestra.run.smithi017.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.7 MB/s | 249 kB 00:00 2024-09-16T00:50:37.041 INFO:teuthology.orchestra.run.smithi088.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-16T00:50:37.066 INFO:teuthology.orchestra.run.smithi088.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-16T00:50:37.083 INFO:teuthology.orchestra.run.smithi088.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-16T00:50:37.085 INFO:teuthology.orchestra.run.smithi017.stdout:(154/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 5.2 MB/s | 3.2 MB 00:00 2024-09-16T00:50:37.116 INFO:teuthology.orchestra.run.smithi088.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-16T00:50:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-16T00:50:37.142 INFO:teuthology.orchestra.run.smithi088.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T00:50:37.168 INFO:teuthology.orchestra.run.smithi017.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-16T00:50:37.174 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:50:37.174 INFO:teuthology.orchestra.run.smithi017.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-16T00:50:37.192 INFO:teuthology.orchestra.run.smithi088.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-16T00:50:37.534 INFO:teuthology.orchestra.run.smithi088.stdout:(148/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-16T00:50:37.685 INFO:teuthology.orchestra.run.smithi088.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.3 MB/s | 3.4 MB 00:00 2024-09-16T00:50:37.743 INFO:teuthology.orchestra.run.smithi088.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-16T00:50:37.785 INFO:teuthology.orchestra.run.smithi088.stdout:(151/156): protobuf-compiler-3.14.0-13.el9.x86_ 455 kB/s | 863 kB 00:01 2024-09-16T00:50:37.802 INFO:teuthology.orchestra.run.smithi088.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 699 kB/s | 41 kB 00:00 2024-09-16T00:50:37.869 INFO:teuthology.orchestra.run.smithi088.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-16T00:50:38.085 INFO:teuthology.orchestra.run.smithi088.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.5 MB/s | 1.8 MB 00:00 2024-09-16T00:50:38.120 INFO:teuthology.orchestra.run.smithi088.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 744 kB/s | 249 kB 00:00 2024-09-16T00:50:38.170 INFO:teuthology.orchestra.run.smithi088.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.0 MB/s | 2.4 MB 00:00 2024-09-16T00:50:38.176 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:50:38.176 INFO:teuthology.orchestra.run.smithi088.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-16T00:50:38.348 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-16T00:50:38.348 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-16T00:50:38.440 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-16T00:50:38.609 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-16T00:50:38.609 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-16T00:50:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-09-16T00:50:39.532 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-09-16T00:50:39.533 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-09-16T00:50:40.930 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-16T00:50:40.930 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-16T00:50:41.749 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-09-16T00:50:41.749 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-09-16T00:50:44.759 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-16T00:50:44.860 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:50:44.904 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:50:44.968 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:50:45.002 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:50:45.028 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:50:45.087 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:50:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:50:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:45.666 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:45.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:45.796 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:45.829 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:50:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:50:46.056 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:50:46.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:46.171 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:46.193 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:46.513 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:46.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:46.825 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:50:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:47.027 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:47.255 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:47.363 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:50:47.454 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:50:47.490 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:50:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:50:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:50:47.642 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:50:47.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:50:47.718 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:50:47.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:50:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-16T00:50:47.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:50:47.856 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:50:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:50:47.909 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:50:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:50:47.940 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:50:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:50:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:50:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:50:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:50:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:50:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:50:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:50:48.148 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:50:48.174 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:50:48.244 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:50:48.285 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-09-16T00:50:48.297 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:50:48.371 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:50:48.423 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T00:50:48.462 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T00:50:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:50:48.504 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:50:48.523 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T00:50:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T00:50:48.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:50:48.591 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T00:50:48.593 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:48.646 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T00:50:48.717 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:50:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T00:50:49.066 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:50:49.085 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:50:49.092 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:49.135 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:50:49.164 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:49.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:50:49.199 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:50:49.213 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:50:49.234 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:50:49.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:49.253 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:49.271 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:50:49.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:49.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:50:49.326 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:50:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:49.355 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:50:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:50:49.518 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T00:50:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:50:49.569 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T00:50:49.578 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:49.578 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:50:49.596 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:49.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:50:49.683 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:50:49.701 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:50:49.719 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:50:49.740 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:49.751 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:49.766 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:50:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:50:49.810 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T00:50:49.832 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:50:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T00:50:49.881 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:50:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:50:50.001 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.050 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:50.075 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.126 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:50:50.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T00:50:50.317 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.331 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:50:50.372 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T00:50:50.372 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:50:50.428 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:50:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:50:50.486 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.529 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:50:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:50:50.563 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:50:50.565 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:50:50.599 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:50:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:50:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:50:50.674 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:50:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:50:50.725 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:50:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:50:50.803 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T00:50:50.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:50:50.841 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:50:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:50:50.906 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:50:50.925 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T00:50:50.940 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:50:50.943 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:50:50.979 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:50:51.005 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:50:51.016 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:50:51.017 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T00:50:51.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:50:51.045 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T00:50:51.047 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:50:51.078 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:50:51.080 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T00:50:51.082 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:50:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:50:51.145 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T00:50:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:50:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:50:51.193 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:50:51.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T00:50:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:50:51.230 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T00:50:51.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:50:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:50:51.281 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T00:50:51.299 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:50:51.314 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T00:50:51.339 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:50:51.344 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:50:51.350 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T00:50:51.375 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:50:51.397 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:50:51.419 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T00:50:51.475 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:50:51.478 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:50:51.480 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T00:50:51.511 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T00:50:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:50:51.555 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T00:50:51.628 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:50:51.632 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T00:50:51.665 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T00:50:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:50:51.709 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T00:50:51.737 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T00:50:51.814 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T00:50:51.869 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T00:50:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T00:50:52.074 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T00:50:52.129 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T00:50:52.245 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:50:52.268 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:50:52.289 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:50:52.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:50:52.356 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:50:52.399 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:50:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:50:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:50:52.469 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:50:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:50:52.522 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:50:52.539 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:50:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:50:52.657 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T00:50:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:50:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:50:52.741 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T00:50:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:50:52.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T00:50:52.805 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T00:50:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:50:52.842 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:50:52.842 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T00:50:52.873 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:50:52.885 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T00:50:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:50:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:50:52.970 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:50:53.018 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:50:53.038 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T00:50:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:50:53.096 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T00:50:53.096 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:50:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:50:53.150 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T00:50:53.222 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T00:50:53.255 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T00:50:53.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T00:50:53.291 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:50:53.337 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T00:50:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:50:53.382 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T00:50:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:50:53.425 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T00:50:53.467 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T00:50:53.490 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:50:53.524 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:50:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T00:50:53.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:50:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:50:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T00:50:53.694 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T00:50:53.705 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:50:53.796 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T00:50:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:50:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:50:54.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:50:54.071 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T00:50:54.120 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T00:50:54.153 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:50:54.160 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T00:50:54.185 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T00:50:54.191 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:50:54.219 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:50:54.256 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:50:54.283 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T00:50:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:50:54.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:50:54.362 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:50:54.397 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:50:54.413 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T00:50:54.430 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:50:54.450 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T00:50:54.472 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:50:54.490 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T00:50:54.506 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:50:54.531 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T00:50:54.570 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T00:50:54.597 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:50:54.602 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T00:50:54.632 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T00:50:54.646 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:50:54.667 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T00:50:54.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:50:54.700 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T00:50:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T00:50:54.785 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T00:50:54.785 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:50:54.845 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:50:54.870 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T00:50:54.915 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T00:50:54.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:50:54.946 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T00:50:55.026 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:50:55.049 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T00:50:55.054 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:50:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:50:55.096 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T00:50:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:50:55.467 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:55.560 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:55.609 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:50:55.658 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:50:55.682 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:50:55.692 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:50:55.721 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:50:55.804 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:50:55.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T00:50:55.858 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:50:55.861 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T00:50:55.895 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T00:50:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:50:55.992 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T00:50:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:50:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:50:56.041 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T00:50:56.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T00:50:56.180 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T00:50:56.198 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:50:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:50:56.238 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:56.239 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T00:50:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:50:56.310 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:56.332 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:50:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:50:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T00:50:56.454 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T00:50:56.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T00:50:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:50:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:50:57.184 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T00:50:57.310 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T00:50:58.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:50:58.551 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T00:50:58.566 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:50:58.595 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:50:58.606 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:50:58.628 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:50:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T00:50:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:50:58.670 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T00:50:58.703 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T00:50:58.954 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:50:59.007 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:59.012 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T00:50:59.058 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:59.108 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:59.148 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T00:50:59.154 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:50:59.179 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T00:50:59.209 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:50:59.209 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:50:59.224 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T00:50:59.256 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:50:59.347 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:50:59.347 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:50:59.347 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:50:59.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:50:59.383 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:50:59.712 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:50:59.715 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T00:50:59.743 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:59.761 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:59.809 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:59.831 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T00:50:59.837 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:50:59.862 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T00:51:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.273 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.283 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.317 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.833 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.870 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:51:02.900 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T00:51:02.945 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:51:02.961 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:51:02.962 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:51:02.962 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:51:02.962 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:03.005 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:51:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T00:51:03.021 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:51:03.021 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:51:03.021 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:03.063 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-16T00:51:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-16T00:51:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:11.168 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:11.184 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:11.185 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:11.185 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:51:11.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:12.682 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:12.682 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:51:12.682 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:12.683 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:12.913 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:12.937 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:13.502 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:51:13.559 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:51:13.623 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:51:13.809 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:51:13.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:51:13.960 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:51:14.081 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:51:14.229 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:51:14.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:51:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:51:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:51:14.779 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:14.806 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:14.838 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:51:14.900 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:51:14.929 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:14.931 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:51:14.931 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-09-16T00:51:14.932 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:15.115 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:15.131 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:15.131 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:51:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-16T00:51:15.392 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:15.576 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T00:51:15.598 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:15.598 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T00:51:15.598 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:15.984 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:16.023 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:16.618 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:16.644 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:16.891 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:16.892 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:51:16.892 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:16.892 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:16.986 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:17.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:17.107 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T00:51:17.149 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:17.149 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:51:17.149 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:17.150 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:51:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:17.291 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:51:17.316 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:17.327 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:17.340 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:17.341 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:17.341 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:51:17.341 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:17.341 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:17.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:17.351 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:17.392 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:17.404 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:17.413 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T00:51:17.413 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:17.413 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:51:17.413 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:17.414 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:51:17.414 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:17.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:51:17.501 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:51:17.514 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:51:17.555 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:51:17.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:51:17.763 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:51:17.812 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:51:17.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:17.890 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:51:17.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:17.977 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:51:18.003 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T00:51:18.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T00:51:18.118 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:51:18.125 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T00:51:18.180 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:51:18.238 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:51:18.271 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:51:18.321 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T00:51:18.373 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T00:51:18.455 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T00:51:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:51:18.511 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:18.535 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:18.535 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:18.536 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:51:18.536 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:18.536 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:18.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:18.552 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T00:51:18.579 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:18.601 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:18.602 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:18.602 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:51:18.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:18.646 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:18.669 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:18.669 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:18.669 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:51:18.670 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:18.670 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:18.670 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:18.697 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T00:51:18.724 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:18.749 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T00:51:18.753 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:51:18.788 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T00:51:18.824 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T00:51:18.846 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:51:18.876 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:18.971 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:18.995 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:18.995 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:18.995 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:51:18.995 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:18.996 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:18.996 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:19.248 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T00:51:19.305 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T00:51:19.370 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T00:51:19.396 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:19.914 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:19.952 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T00:51:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:20.909 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:20.944 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:21.047 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:51:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:21.272 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:21.272 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:51:21.272 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:21.273 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:21.334 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:21.436 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:51:21.493 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:51:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T00:51:21.598 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:21.708 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T00:51:21.880 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T00:51:21.909 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:51:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:21.985 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T00:51:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T00:51:22.161 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T00:51:22.426 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:51:22.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:22.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:22.535 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:22.557 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:22.557 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:22.557 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:51:22.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:22.601 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:22.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:22.927 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:22.950 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:23.136 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T00:51:23.170 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:23.195 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T00:51:23.196 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:23.196 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:51:23.196 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:23.196 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:51:23.196 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:23.246 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:23.271 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T00:51:23.271 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:23.271 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:51:23.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:23.322 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:23.348 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T00:51:23.348 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:23.349 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T00:51:23.349 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:23.349 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T00:51:23.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:51:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:51:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:51:23.664 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:23.665 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:51:23.690 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:23.692 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:51:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:51:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:51:23.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:51:23.981 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:51:24.027 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:51:24.676 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:25.572 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:51:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:51:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:51:25.796 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:51:25.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:51:25.850 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:51:25.875 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:51:25.876 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:26.060 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:26.085 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:51:26.090 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:26.090 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:26.287 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:26.287 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:26.363 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:27.521 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:51:27.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:51:27.603 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:51:27.635 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:51:27.663 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:51:27.856 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:51:27.909 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:51:27.948 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:51:27.978 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:51:28.024 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:51:28.535 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T00:51:28.576 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T00:51:28.611 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:28.618 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T00:51:28.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T00:51:28.654 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:28.676 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:28.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T00:51:28.892 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T00:51:28.940 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T00:51:28.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T00:51:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T00:51:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T00:51:29.508 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:51:29.601 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:51:29.651 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:51:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:29.741 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T00:51:29.744 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:51:29.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:51:29.805 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:51:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:51:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:30.015 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:30.041 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:51:30.045 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:30.045 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:30.217 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:30.391 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T00:51:30.749 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T00:51:30.803 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T00:51:30.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T00:51:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T00:51:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T00:51:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T00:51:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:31.071 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T00:51:31.071 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:31.147 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T00:51:31.172 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T00:51:31.177 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:31.178 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T00:51:31.374 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:31.453 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T00:51:31.526 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:51:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:51:32.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:51:32.069 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:51:32.081 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:51:32.082 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:51:32.083 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:51:32.084 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:51:32.085 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:51:32.085 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:51:32.085 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:51:32.086 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:51:32.087 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:51:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:51:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:51:32.091 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:51:32.091 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:51:32.091 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:51:32.091 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:51:32.091 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:51:32.092 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:51:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:51:32.094 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:51:32.095 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:51:32.096 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:51:32.096 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:51:32.096 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:51:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:51:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:51:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:51:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:51:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:51:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:51:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:51:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:51:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:51:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:51:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:51:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:51:34.722 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-16T00:51:35.135 DEBUG:teuthology.parallel:result is None 2024-09-16T00:51:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:51:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:51:36.144 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:51:36.145 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:51:36.146 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:51:36.147 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:51:36.148 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:51:36.149 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:51:36.150 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:51:36.151 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:51:36.151 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:51:36.151 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:51:36.151 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:51:36.152 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:51:36.153 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:51:36.154 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:51:36.155 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:51:36.156 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:51:36.157 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:51:36.158 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:51:37.112 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:37.112 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T00:51:37.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T00:51:37.114 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T00:51:37.115 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T00:51:37.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T00:51:37.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T00:51:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T00:51:37.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T00:51:37.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T00:51:37.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T00:51:37.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T00:51:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T00:51:37.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T00:51:37.135 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T00:51:37.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T00:51:37.137 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T00:51:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:39.000 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-09-16T00:51:39.000 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.001 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.002 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.003 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:51:39.004 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:51:39.005 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:51:39.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:51:39.007 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:51:39.008 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:51:39.009 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:51:39.010 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:51:39.011 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:51:39.012 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:51:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:51:39.013 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:51:39.013 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-09-16T00:51:39.486 DEBUG:teuthology.parallel:result is None 2024-09-16T00:51:39.570 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T00:51:39.570 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:39.570 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T00:51:39.571 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.572 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.573 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.574 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T00:51:39.575 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T00:51:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:51:39.577 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:51:39.578 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:51:39.579 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.580 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:51:39.581 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T00:51:39.582 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T00:51:39.583 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:51:39.583 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T00:51:39.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:51:39.583 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-16T00:51:39.991 DEBUG:teuthology.parallel:result is None 2024-09-16T00:51:39.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:40.138 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:51:40.161 INFO:teuthology.orchestra.run.smithi017.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.162 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.162 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:51:40.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:40.304 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:51:40.331 INFO:teuthology.orchestra.run.smithi088.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.331 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.331 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:51:40.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:40.478 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:51:40.505 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.505 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T00:51:40.505 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T00:51:40.507 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T00:51:40.507 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:51:40.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:51:40.538 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:51:40.538 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:51:40.571 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:51:40.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:51:40.603 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T00:51:40.603 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:51:40.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:51:40.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:51:40.701 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:51:40.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:51:40.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:51:40.799 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:51:40.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:51:40.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:51:40.898 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T00:51:40.899 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:51:40.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:51:40.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:51:41.000 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:51:41.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:51:41.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:51:41.099 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:51:41.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:51:41.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:51:41.196 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T00:51:41.197 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:51:41.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:51:41.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:51:41.297 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:51:41.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:51:41.326 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:51:41.395 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:51:41.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:51:41.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:51:41.494 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T00:51:41.595 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2}} 2024-09-16T00:51:41.595 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:41.596 INFO:tasks.cephadm:Cluster fsid is d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:51:41.596 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T00:51:41.596 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.88', 'mon.c': '172.21.15.154'} 2024-09-16T00:51:41.596 INFO:tasks.cephadm:First mon is mon.a on smithi017 2024-09-16T00:51:41.596 INFO:tasks.cephadm:First mgr is x 2024-09-16T00:51:41.596 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T00:51:41.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-09-16T00:51:41.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2024-09-16T00:51:41.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-16T00:51:41.690 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-16T00:51:41.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:41.837 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-16T00:51:41.983 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:51:41.985 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:51:41.986 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:51:41.986 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:42.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:51 /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:42.350 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:42.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:51 /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:42.716 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:43.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 00:51 /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:43.090 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:43.110 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:43.130 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:51:43.165 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-16T00:51:43.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:51:43.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:51:43.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T00:51:44.804 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:51:44.817 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:51:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:52:15.353 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T00:52:15.354 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T00:52:32.381 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-16T00:52:32.381 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:52:32.381 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:52:32.381 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2024-09-16T00:52:32.381 INFO:teuthology.orchestra.run.smithi088.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:52:32.382 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-16T00:52:32.382 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-16T00:52:37.453 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-16T00:52:37.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-09-16T00:52:37.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2024-09-16T00:52:37.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-16T00:52:37.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-09-16T00:52:37.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2024-09-16T00:52:37.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-16T00:52:37.657 INFO:tasks.cephadm:Writing seed config... 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-16T00:52:37.659 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T00:52:37.660 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T00:52:37.661 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-16T00:52:37.662 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-16T00:52:37.663 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:52:37.663 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T00:52:37.682 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d67bb9a6-73c5-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-16T00:52:37.682 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service 2024-09-16T00:52:37.725 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x.service 2024-09-16T00:52:37.768 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T00:52:37.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:37.985 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:52:37.986 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'd67bb9a6-73c5-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-09-16T00:52:37.986 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T00:52:37.986 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-09-16T00:52:38.013 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:52:38.013 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-09-16T00:52:38.013 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-09-16T00:52:38.021 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:52:38.021 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:52:38.029 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:52:38.029 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:52:38.036 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-16T00:52:38.044 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-16T00:52:38.044 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:52:38.044 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-09-16T00:52:38.068 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:52:38.068 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T00:52:38.068 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-09-16T00:52:38.068 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-09-16T00:52:38.075 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:52:38.075 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:52:38.083 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:52:38.083 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:52:38.090 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-16T00:52:38.097 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-16T00:52:38.097 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:52:38.098 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-09-16T00:52:38.098 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:38.098 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140289650762752 on /run/cephadm/d67bb9a6-73c5-11ef-bceb-c7b262605968.lock 2024-09-16T00:52:38.098 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140289650762752 acquired on /run/cephadm/d67bb9a6-73c5-11ef-bceb-c7b262605968.lock 2024-09-16T00:52:38.098 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-09-16T00:52:38.099 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-09-16T00:52:38.099 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-16T00:52:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-09-16T00:52:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-09-16T00:52:38.105 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T00:52:38.105 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-16T00:52:38.105 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-16T00:52:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:52:38.109 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-16T00:52:38.109 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-16T00:52:38.109 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T00:52:38.110 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T00:52:38.111 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T00:52:38.600 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T00:52:39.878 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T00:52:39.878 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T00:52:39.878 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T00:52:40.751 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-09-16T00:52:40.752 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-09-16T00:52:41.648 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBZgedmPx2bAxAArPcuHYOAlH+vtH87gR2tYQ== 2024-09-16T00:52:42.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBZgedmqJ4ZORAAzEwj157KGSN9A9wol6m2iA== 2024-09-16T00:52:43.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBbgedmeBTNAhAAr74VfD9dVriMGTsYE/rEjQ== 2024-09-16T00:52:43.693 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-09-16T00:52:44.648 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:52:44.648 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-16T00:52:44.648 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:52:44.649 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-09-16T00:52:45.605 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2024-09-16T00:52:45.835 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T00:52:45.988 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T00:52:46.177 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target. 2024-09-16T00:52:46.177 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target. 2024-09-16T00:52:46.411 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a 2024-09-16T00:52:46.411 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-16T00:52:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target.wants/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@.service. 2024-09-16T00:52:47.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:47 smithi017 podman[30826]: 2024-09-16 00:52:47.034548758 +0000 UTC m=+0.335667230 container start 702a0781e0ea04c15f1dc93b7f2900cd24fb8405fb6bce018d37ce5f990a529e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-16T00:52:47.129 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:52:47.129 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-16T00:52:47.137 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:52:47.137 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:52:47.137 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-16T00:52:47.137 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:52:47.138 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-09-16T00:52:47.138 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-09-16T00:52:47.367 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:47 smithi017 ceph-mon[30845]: mkfs d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:47.367 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:47 smithi017 ceph-mon[30845]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T00:52:47.367 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:47 smithi017 bash[30826]: 702a0781e0ea04c15f1dc93b7f2900cd24fb8405fb6bce018d37ce5f990a529e 2024-09-16T00:52:47.367 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:47 smithi017 systemd[1]: Started Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:48.162 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: monmap epoch 1 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: last_changed 2024-09-16T00:52:44.041107+0000 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: min_mon_release 19 (squid) 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: election_strategy: 1 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: fsmap 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: mgrmap e1: no daemons active 2024-09-16T00:52:48.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:48 smithi017 ceph-mon[30845]: from='client.? 172.21.15.17:0/1103609835' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.554595s) 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72ce4a640 1 Processor -- start 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72ce4a640 1 -- start start 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72ce4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72ce4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc72807e160 con 0x7fc72807dd60 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50766/0 (socket says 172.21.15.17:50766) 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.553+0000 7fc72659c640 1 -- 172.21.15.17:0/2637360502 learned_addr learned my addr 172.21.15.17:0/2637360502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.554+0000 7fc72659c640 1 -- 172.21.15.17:0/2637360502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72807c810 con 0x7fc72807dd60 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.555+0000 7fc72659c640 1 --2- 172.21.15.17:0/2637360502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc718009820 tx=0x7fc71802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f6b002f361cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc725d9b640 1 -- 172.21.15.17:0/2637360502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc718037070 con 0x7fc72807dd60 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc725d9b640 1 -- 172.21.15.17:0/2637360502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718032440 con 0x7fc72807dd60 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc725d9b640 1 -- 172.21.15.17:0/2637360502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc718032740 con 0x7fc72807dd60 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 -- 172.21.15.17:0/2637360502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 msgr2=0x7fc72807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 --2- 172.21.15.17:0/2637360502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc718009820 tx=0x7fc71802a270 comp rx=0 tx=0).stop 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 -- 172.21.15.17:0/2637360502 shutdown_connections 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 --2- 172.21.15.17:0/2637360502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72807c2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 -- 172.21.15.17:0/2637360502 >> 172.21.15.17:0/2637360502 conn(0x7fc728102f00 msgr2=0x7fc728105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 -- 172.21.15.17:0/2637360502 shutdown_connections 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.556+0000 7fc72ce4a640 1 -- 172.21.15.17:0/2637360502 wait complete. 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.557+0000 7fc72ce4a640 1 Processor -- start 2024-09-16T00:52:48.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.557+0000 7fc72ce4a640 1 -- start start 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.557+0000 7fc72ce4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.557+0000 7fc72ce4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc72807cd50 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50780/0 (socket says 172.21.15.17:50780) 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72659c640 1 -- 172.21.15.17:0/1103609835 learned_addr learned my addr 172.21.15.17:0/1103609835 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72659c640 1 -- 172.21.15.17:0/1103609835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72819d4f0 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72659c640 1 --2- 172.21.15.17:0/1103609835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7180090b0 tx=0x7fc7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc718041070 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71803c7a0 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72819d780 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc718037040 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7281a0470 con 0x7fc72807dd60 2024-09-16T00:52:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc718044070 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.558+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc71803d3f0 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.559+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72807c350 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.562+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc718046450 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.624+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc72802d910 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.624+0000 7fc71f7fe640 1 -- 172.21.15.17:0/1103609835 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc718046630 con 0x7fc72807dd60 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 msgr2=0x7fc72819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 --2- 172.21.15.17:0/1103609835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7180090b0 tx=0x7fc7180046c0 comp rx=0 tx=0).stop 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 shutdown_connections 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 --2- 172.21.15.17:0/1103609835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc72807dd60 0x7fc72819cfb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 >> 172.21.15.17:0/1103609835 conn(0x7fc728102f00 msgr2=0x7fc728103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 shutdown_connections 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:47.625+0000 7fc72ce4a640 1 -- 172.21.15.17:0/1103609835 wait complete. 2024-09-16T00:52:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-09-16T00:52:48.176 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T00:52:49.252 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:49 smithi017 ceph-mon[30845]: from='client.? 172.21.15.17:0/1563473307' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:52:49.252 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:49 smithi017 ceph-mon[30845]: from='client.? 172.21.15.17:0/1563473307' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:52:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:52:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f70033d6640 1 Processor -- start 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f70033d6640 1 -- start start 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f70033d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f70033d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc10a230 con 0x7f6ffc109860 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f7001172640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f7001172640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50788/0 (socket says 172.21.15.17:50788) 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.579+0000 7f7001172640 1 -- 172.21.15.17:0/296767648 learned_addr learned my addr 172.21.15.17:0/296767648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.580+0000 7f7001172640 1 -- 172.21.15.17:0/296767648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc10aa30 con 0x7f6ffc109860 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.580+0000 7f7001172640 1 --2- 172.21.15.17:0/296767648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009820 tx=0x7f6ff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73f1c98a3e30653 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f6feffff640 1 -- 172.21.15.17:0/296767648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0037070 con 0x7f6ffc109860 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f6feffff640 1 -- 172.21.15.17:0/296767648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0032440 con 0x7f6ffc109860 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f6feffff640 1 -- 172.21.15.17:0/296767648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0032740 con 0x7f6ffc109860 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 -- 172.21.15.17:0/296767648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 msgr2=0x7f6ffc109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 --2- 172.21.15.17:0/296767648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009820 tx=0x7f6ff002a270 comp rx=0 tx=0).stop 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 -- 172.21.15.17:0/296767648 shutdown_connections 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 --2- 172.21.15.17:0/296767648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc109c60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 -- 172.21.15.17:0/296767648 >> 172.21.15.17:0/296767648 conn(0x7f6ffc07ced0 msgr2=0x7f6ffc07d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 -- 172.21.15.17:0/296767648 shutdown_connections 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.581+0000 7f70033d6640 1 -- 172.21.15.17:0/296767648 wait complete. 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f70033d6640 1 Processor -- start 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f70033d6640 1 -- start start 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f70033d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f70033d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc10afd0 con 0x7f6ffc109860 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f7001172640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f7001172640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50804/0 (socket says 172.21.15.17:50804) 2024-09-16T00:52:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.582+0000 7f7001172640 1 -- 172.21.15.17:0/1563473307 learned_addr learned my addr 172.21.15.17:0/1563473307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f7001172640 1 -- 172.21.15.17:0/1563473307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc19d4c0 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f7001172640 1 --2- 172.21.15.17:0/1563473307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00090b0 tx=0x7f6ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0041070 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff003c7a0 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc19d750 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0037040 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc1a0440 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ff0044070 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.583+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ff003d3f0 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.584+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc10b640 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.586+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6ff0046450 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.646+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6ffc02d910 con 0x7f6ffc109860 2024-09-16T00:52:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.649+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f6ff0046630 con 0x7f6ffc109860 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f6fee7fc640 1 -- 172.21.15.17:0/1563473307 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6ff0056070 con 0x7f6ffc109860 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 msgr2=0x7f6ffc19cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 --2- 172.21.15.17:0/1563473307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00090b0 tx=0x7f6ff00046c0 comp rx=0 tx=0).stop 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 shutdown_connections 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 --2- 172.21.15.17:0/1563473307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc109860 0x7f6ffc19cf80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 >> 172.21.15.17:0/1563473307 conn(0x7f6ffc07ced0 msgr2=0x7f6ffc191280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 shutdown_connections 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:48.650+0000 7f70033d6640 1 -- 172.21.15.17:0/1563473307 wait complete. 2024-09-16T00:52:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-09-16T00:52:50.241 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:50 smithi017 ceph-mon[30845]: from='client.? 172.21.15.17:0/1240501860' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa57a7e9640 1 Processor -- start 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa57a7e9640 1 -- start start 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa57a7e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa57a7e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa574107fb0 con 0x7fa574107670 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50818/0 (socket says 172.21.15.17:50818) 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa573fff640 1 -- 172.21.15.17:0/1778880645 learned_addr learned my addr 172.21.15.17:0/1778880645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.609+0000 7fa573fff640 1 -- 172.21.15.17:0/1778880645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa574108130 con 0x7fa574107670 2024-09-16T00:52:50.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.610+0000 7fa573fff640 1 --2- 172.21.15.17:0/1778880645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa564009820 tx=0x7fa56402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4082aaf68342d786 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.610+0000 7fa572ffd640 1 -- 172.21.15.17:0/1778880645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564037070 con 0x7fa574107670 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.610+0000 7fa572ffd640 1 -- 172.21.15.17:0/1778880645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa5640328d0 con 0x7fa574107670 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.610+0000 7fa572ffd640 1 -- 172.21.15.17:0/1778880645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5640307d0 con 0x7fa574107670 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1778880645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 msgr2=0x7fa574107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 --2- 172.21.15.17:0/1778880645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa564009820 tx=0x7fa56402a270 comp rx=0 tx=0).stop 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1778880645 shutdown_connections 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 --2- 172.21.15.17:0/1778880645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa574107a70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1778880645 >> 172.21.15.17:0/1778880645 conn(0x7fa574102e60 msgr2=0x7fa5741052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1778880645 shutdown_connections 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.611+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1778880645 wait complete. 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa57a7e9640 1 Processor -- start 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa57a7e9640 1 -- start start 2024-09-16T00:52:50.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa57a7e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa57a7e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa57410bae0 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50820/0 (socket says 172.21.15.17:50820) 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa573fff640 1 -- 172.21.15.17:0/1240501860 learned_addr learned my addr 172.21.15.17:0/1240501860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.612+0000 7fa573fff640 1 -- 172.21.15.17:0/1240501860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57419bab0 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa573fff640 1 --2- 172.21.15.17:0/1240501860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5640097f0 tx=0x7fa564030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa564037040 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa564032bb0 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57419bd40 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa56403a390 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57419ea30 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa56403a5d0 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.613+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa564044bf0 con 0x7fa574107670 2024-09-16T00:52:50.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.614+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57410bc60 con 0x7fa574107670 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.616+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa564044df0 con 0x7fa574107670 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.676+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa57419ef10 con 0x7fa574107670 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.676+0000 7fa5717fa640 1 -- 172.21.15.17:0/1240501860 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fa564044400 con 0x7fa574107670 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 msgr2=0x7fa57419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 --2- 172.21.15.17:0/1240501860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5640097f0 tx=0x7fa564030d00 comp rx=0 tx=0).stop 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 shutdown_connections 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 --2- 172.21.15.17:0/1240501860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574107670 0x7fa57419b570 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 >> 172.21.15.17:0/1240501860 conn(0x7fa574102e60 msgr2=0x7fa574103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 shutdown_connections 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:49.677+0000 7fa57a7e9640 1 -- 172.21.15.17:0/1240501860 wait complete. 2024-09-16T00:52:50.251 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-09-16T00:52:50.562 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:50 smithi017 systemd[1]: Stopping Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:52:50.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:50 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a[30841]: 2024-09-16T00:52:50.560+0000 7fb08e490640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:52:50.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:50 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a[30841]: 2024-09-16T00:52:50.560+0000 7fb08e490640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T00:52:50.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:50 smithi017 podman[31086]: 2024-09-16 00:52:50.684107295 +0000 UTC m=+0.248463987 container died 702a0781e0ea04c15f1dc93b7f2900cd24fb8405fb6bce018d37ce5f990a529e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T00:52:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31086]: 2024-09-16 00:52:51.019421155 +0000 UTC m=+0.583777845 container cleanup 702a0781e0ea04c15f1dc93b7f2900cd24fb8405fb6bce018d37ce5f990a529e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:52:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 bash[31086]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a 2024-09-16T00:52:51.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31099]: 2024-09-16 00:52:51.195382902 +0000 UTC m=+0.509882261 container remove 702a0781e0ea04c15f1dc93b7f2900cd24fb8405fb6bce018d37ce5f990a529e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T00:52:51.749 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-16T00:52:51.749 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 systemd[1]: Stopped Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:51.749 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 systemd[1]: Starting Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:52:51.749 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31191]: 2024-09-16 00:52:51.654284806 +0000 UTC m=+0.106274627 container create 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-16T00:52:51.750 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31191]: 2024-09-16 00:52:51.564401451 +0000 UTC m=+0.016391275 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:52:51.911 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T00:52:52.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31191]: 2024-09-16 00:52:51.848658296 +0000 UTC m=+0.300648128 container init 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 podman[31191]: 2024-09-16 00:52:51.852544123 +0000 UTC m=+0.304533945 container start 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: pidfile_write: ignore empty --pid-file 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: load: jerasure load: lrc 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Git sha 0 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: DB SUMMARY 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: DB Session ID: HQJRZZ6WTOUJIYOQMM9L 2024-09-16T00:52:52.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105876 ; 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.env: 0x55e5815b5940 2024-09-16T00:52:52.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:52:52.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.info_log: 0x55e58232f6e0 2024-09-16T00:52:52.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:52:52.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.statistics: (nil) 2024-09-16T00:52:52.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.use_fsync: 0 2024-09-16T00:52:52.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:52:52.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:52:52.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.db_log_dir: 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.wal_dir: 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:52:52.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.write_buffer_manager: 0x55e58233edc0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:52:52.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.unordered_write: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.row_cache: None 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.wal_filter: None 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:52:52.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.wal_compression: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:52:52.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_open_files: -1 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:52:52.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Compression algorithms supported: 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kZSTD supported: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:52:52.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.merge_operator: 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_filter: None 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e58232f320) 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:52:52.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x55e5823231f0 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2024-09-16T00:52:52.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2024-09-16T00:52:52.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression: NoCompression 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:52:52.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.num_levels: 7 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:52:52.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:52:52.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:52:52.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.ttl: 2592000 2024-09-16T00:52:52.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T00:52:52.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 10a9fd45-12b2-4b35-b5ef-a35edea32b25 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447971878884, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447971880001, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100895, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98780, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14429, "raw_average_key_size": 49, "raw_value_size": 90972, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447971, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "10a9fd45-12b2-4b35-b5ef-a35edea32b25", "db_session_id": "HQJRZZ6WTOUJIYOQMM9L", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447971880100, "job": 1, "event": "recovery_finished"} 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e582350e00 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: DB pointer 0x55e58244c000 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:52.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 100.39 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 100.39 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:52:52.144 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 29.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 29.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:52:52.145 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x55e5823231f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???) e1 preinit fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).mds e1 new map 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).mds e1 print_map 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: btime 2024-09-16T00:52:47:071837+0000 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-16T00:52:52.146 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 ceph-mon[31211]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 bash[31191]: 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 2024-09-16T00:52:52.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:51 smithi017 systemd[1]: Started Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.334+0000 7efe15fca640 1 Processor -- start 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.334+0000 7efe15fca640 1 -- start start 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.334+0000 7efe15fca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.334+0000 7efe15fca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe1007be10 con 0x7efe101080f0 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.335+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.335+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56732/0 (socket says 172.21.15.17:56732) 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.335+0000 7efe0f7fe640 1 -- 172.21.15.17:0/2701406983 learned_addr learned my addr 172.21.15.17:0/2701406983 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:53.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.335+0000 7efe0f7fe640 1 -- 172.21.15.17:0/2701406983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1010aa20 con 0x7efe101080f0 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.337+0000 7efe0f7fe640 1 --2- 172.21.15.17:0/2701406983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe00009820 tx=0x7efe0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f9bc2fd17eb515 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.337+0000 7efe0e7fc640 1 -- 172.21.15.17:0/2701406983 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00037070 con 0x7efe101080f0 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.337+0000 7efe0e7fc640 1 -- 172.21.15.17:0/2701406983 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efe000328d0 con 0x7efe101080f0 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.337+0000 7efe0e7fc640 1 -- 172.21.15.17:0/2701406983 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe000307d0 con 0x7efe101080f0 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 -- 172.21.15.17:0/2701406983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 msgr2=0x7efe1010a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 --2- 172.21.15.17:0/2701406983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe00009820 tx=0x7efe0002a270 comp rx=0 tx=0).stop 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 -- 172.21.15.17:0/2701406983 shutdown_connections 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 --2- 172.21.15.17:0/2701406983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1010a4e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 -- 172.21.15.17:0/2701406983 >> 172.21.15.17:0/2701406983 conn(0x7efe10101d90 msgr2=0x7efe101041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 -- 172.21.15.17:0/2701406983 shutdown_connections 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.338+0000 7efe15fca640 1 -- 172.21.15.17:0/2701406983 wait complete. 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe15fca640 1 Processor -- start 2024-09-16T00:52:53.028 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe15fca640 1 -- start start 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe15fca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe15fca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010b9a0 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56738/0 (socket says 172.21.15.17:56738) 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.339+0000 7efe0f7fe640 1 -- 172.21.15.17:0/2654280601 learned_addr learned my addr 172.21.15.17:0/2654280601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0f7fe640 1 -- 172.21.15.17:0/2654280601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1019ba90 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0f7fe640 1 --2- 172.21.15.17:0/2654280601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efe00032e10 tx=0x7efe00032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00042070 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efe00030c80 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1019bd20 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00037040 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1019ea10 con 0x7efe101080f0 2024-09-16T00:52:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe00045070 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.340+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efe000479f0 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.341+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe10108550 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.343+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efe0003c5f0 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.402+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efe1019ebe0 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.404+0000 7efe0cff9640 1 -- 172.21.15.17:0/2654280601 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7efe0003c7d0 con 0x7efe101080f0 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 msgr2=0x7efe1019b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 --2- 172.21.15.17:0/2654280601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efe00032e10 tx=0x7efe00032e40 comp rx=0 tx=0).stop 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 shutdown_connections 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 --2- 172.21.15.17:0/2654280601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe101080f0 0x7efe1019b550 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 >> 172.21.15.17:0/2654280601 conn(0x7efe10101d90 msgr2=0x7efe10102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 shutdown_connections 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:52.405+0000 7efe15fca640 1 -- 172.21.15.17:0/2654280601 wait complete. 2024-09-16T00:52:53.030 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T00:52:53.045 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:53.045 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-09-16T00:52:53.046 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T00:52:53.046 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: monmap epoch 1 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: last_changed 2024-09-16T00:52:44.041107+0000 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: election_strategy: 1 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: fsmap 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T00:52:53.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: mgrmap e1: no daemons active 2024-09-16T00:52:53.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:52 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2654280601' entity='client.admin' 2024-09-16T00:52:53.312 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x 2024-09-16T00:52:53.313 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-16T00:52:53.469 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968.target.wants/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@.service. 2024-09-16T00:52:54.017 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:52:54.017 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-16T00:52:54.026 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:52:54.026 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:52:54.026 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-16T00:52:54.026 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:52:54.037 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:52:54.037 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-16T00:52:54.046 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:52:54.046 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:52:54.046 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-16T00:52:54.047 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-16T00:52:54.047 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-09-16T00:52:54.047 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-09-16T00:52:54.167 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.113+0000 7f947cbc3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:54.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.271+0000 7f947cbc3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:52:54.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.342+0000 7f947cbc3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:52:54.918 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1888503908' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:52:54.919 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.502+0000 7f947cbc3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:54.919 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.653+0000 7f947cbc3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:52:55.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:55.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:52:55.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-16T00:52:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:52:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:52:55.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:52:47:071837+0000", 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:52:55.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:52:47.072472+0000", 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.483+0000 7f4cb6619640 1 Processor -- start 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.483+0000 7f4cb6619640 1 -- start start 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.483+0000 7f4cb6619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.483+0000 7f4cb6619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0107f90 con 0x7f4cb0107650 2024-09-16T00:52:55.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.484+0000 7f4caffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.484+0000 7f4caffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56778/0 (socket says 172.21.15.17:56778) 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.484+0000 7f4caffff640 1 -- 172.21.15.17:0/2925696439 learned_addr learned my addr 172.21.15.17:0/2925696439 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.484+0000 7f4caffff640 1 -- 172.21.15.17:0/2925696439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb0108110 con 0x7f4cb0107650 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.485+0000 7f4caffff640 1 --2- 172.21.15.17:0/2925696439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009820 tx=0x7f4ca002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5cc3cea108e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.485+0000 7f4caeffd640 1 -- 172.21.15.17:0/2925696439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca0037070 con 0x7f4cb0107650 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.485+0000 7f4caeffd640 1 -- 172.21.15.17:0/2925696439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4ca00328d0 con 0x7f4cb0107650 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.485+0000 7f4caeffd640 1 -- 172.21.15.17:0/2925696439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca00307d0 con 0x7f4cb0107650 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 -- 172.21.15.17:0/2925696439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 msgr2=0x7f4cb0107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 --2- 172.21.15.17:0/2925696439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009820 tx=0x7f4ca002a270 comp rx=0 tx=0).stop 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 -- 172.21.15.17:0/2925696439 shutdown_connections 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 --2- 172.21.15.17:0/2925696439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb0107a50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 -- 172.21.15.17:0/2925696439 >> 172.21.15.17:0/2925696439 conn(0x7f4cb0102e60 msgr2=0x7f4cb01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 -- 172.21.15.17:0/2925696439 shutdown_connections 2024-09-16T00:52:55.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.486+0000 7f4cb6619640 1 -- 172.21.15.17:0/2925696439 wait complete. 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4cb6619640 1 Processor -- start 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4cb6619640 1 -- start start 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4cb6619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4cb6619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb010bac0 con 0x7f4cb0107650 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4caffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4caffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56788/0 (socket says 172.21.15.17:56788) 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.487+0000 7f4caffff640 1 -- 172.21.15.17:0/1888503908 learned_addr learned my addr 172.21.15.17:0/1888503908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4caffff640 1 -- 172.21.15.17:0/1888503908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb019baa0 con 0x7f4cb0107650 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4caffff640 1 --2- 172.21.15.17:0/1888503908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0032e10 tx=0x7f4ca0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca0042070 con 0x7f4cb0107650 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4ca0030c80 con 0x7f4cb0107650 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb019bd30 con 0x7f4cb0107650 2024-09-16T00:52:55.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca0037040 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.488+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb019ea20 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.489+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ca0045070 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.489+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ca00479e0 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.489+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb010bc40 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.491+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4ca003c5f0 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.555+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4cb019efb0 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.556+0000 7f4cad7fa640 1 -- 172.21.15.17:0/1888503908 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4ca003c7d0 con 0x7f4cb0107650 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 msgr2=0x7f4cb019b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 --2- 172.21.15.17:0/1888503908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0032e10 tx=0x7f4ca0032e40 comp rx=0 tx=0).stop 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 shutdown_connections 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 --2- 172.21.15.17:0/1888503908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb0107650 0x7f4cb019b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 >> 172.21.15.17:0/1888503908 conn(0x7f4cb0102e60 msgr2=0x7f4cb0103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 shutdown_connections 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:54.557+0000 7f4cb6619640 1 -- 172.21.15.17:0/1888503908 wait complete. 2024-09-16T00:52:55.184 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-09-16T00:52:55.186 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:54.990+0000 7f947cbc3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:52:55.186 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:55 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:55.054+0000 7f947cbc3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:52:55.686 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:55 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:55.249+0000 7f947cbc3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:52:56.436 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:56.173+0000 7f947cbc3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:52:56.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:56.243+0000 7f947cbc3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:52:57.280 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:56.999+0000 7f947cbc3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:52:57.280 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.119+0000 7f947cbc3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:52:57.571 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.278+0000 7f947cbc3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:52:57.571 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.342+0000 7f947cbc3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:52:57.571 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.501+0000 7f947cbc3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:52:57.881 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1432285248' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:52:57.882 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.574+0000 7f947cbc3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:52:57.882 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.638+0000 7f947cbc3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:52:57.882 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.811+0000 7f947cbc3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:52:57.882 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.880+0000 7f947cbc3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:52:58.162 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:57.950+0000 7f947cbc3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:52:58.163 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:58.037+0000 7f947cbc3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:52:58.163 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:58.100+0000 7f947cbc3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:52:58.163 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:58.161+0000 7f947cbc3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:52:58.283 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:52:58.283 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:52:58.284 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:52:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:52:58.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:52:58.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:52:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:52:58.289 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:52:47:071837+0000", 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:52:58.290 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:52:58.291 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:52:47.072472+0000", 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:52:58.292 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.569+0000 7f8727958640 1 Processor -- start 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f8727958640 1 -- start start 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f8727958640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f8727958640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8720107fb0 con 0x7f8720107670 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f87256f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f87256f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56796/0 (socket says 172.21.15.17:56796) 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.570+0000 7f87256f4640 1 -- 172.21.15.17:0/1226703067 learned_addr learned my addr 172.21.15.17:0/1226703067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.571+0000 7f87256f4640 1 -- 172.21.15.17:0/1226703067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8720108130 con 0x7f8720107670 2024-09-16T00:52:58.293 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.572+0000 7f87256f4640 1 --2- 172.21.15.17:0/1226703067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f871c009820 tx=0x7f871c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf03894ca680d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.572+0000 7f8717fff640 1 -- 172.21.15.17:0/1226703067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c037070 con 0x7f8720107670 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.572+0000 7f8717fff640 1 -- 172.21.15.17:0/1226703067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f871c0328d0 con 0x7f8720107670 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.572+0000 7f8717fff640 1 -- 172.21.15.17:0/1226703067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c0307d0 con 0x7f8720107670 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- 172.21.15.17:0/1226703067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 msgr2=0x7f8720107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 --2- 172.21.15.17:0/1226703067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f871c009820 tx=0x7f871c02a270 comp rx=0 tx=0).stop 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- 172.21.15.17:0/1226703067 shutdown_connections 2024-09-16T00:52:58.294 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 --2- 172.21.15.17:0/1226703067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f8720107a70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- 172.21.15.17:0/1226703067 >> 172.21.15.17:0/1226703067 conn(0x7f8720102ec0 msgr2=0x7f87201052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- 172.21.15.17:0/1226703067 shutdown_connections 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- 172.21.15.17:0/1226703067 wait complete. 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 Processor -- start 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.573+0000 7f8727958640 1 -- start start 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f8727958640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f8727958640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f872010ba90 con 0x7f8720107670 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87256f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87256f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56798/0 (socket says 172.21.15.17:56798) 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87256f4640 1 -- 172.21.15.17:0/1432285248 learned_addr learned my addr 172.21.15.17:0/1432285248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87256f4640 1 -- 172.21.15.17:0/1432285248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872019bb00 con 0x7f8720107670 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87256f4640 1 --2- 172.21.15.17:0/1432285248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f871c032e10 tx=0x7f871c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c042070 con 0x7f8720107670 2024-09-16T00:52:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f871c030c80 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872019bd90 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.574+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871c037040 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.575+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872019ea80 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.575+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f871c045070 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.575+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f871c0463b0 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.575+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872010bc10 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.578+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f871c047440 con 0x7f8720107670 2024-09-16T00:52:58.297 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.642+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f872019ec50 con 0x7f8720107670 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.642+0000 7f87167fc640 1 -- 172.21.15.17:0/1432285248 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f871c047620 con 0x7f8720107670 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 msgr2=0x7f872019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 --2- 172.21.15.17:0/1432285248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f871c032e10 tx=0x7f871c032e40 comp rx=0 tx=0).stop 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 shutdown_connections 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 --2- 172.21.15.17:0/1432285248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8720107670 0x7f872019b5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 >> 172.21.15.17:0/1432285248 conn(0x7f8720102ec0 msgr2=0x7f8720103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 shutdown_connections 2024-09-16T00:52:58.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:52:57.644+0000 7f8727958640 1 -- 172.21.15.17:0/1432285248 wait complete. 2024-09-16T00:52:58.299 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:52:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:52:58.992+0000 7f947cbc3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: Activating manager daemon x 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: mgrmap e2: x(active, starting, since 0.00323593s) 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:52:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: Manager daemon x is now available 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' 2024-09-16T00:52:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:52:59 smithi017 ceph-mon[31211]: from='mgr.14100 172.21.15.17:0/2424740101' entity='mgr.x' 2024-09-16T00:53:01.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:00 smithi017 ceph-mon[31211]: mgrmap e3: x(active, since 1.007s) 2024-09-16T00:53:01.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:00 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/779463714' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:53:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:53:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:53:01.551 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T00:52:47:071837+0000", 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:53:01.552 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:52:47.072472+0000", 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.728+0000 7ff3d6b7a640 1 Processor -- start 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.728+0000 7ff3d6b7a640 1 -- start start 2024-09-16T00:53:01.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d6b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d6b7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0107f90 con 0x7ff3d0107650 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d4916640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d4916640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55814/0 (socket says 172.21.15.17:55814) 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d4916640 1 -- 172.21.15.17:0/1057089270 learned_addr learned my addr 172.21.15.17:0/1057089270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.729+0000 7ff3d4916640 1 -- 172.21.15.17:0/1057089270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d0108110 con 0x7ff3d0107650 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.730+0000 7ff3d4916640 1 --2- 172.21.15.17:0/1057089270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009820 tx=0x7ff3c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72fd1f8ec48ecaa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.730+0000 7ff3cf7fe640 1 -- 172.21.15.17:0/1057089270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0037070 con 0x7ff3d0107650 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.730+0000 7ff3cf7fe640 1 -- 172.21.15.17:0/1057089270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff3c00328d0 con 0x7ff3d0107650 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.730+0000 7ff3cf7fe640 1 -- 172.21.15.17:0/1057089270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3c00307d0 con 0x7ff3d0107650 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/1057089270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 msgr2=0x7ff3d0107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/1057089270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009820 tx=0x7ff3c002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/1057089270 shutdown_connections 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/1057089270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d0107a50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/1057089270 >> 172.21.15.17:0/1057089270 conn(0x7ff3d0102f00 msgr2=0x7ff3d0105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:01.554 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/1057089270 shutdown_connections 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/1057089270 wait complete. 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.731+0000 7ff3d6b7a640 1 Processor -- start 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d6b7a640 1 -- start start 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d6b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d6b7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d010bac0 con 0x7ff3d0107650 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d4916640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d4916640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55820/0 (socket says 172.21.15.17:55820) 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d4916640 1 -- 172.21.15.17:0/779463714 learned_addr learned my addr 172.21.15.17:0/779463714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d4916640 1 -- 172.21.15.17:0/779463714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d019ba90 con 0x7ff3d0107650 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.732+0000 7ff3d4916640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0032e10 tx=0x7ff3c0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.733+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0042070 con 0x7ff3d0107650 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.733+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff3c0030c80 con 0x7ff3d0107650 2024-09-16T00:53:01.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.733+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d019bd20 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.733+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0037040 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.733+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d019ea10 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.734+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7ff3c0045070 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.734+0000 7ff3cdffb640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 0x7ff3b803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.734+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff3c006bf10 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.734+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d010bc40 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.734+0000 7ff3cffff640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 0x7ff3b803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.735+0000 7ff3cffff640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 0x7ff3b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40098c0 tx=0x7ff3c4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.739+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3c0045360 con 0x7ff3d0107650 2024-09-16T00:53:01.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.982+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff3d019ebe0 con 0x7ff3d0107650 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.983+0000 7ff3cdffb640 1 -- 172.21.15.17:0/779463714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7ff3c002ed70 con 0x7ff3d0107650 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 msgr2=0x7ff3b803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 0x7ff3b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40098c0 tx=0x7ff3c4006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 msgr2=0x7ff3d019b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0032e10 tx=0x7ff3c0032e40 comp rx=0 tx=0).stop 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 shutdown_connections 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7ff3b80390a0 0x7ff3b803b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 --2- 172.21.15.17:0/779463714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3d0107650 0x7ff3d019b550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 >> 172.21.15.17:0/779463714 conn(0x7ff3d0102f00 msgr2=0x7ff3d0103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 shutdown_connections 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:00.985+0000 7ff3d6b7a640 1 -- 172.21.15.17:0/779463714 wait complete. 2024-09-16T00:53:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-09-16T00:53:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:02 smithi017 ceph-mon[31211]: mgrmap e4: x(active, since 2s) 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:53:02.742 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:53:02.743 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd80f52640 1 Processor -- start 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd80f52640 1 -- start start 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd80f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd80f52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c07bdd0 con 0x7fdd7c105f20 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55826/0 (socket says 172.21.15.17:55826) 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.935+0000 7fdd7a59c640 1 -- 172.21.15.17:0/1214898909 learned_addr learned my addr 172.21.15.17:0/1214898909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.936+0000 7fdd7a59c640 1 -- 172.21.15.17:0/1214898909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c106860 con 0x7fdd7c105f20 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd7a59c640 1 --2- 172.21.15.17:0/1214898909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009820 tx=0x7fdd6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2d554121bd9634 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd79d9b640 1 -- 172.21.15.17:0/1214898909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c037070 con 0x7fdd7c105f20 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd79d9b640 1 -- 172.21.15.17:0/1214898909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdd6c0328d0 con 0x7fdd7c105f20 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd79d9b640 1 -- 172.21.15.17:0/1214898909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c0307d0 con 0x7fdd7c105f20 2024-09-16T00:53:02.744 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd80f52640 1 -- 172.21.15.17:0/1214898909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 msgr2=0x7fdd7c106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1214898909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009820 tx=0x7fdd6c02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd80f52640 1 -- 172.21.15.17:0/1214898909 shutdown_connections 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1214898909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c106320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.937+0000 7fdd80f52640 1 -- 172.21.15.17:0/1214898909 >> 172.21.15.17:0/1214898909 conn(0x7fdd7c101d90 msgr2=0x7fdd7c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.938+0000 7fdd80f52640 1 -- 172.21.15.17:0/1214898909 shutdown_connections 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.938+0000 7fdd80f52640 1 -- 172.21.15.17:0/1214898909 wait complete. 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.938+0000 7fdd80f52640 1 Processor -- start 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.938+0000 7fdd80f52640 1 -- start start 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.938+0000 7fdd80f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd80f52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c107780 con 0x7fdd7c105f20 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55842/0 (socket says 172.21.15.17:55842) 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd7a59c640 1 -- 172.21.15.17:0/1651181837 learned_addr learned my addr 172.21.15.17:0/1651181837 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:02.745 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd7a59c640 1 -- 172.21.15.17:0/1651181837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c19dc30 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd7a59c640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097f0 tx=0x7fdd6c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c037040 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c19dec0 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdd6c032bb0 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c03a390 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.939+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c1a0bb0 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.940+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fdd6c03a600 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.940+0000 7fdd737fe640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 0x7fdd6803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.940+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdd6c06c490 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.940+0000 7fdd73fff640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 0x7fdd6803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.940+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c107e50 con 0x7fdd7c105f20 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.941+0000 7fdd73fff640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 0x7fdd6803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd640098c0 tx=0x7fdd64006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:02.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:01.945+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd6c06beb0 con 0x7fdd7c105f20 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.123+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fdd7c1a21c0 con 0x7fdd7c105f20 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.123+0000 7fdd737fe640 1 -- 172.21.15.17:0/1651181837 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fdd6c02c030 con 0x7fdd7c105f20 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.125+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 msgr2=0x7fdd6803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.125+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 0x7fdd6803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd640098c0 tx=0x7fdd64006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.125+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 msgr2=0x7fdd7c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.125+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097f0 tx=0x7fdd6c030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 shutdown_connections 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7fdd680391b0 0x7fdd6803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 --2- 172.21.15.17:0/1651181837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd7c105f20 0x7fdd7c19d6f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 >> 172.21.15.17:0/1651181837 conn(0x7fdd7c101d90 msgr2=0x7fdd7c191b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 shutdown_connections 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:02.126+0000 7fdd80f52640 1 -- 172.21.15.17:0/1651181837 wait complete. 2024-09-16T00:53:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-09-16T00:53:03.414 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:03 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1651181837' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:53:04.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/933154293' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T00:53:04.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-16T00:53:04.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-16T00:53:04.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.156+0000 7fcda2425040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:53:04.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.215+0000 7fcda2425040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.180+0000 7f7c0b9fa640 1 Processor -- start 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.180+0000 7f7c0b9fa640 1 -- start start 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.180+0000 7f7c0b9fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.180+0000 7f7c0b9fa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0407c830 con 0x7f7c0407dd80 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.180+0000 7f7c09796640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.181+0000 7f7c09796640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55844/0 (socket says 172.21.15.17:55844) 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.181+0000 7f7c09796640 1 -- 172.21.15.17:0/2424476688 learned_addr learned my addr 172.21.15.17:0/2424476688 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.181+0000 7f7c09796640 1 -- 172.21.15.17:0/2424476688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0407c9b0 con 0x7f7c0407dd80 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.181+0000 7f7c09796640 1 --2- 172.21.15.17:0/2424476688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009820 tx=0x7f7c0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d4d7cecdf7b61f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7bfbfff640 1 -- 172.21.15.17:0/2424476688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c00037070 con 0x7f7c0407dd80 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7bfbfff640 1 -- 172.21.15.17:0/2424476688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7c000328d0 con 0x7f7c0407dd80 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7bfbfff640 1 -- 172.21.15.17:0/2424476688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c000307d0 con 0x7f7c0407dd80 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/2424476688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 msgr2=0x7f7c0407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/2424476688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009820 tx=0x7f7c0002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/2424476688 shutdown_connections 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/2424476688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0407c2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/2424476688 >> 172.21.15.17:0/2424476688 conn(0x7f7c04102f00 msgr2=0x7f7c04105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.182+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/2424476688 shutdown_connections 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/2424476688 wait complete. 2024-09-16T00:53:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c0b9fa640 1 Processor -- start 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c0b9fa640 1 -- start start 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c0b9fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c0b9fa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410db70 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c09796640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c09796640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55854/0 (socket says 172.21.15.17:55854) 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.183+0000 7f7c09796640 1 -- 172.21.15.17:0/933154293 learned_addr learned my addr 172.21.15.17:0/933154293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7c09796640 1 -- 172.21.15.17:0/933154293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0419dce0 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7c09796640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c000097f0 tx=0x7f7c00030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c00037040 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7c00032bb0 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0419df70 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c041a0c60 con 0x7f7c0407dd80 2024-09-16T00:53:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.184+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0003a390 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.185+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f7c0003a670 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.185+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be80052c0 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.185+0000 7f7bfa7fc640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 0x7f7bf003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.186+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c0006c680 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.186+0000 7f7c08f95640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 0x7f7bf003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.186+0000 7f7c08f95640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 0x7f7bf003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098c0 tx=0x7f7bf4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.191+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c00032dd0 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:03.413+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f7be80055b0 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.005+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f7c000319e0 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.007+0000 7f7bfa7fc640 1 -- 172.21.15.17:0/933154293 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f7c00044780 con 0x7f7c0407dd80 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 msgr2=0x7f7bf003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 0x7f7bf003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098c0 tx=0x7f7bf4006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 msgr2=0x7f7c0419d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c000097f0 tx=0x7f7c00030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 shutdown_connections 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f7bf00391b0 0x7f7bf003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 --2- 172.21.15.17:0/933154293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c0407dd80 0x7f7c0419d7a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 >> 172.21.15.17:0/933154293 conn(0x7f7c04102f00 msgr2=0x7f7c04103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 shutdown_connections 2024-09-16T00:53:04.567 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.009+0000 7f7c0b9fa640 1 -- 172.21.15.17:0/933154293 wait complete. 2024-09-16T00:53:04.605 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.372+0000 7fcda2425040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:53:04.605 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.441+0000 7fcda2425040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:53:04.606 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.604+0000 7fcda2425040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:53:04.916 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:04.752+0000 7fcda2425040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:53:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:05 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/933154293' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T00:53:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:05 smithi017 ceph-mon[31211]: mgrmap e5: x(active, since 5s) 2024-09-16T00:53:05.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:05.088+0000 7fcda2425040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:53:05.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:05.151+0000 7fcda2425040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:53:05.578 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:05.348+0000 7fcda2425040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:53:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.994+0000 7f412f463640 1 Processor -- start 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.994+0000 7f412f463640 1 -- start start 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412f463640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412f463640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f412807be10 con 0x7f41281080f0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412d1ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412d1ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55880/0 (socket says 172.21.15.17:55880) 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412d1ff640 1 -- 172.21.15.17:0/1585109646 learned_addr learned my addr 172.21.15.17:0/1585109646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.995+0000 7f412d1ff640 1 -- 172.21.15.17:0/1585109646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412810aa20 con 0x7f41281080f0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.996+0000 7f412d1ff640 1 --2- 172.21.15.17:0/1585109646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4124009820 tx=0x7f412402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8901d7558bbb574b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.996+0000 7f411bfff640 1 -- 172.21.15.17:0/1585109646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4124037070 con 0x7f41281080f0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.996+0000 7f411bfff640 1 -- 172.21.15.17:0/1585109646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f41240328d0 con 0x7f41281080f0 2024-09-16T00:53:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.996+0000 7f411bfff640 1 -- 172.21.15.17:0/1585109646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41240307d0 con 0x7f41281080f0 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- 172.21.15.17:0/1585109646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 msgr2=0x7f412810a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 --2- 172.21.15.17:0/1585109646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4124009820 tx=0x7f412402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- 172.21.15.17:0/1585109646 shutdown_connections 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 --2- 172.21.15.17:0/1585109646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412810a4e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- 172.21.15.17:0/1585109646 >> 172.21.15.17:0/1585109646 conn(0x7f4128101cf0 msgr2=0x7f4128104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- 172.21.15.17:0/1585109646 shutdown_connections 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- 172.21.15.17:0/1585109646 wait complete. 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 Processor -- start 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.997+0000 7f412f463640 1 -- start start 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412f463640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412f463640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f412810b9a0 con 0x7f41281080f0 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412d1ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412d1ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55894/0 (socket says 172.21.15.17:55894) 2024-09-16T00:53:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412d1ff640 1 -- 172.21.15.17:0/3250150148 learned_addr learned my addr 172.21.15.17:0/3250150148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412d1ff640 1 -- 172.21.15.17:0/3250150148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412819ba70 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412d1ff640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4124032e10 tx=0x7f4124032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4124042070 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412819bd00 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4124030c80 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4124037040 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.998+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f412819e9f0 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.999+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f4124045070 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.999+0000 7f411a7fc640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 0x7f411403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.999+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f412406c190 con 0x7f41281080f0 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.999+0000 7f412c9fe640 1 -- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 msgr2=0x7f411403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:04.999+0000 7f412c9fe640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 0x7f411403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:53:05.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.000+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4128108550 con 0x7f41281080f0 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.004+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4124045360 con 0x7f41281080f0 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.200+0000 7f412c9fe640 1 -- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 msgr2=0x7f411403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.200+0000 7f412c9fe640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 0x7f411403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.228+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f412819ebc0 con 0x7f41281080f0 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.229+0000 7f411a7fc640 1 -- 172.21.15.17:0/3250150148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f412819ebc0 con 0x7f41281080f0 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 msgr2=0x7f411403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 0x7f411403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 msgr2=0x7f412819b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4124032e10 tx=0x7f4124032e40 comp rx=0 tx=0).stop 2024-09-16T00:53:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 shutdown_connections 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f41140391b0 0x7f411403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 --2- 172.21.15.17:0/3250150148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41281080f0 0x7f412819b530 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 >> 172.21.15.17:0/3250150148 conn(0x7f4128101cf0 msgr2=0x7f41281028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 shutdown_connections 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:05.231+0000 7f412f463640 1 -- 172.21.15.17:0/3250150148 wait complete. 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-16T00:53:05.893 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-09-16T00:53:06.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:06 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3250150148' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:53:06.518 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:06.288+0000 7fcda2425040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:53:06.518 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:06.360+0000 7fcda2425040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:53:07.186 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.108+0000 7fcda2425040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:53:07.450 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.231+0000 7fcda2425040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:53:07.451 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.383+0000 7fcda2425040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:53:07.451 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.449+0000 7fcda2425040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:53:07.720 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.610+0000 7fcda2425040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:53:07.720 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.683+0000 7fcda2425040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:53:07.987 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.748+0000 7fcda2425040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:53:07.988 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.917+0000 7fcda2425040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:53:07.988 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:07.986+0000 7fcda2425040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:53:08.270 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:08.056+0000 7fcda2425040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:53:08.271 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:08.144+0000 7fcda2425040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:53:08.271 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:08.207+0000 7fcda2425040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:53:08.271 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:08.269+0000 7fcda2425040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:09.101+0000 7fcda2425040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: Active manager daemon x restarted 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: Activating manager daemon x 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: mgrmap e6: x(active, starting, since 0.00335734s) 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:53:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: Manager daemon x is now available 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:53:09.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:09 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:53:10.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:10 smithi017 ceph-mon[31211]: Found migration_current of "None". Setting to last migration. 2024-09-16T00:53:10.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:10 smithi017 ceph-mon[31211]: mgrmap e7: x(active, since 1.00518s) 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d7ee3640 1 Processor -- start 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d7ee3640 1 -- start start 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d7ee3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d7ee3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57d0107fb0 con 0x7f57d0107670 2024-09-16T00:53:10.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d5c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d5c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55900/0 (socket says 172.21.15.17:55900) 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.310+0000 7f57d5c7f640 1 -- 172.21.15.17:0/3744029553 learned_addr learned my addr 172.21.15.17:0/3744029553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.311+0000 7f57d5c7f640 1 -- 172.21.15.17:0/3744029553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d0108130 con 0x7f57d0107670 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.311+0000 7f57d5c7f640 1 --2- 172.21.15.17:0/3744029553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009820 tx=0x7f57cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c50f020fa6ac35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d4c7d640 1 -- 172.21.15.17:0/3744029553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57cc037070 con 0x7f57d0107670 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d4c7d640 1 -- 172.21.15.17:0/3744029553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f57cc0328d0 con 0x7f57d0107670 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d4c7d640 1 -- 172.21.15.17:0/3744029553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57cc0307d0 con 0x7f57d0107670 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 -- 172.21.15.17:0/3744029553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 msgr2=0x7f57d0107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/3744029553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009820 tx=0x7f57cc02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 -- 172.21.15.17:0/3744029553 shutdown_connections 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/3744029553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d0107a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 -- 172.21.15.17:0/3744029553 >> 172.21.15.17:0/3744029553 conn(0x7f57d0102ec0 msgr2=0x7f57d01052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:10.737 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.312+0000 7f57d7ee3640 1 -- 172.21.15.17:0/3744029553 shutdown_connections 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d7ee3640 1 -- 172.21.15.17:0/3744029553 wait complete. 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d7ee3640 1 Processor -- start 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d7ee3640 1 -- start start 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d7ee3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d7ee3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57d010ba90 con 0x7f57d0107670 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d5c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d5c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55910/0 (socket says 172.21.15.17:55910) 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.313+0000 7f57d5c7f640 1 -- 172.21.15.17:0/314043739 learned_addr learned my addr 172.21.15.17:0/314043739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57d5c7f640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d019dcc0 con 0x7f57d0107670 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57d5c7f640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097f0 tx=0x7f57cc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57cc037040 con 0x7f57d0107670 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d019df50 con 0x7f57d0107670 2024-09-16T00:53:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f57cc032bb0 con 0x7f57d0107670 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57cc03a390 con 0x7f57d0107670 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.314+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d01a0c40 con 0x7f57d0107670 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.315+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f57cc03b3f0 con 0x7f57d0107670 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.316+0000 7f57c6ffd640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.316+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f57bc03bd80 con 0x7f57bc0391b0 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.316+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f57cc06c520 con 0x7f57d0107670 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.316+0000 7f57d547e640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 msgr2=0x7f57bc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.316+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.517+0000 7f57d547e640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 msgr2=0x7f57bc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.517+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.918+0000 7f57d547e640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 msgr2=0x7f57bc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:10.739 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:06.918+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:07.719+0000 7f57d547e640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 msgr2=0x7f57bc03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/930560743 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:07.719+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:09.104+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f57cc06afe0 con 0x7f57d0107670 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:09.104+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 msgr2=0x7f57bc03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:09.104+0000 7f57c6ffd640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.105+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f57cc049cc0 con 0x7f57d0107670 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.105+0000 7f57c6ffd640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 0x7f57bc03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.105+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f57cc006810 con 0x7f57bc03cae0 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.106+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 0x7f57bc03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.107+0000 7f57d547e640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 0x7f57bc03eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f57c0003980 tx=0x7f57c0006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.108+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f57cc006810 con 0x7f57bc03cae0 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f57d010bc10 con 0x7f57bc03cae0 2024-09-16T00:53:10.740 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57c6ffd640 1 -- 172.21.15.17:0/314043739 <== mgr.14118 v2:172.21.15.17:6800/944475972 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f57d010bc10 con 0x7f57bc03cae0 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 msgr2=0x7f57bc03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 0x7f57bc03eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f57c0003980 tx=0x7f57c0006e10 comp rx=0 tx=0).stop 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 msgr2=0x7f57d019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097f0 tx=0x7f57cc030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 shutdown_connections 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f57bc03cae0 0x7f57bc03eed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:6800/930560743,v1:172.21.15.17:6801/930560743] conn(0x7f57bc0391b0 0x7f57bc03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 --2- 172.21.15.17:0/314043739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d0107670 0x7f57d019d780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 >> 172.21.15.17:0/314043739 conn(0x7f57d0102ec0 msgr2=0x7f57d01039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 shutdown_connections 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:10.115+0000 7f57d7ee3640 1 -- 172.21.15.17:0/314043739 wait complete. 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-09-16T00:53:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-09-16T00:53:11.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-mon[31211]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T00:53:11.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-mon[31211]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T00:53:11.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:11.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:11.611 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:11.608+0000 7fcd0973f640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:00:53:11] ENGINE Error in HTTPServer.serve 2024-09-16T00:53:11.611 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Traceback (most recent call last): 2024-09-16T00:53:11.611 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:53:11.611 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-16T00:53:11.611 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._run(expiration_interval) 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self.do_handshake() 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:53:11.612 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-16T00:53:11.613 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:53:11.613 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3fbfc0640 1 Processor -- start 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3fbfc0640 1 -- start start 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3fbfc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3fbfc0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f407be50 con 0x7fe3f4108040 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3f9d5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3f9d5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48784/0 (socket says 172.21.15.17:48784) 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.152+0000 7fe3f9d5c640 1 -- 172.21.15.17:0/2649001400 learned_addr learned my addr 172.21.15.17:0/2649001400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.153+0000 7fe3f9d5c640 1 -- 172.21.15.17:0/2649001400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f410a970 con 0x7fe3f4108040 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.153+0000 7fe3f9d5c640 1 --2- 172.21.15.17:0/2649001400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009820 tx=0x7fe3f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4dc216c2cf5324 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:11.991 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3f8d5a640 1 -- 172.21.15.17:0/2649001400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f0037070 con 0x7fe3f4108040 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3f8d5a640 1 -- 172.21.15.17:0/2649001400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe3f00328d0 con 0x7fe3f4108040 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3f8d5a640 1 -- 172.21.15.17:0/2649001400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f00307d0 con 0x7fe3f4108040 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/2649001400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 msgr2=0x7fe3f410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/2649001400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009820 tx=0x7fe3f002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/2649001400 shutdown_connections 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/2649001400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f410a430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/2649001400 >> 172.21.15.17:0/2649001400 conn(0x7fe3f4101ce0 msgr2=0x7fe3f4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/2649001400 shutdown_connections 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.154+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/2649001400 wait complete. 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3fbfc0640 1 Processor -- start 2024-09-16T00:53:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3fbfc0640 1 -- start start 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3fbfc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3fbfc0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410b950 con 0x7fe3f4108040 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3f9d5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3f9d5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48788/0 (socket says 172.21.15.17:48788) 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3f9d5c640 1 -- 172.21.15.17:0/17210503 learned_addr learned my addr 172.21.15.17:0/17210503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.155+0000 7fe3f9d5c640 1 -- 172.21.15.17:0/17210503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f4107e00 con 0x7fe3f4108040 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3f9d5c640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00097f0 tx=0x7fe3f0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f0037040 con 0x7fe3f4108040 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe3f0032bb0 con 0x7fe3f4108040 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f4105ff0 con 0x7fe3f4108040 2024-09-16T00:53:11.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f003a390 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.156+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f4106530 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.157+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe3f003b3f0 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.157+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f41084a0 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.157+0000 7fe3eaffd640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 0x7fe3e003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.157+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe3f006c370 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.157+0000 7fe3f955b640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 0x7fe3e003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.158+0000 7fe3f955b640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 0x7fe3e003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40098c0 tx=0x7fe3e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.162+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3f0049cc0 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.218+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe3f003a580 con 0x7fe3f4108040 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.359+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe3f4106e80 con 0x7fe3e00390a0 2024-09-16T00:53:11.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.365+0000 7fe3eaffd640 1 -- 172.21.15.17:0/17210503 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe3f4106e80 con 0x7fe3e00390a0 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 msgr2=0x7fe3e003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 0x7fe3e003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40098c0 tx=0x7fe3e4006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 msgr2=0x7fe3f41078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00097f0 tx=0x7fe3f0030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 shutdown_connections 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7fe3e00390a0 0x7fe3e003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 --2- 172.21.15.17:0/17210503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4108040 0x7fe3f41078c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.367+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 >> 172.21.15.17:0/17210503 conn(0x7fe3f4101ce0 msgr2=0x7fe3f41028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.368+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 shutdown_connections 2024-09-16T00:53:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:11.368+0000 7fe3fbfc0640 1 -- 172.21.15.17:0/17210503 wait complete. 2024-09-16T00:53:12.305 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: mgrmap e8: x(active, since 2s) 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:11] ENGINE Bus STARTING 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:11] ENGINE Serving on http://172.21.15.17:8765 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:11] ENGINE Serving on https://172.21.15.17:7150 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:11] ENGINE Bus STARTED 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:12 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:11] ENGINE Error in HTTPServer.serve 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-16T00:53:12.306 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-16T00:53:12.307 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:53:12.308 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-16T00:53:12.308 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:53:13.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T00:53:13.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.386+0000 7f934b912640 1 Processor -- start 2024-09-16T00:53:13.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.386+0000 7f934b912640 1 -- start start 2024-09-16T00:53:13.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.386+0000 7f934b912640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.386+0000 7f934b912640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f934407be10 con 0x7f9344108110 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.387+0000 7f93496ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.387+0000 7f93496ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48794/0 (socket says 172.21.15.17:48794) 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.387+0000 7f93496ae640 1 -- 172.21.15.17:0/984297761 learned_addr learned my addr 172.21.15.17:0/984297761 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.387+0000 7f93496ae640 1 -- 172.21.15.17:0/984297761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934410aa40 con 0x7f9344108110 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.388+0000 7f93496ae640 1 --2- 172.21.15.17:0/984297761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9340009820 tx=0x7f934002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe791e14896b483c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.388+0000 7f933bfff640 1 -- 172.21.15.17:0/984297761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9340037070 con 0x7f9344108110 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.388+0000 7f933bfff640 1 -- 172.21.15.17:0/984297761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f93400328d0 con 0x7f9344108110 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.388+0000 7f933bfff640 1 -- 172.21.15.17:0/984297761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93400307d0 con 0x7f9344108110 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- 172.21.15.17:0/984297761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 msgr2=0x7f934410a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 --2- 172.21.15.17:0/984297761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9340009820 tx=0x7f934002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- 172.21.15.17:0/984297761 shutdown_connections 2024-09-16T00:53:13.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 --2- 172.21.15.17:0/984297761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934410a500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- 172.21.15.17:0/984297761 >> 172.21.15.17:0/984297761 conn(0x7f9344101d10 msgr2=0x7f9344104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- 172.21.15.17:0/984297761 shutdown_connections 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- 172.21.15.17:0/984297761 wait complete. 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 Processor -- start 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.389+0000 7f934b912640 1 -- start start 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f934b912640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f934b912640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f934410b9c0 con 0x7f9344108110 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f93496ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f93496ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48808/0 (socket says 172.21.15.17:48808) 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f93496ae640 1 -- 172.21.15.17:0/2272527760 learned_addr learned my addr 172.21.15.17:0/2272527760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f93496ae640 1 -- 172.21.15.17:0/2272527760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934419bab0 con 0x7f9344108110 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f93496ae640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93400097f0 tx=0x7f9340030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:13.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9340037040 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9340032bb0 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934419bd40 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f934003a390 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.390+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934419ea30 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.391+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f934003b3f0 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.391+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9344108570 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.391+0000 7f933a7fc640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 0x7f933003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.391+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f934006c550 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.392+0000 7f9348ead640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 0x7f933003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.392+0000 7f9348ead640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 0x7f933003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93340098c0 tx=0x7f9334006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.396+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9340040210 con 0x7f9344108110 2024-09-16T00:53:13.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.572+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9344102fa0 con 0x7f9330039200 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.573+0000 7f933a7fc640 1 -- 172.21.15.17:0/2272527760 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9344102fa0 con 0x7f9330039200 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 msgr2=0x7f933003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 0x7f933003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93340098c0 tx=0x7f9334006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 msgr2=0x7f934419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93400097f0 tx=0x7f9340030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 shutdown_connections 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9330039200 0x7f933003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 --2- 172.21.15.17:0/2272527760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9344108110 0x7f934419b570 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 >> 172.21.15.17:0/2272527760 conn(0x7f9344101d10 msgr2=0x7f9344102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 shutdown_connections 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:12.576+0000 7f934b912640 1 -- 172.21.15.17:0/2272527760 wait complete. 2024-09-16T00:53:13.225 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-09-16T00:53:13.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:13 smithi017 ceph-mon[31211]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:14.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Generating public/private rsa key pair. 2024-09-16T00:53:14.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Your identification has been saved in /tmp/tmpjdc_2dtq/key 2024-09-16T00:53:14.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Your public key has been saved in /tmp/tmpjdc_2dtq/key.pub 2024-09-16T00:53:14.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: The key fingerprint is: 2024-09-16T00:53:14.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: SHA256:/ndr4N6g32bYiKSv3H9gVP5o6N4ill//4AlJSjFVmOE ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: The key's randomart image is: 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: +---[RSA 3072]----+ 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | o=. | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | oo . | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | o Eo | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | o. . | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | S .... o | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | . ..o=.o .| 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | .o.*+Bo | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | ..o=.BOB+ | 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: | o+=O*BB.+| 2024-09-16T00:53:14.188 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: +----[SHA256]-----+ 2024-09-16T00:53:14.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b28cf9640 1 Processor -- start 2024-09-16T00:53:14.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b28cf9640 1 -- start start 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b28cf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b28cf9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2407bdf0 con 0x7f7b24108110 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48812/0 (socket says 172.21.15.17:48812) 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b2259c640 1 -- 172.21.15.17:0/854249519 learned_addr learned my addr 172.21.15.17:0/854249519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.635+0000 7f7b2259c640 1 -- 172.21.15.17:0/854249519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2410aa40 con 0x7f7b24108110 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.636+0000 7f7b2259c640 1 --2- 172.21.15.17:0/854249519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009820 tx=0x7f7b1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f746a0d79ebc9492 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.636+0000 7f7b2159a640 1 -- 172.21.15.17:0/854249519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14037070 con 0x7f7b24108110 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.636+0000 7f7b2159a640 1 -- 172.21.15.17:0/854249519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7b140328d0 con 0x7f7b24108110 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.636+0000 7f7b2159a640 1 -- 172.21.15.17:0/854249519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b140307d0 con 0x7f7b24108110 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 -- 172.21.15.17:0/854249519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 msgr2=0x7f7b2410a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:14.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/854249519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009820 tx=0x7f7b1402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 -- 172.21.15.17:0/854249519 shutdown_connections 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/854249519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b2410a500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 -- 172.21.15.17:0/854249519 >> 172.21.15.17:0/854249519 conn(0x7f7b24101d90 msgr2=0x7f7b241041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 -- 172.21.15.17:0/854249519 shutdown_connections 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.637+0000 7f7b28cf9640 1 -- 172.21.15.17:0/854249519 wait complete. 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b28cf9640 1 Processor -- start 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b28cf9640 1 -- start start 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b28cf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b28cf9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2410b9c0 con 0x7f7b24108110 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48816/0 (socket says 172.21.15.17:48816) 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b2259c640 1 -- 172.21.15.17:0/3136341144 learned_addr learned my addr 172.21.15.17:0/3136341144 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.638+0000 7f7b2259c640 1 -- 172.21.15.17:0/3136341144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24107ed0 con 0x7f7b24108110 2024-09-16T00:53:14.637 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b2259c640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097f0 tx=0x7f7b14030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b14037040 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7b14032bb0 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b241060c0 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1403a390 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.639+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b24106600 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.640+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7b1403a5d0 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.640+0000 7f7b1b7fe640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 0x7f7b1003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.640+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b1406c510 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.640+0000 7f7b21d9b640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 0x7f7b1003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.640+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24108570 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.641+0000 7f7b21d9b640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 0x7f7b1003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098c0 tx=0x7f7b0c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.645+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b14040210 con 0x7f7b24108110 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:13.824+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7b24106cb0 con 0x7f7b100391b0 2024-09-16T00:53:14.638 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.016+0000 7f7b1b7fe640 1 -- 172.21.15.17:0/3136341144 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b24106cb0 con 0x7f7b100391b0 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 msgr2=0x7f7b1003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 0x7f7b1003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098c0 tx=0x7f7b0c006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 msgr2=0x7f7b24107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097f0 tx=0x7f7b14030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 shutdown_connections 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f7b100391b0 0x7f7b1003b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 --2- 172.21.15.17:0/3136341144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b24108110 0x7f7b24107990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 >> 172.21.15.17:0/3136341144 conn(0x7f7b24101d90 msgr2=0x7f7b24102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 shutdown_connections 2024-09-16T00:53:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:14.020+0000 7f7b28cf9640 1 -- 172.21.15.17:0/3136341144 wait complete. 2024-09-16T00:53:15.236 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:15 smithi017 ceph-mon[31211]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:15.237 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:15 smithi017 ceph-mon[31211]: Generating ssh key... 2024-09-16T00:53:15.237 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:15 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:15.237 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:15 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d32d30640 1 Processor -- start 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d32d30640 1 -- start start 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d32d30640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d32d30640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c07c830 con 0x7f9d2c07dd80 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d30acc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d30acc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48820/0 (socket says 172.21.15.17:48820) 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.048+0000 7f9d30acc640 1 -- 172.21.15.17:0/2816103535 learned_addr learned my addr 172.21.15.17:0/2816103535 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.049+0000 7f9d30acc640 1 -- 172.21.15.17:0/2816103535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c07c9b0 con 0x7f9d2c07dd80 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.049+0000 7f9d30acc640 1 --2- 172.21.15.17:0/2816103535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009820 tx=0x7f9d2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99169b16d211cef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d2b7fe640 1 -- 172.21.15.17:0/2816103535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d20037070 con 0x7f9d2c07dd80 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d2b7fe640 1 -- 172.21.15.17:0/2816103535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9d200328d0 con 0x7f9d2c07dd80 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d2b7fe640 1 -- 172.21.15.17:0/2816103535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d200307d0 con 0x7f9d2c07dd80 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 -- 172.21.15.17:0/2816103535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 msgr2=0x7f9d2c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 --2- 172.21.15.17:0/2816103535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009820 tx=0x7f9d2002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 -- 172.21.15.17:0/2816103535 shutdown_connections 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 --2- 172.21.15.17:0/2816103535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c07c2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 -- 172.21.15.17:0/2816103535 >> 172.21.15.17:0/2816103535 conn(0x7f9d2c102f00 msgr2=0x7f9d2c105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 -- 172.21.15.17:0/2816103535 shutdown_connections 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.050+0000 7f9d32d30640 1 -- 172.21.15.17:0/2816103535 wait complete. 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d32d30640 1 Processor -- start 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d32d30640 1 -- start start 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d32d30640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:15.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d32d30640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c10db70 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d30acc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d30acc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48836/0 (socket says 172.21.15.17:48836) 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d30acc640 1 -- 172.21.15.17:0/686706264 learned_addr learned my addr 172.21.15.17:0/686706264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.051+0000 7f9d30acc640 1 -- 172.21.15.17:0/686706264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c19dce0 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d30acc640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d20032e10 tx=0x7f9d20032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d20042070 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9d20030c80 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d20037040 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c19df70 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.052+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a0c60 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.053+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9d20045070 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.053+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c07c370 con 0x7f9d2c07dd80 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.053+0000 7f9d29ffb640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 0x7f9d1c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:15.819 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.053+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d2006c1f0 con 0x7f9d2c07dd80 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.053+0000 7f9d2bfff640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 0x7f9d1c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.054+0000 7f9d2bfff640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 0x7f9d1c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d180098c0 tx=0x7f9d18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.058+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d2002e200 con 0x7f9d2c07dd80 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.236+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f9d2c1041c0 con 0x7f9d1c039200 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.237+0000 7f9d29ffb640 1 -- 172.21.15.17:0/686706264 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f9d2c1041c0 con 0x7f9d1c039200 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 msgr2=0x7f9d1c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 0x7f9d1c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d180098c0 tx=0x7f9d18006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 msgr2=0x7f9d2c19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d20032e10 tx=0x7f9d20032e40 comp rx=0 tx=0).stop 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 shutdown_connections 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9d1c039200 0x7f9d1c03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:15.820 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 --2- 172.21.15.17:0/686706264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d2c07dd80 0x7f9d2c19d7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:15.821 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 >> 172.21.15.17:0/686706264 conn(0x7f9d2c102f00 msgr2=0x7f9d2c103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:15.821 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 shutdown_connections 2024-09-16T00:53:15.821 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:15.239+0000 7f9d32d30640 1 -- 172.21.15.17:0/686706264 wait complete. 2024-09-16T00:53:15.821 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T00:53:15.821 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T00:53:15.822 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-09-16T00:53:16.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:16 smithi017 ceph-mon[31211]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:17.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:17 smithi017 ceph-mon[31211]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:18.416 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:18 smithi017 ceph-mon[31211]: Deploying cephadm binary to smithi017 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.253+0000 7f604dd76640 1 Processor -- start 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.253+0000 7f604dd76640 1 -- start start 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.253+0000 7f604dd76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.254+0000 7f604dd76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f604807be50 con 0x7f6048108040 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.254+0000 7f60477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.254+0000 7f60477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48846/0 (socket says 172.21.15.17:48846) 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.254+0000 7f60477fe640 1 -- 172.21.15.17:0/549771081 learned_addr learned my addr 172.21.15.17:0/549771081 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.254+0000 7f60477fe640 1 -- 172.21.15.17:0/549771081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604810a970 con 0x7f6048108040 2024-09-16T00:53:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f60477fe640 1 --2- 172.21.15.17:0/549771081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6038009820 tx=0x7f603802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5032d0c3af85bbdf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f60467fc640 1 -- 172.21.15.17:0/549771081 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6038037070 con 0x7f6048108040 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f60467fc640 1 -- 172.21.15.17:0/549771081 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f60380328d0 con 0x7f6048108040 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f60467fc640 1 -- 172.21.15.17:0/549771081 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60380307d0 con 0x7f6048108040 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f604dd76640 1 -- 172.21.15.17:0/549771081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 msgr2=0x7f604810a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f604dd76640 1 --2- 172.21.15.17:0/549771081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6038009820 tx=0x7f603802a270 comp rx=0 tx=0).stop 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f604dd76640 1 -- 172.21.15.17:0/549771081 shutdown_connections 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f604dd76640 1 --2- 172.21.15.17:0/549771081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f604810a430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.255+0000 7f604dd76640 1 -- 172.21.15.17:0/549771081 >> 172.21.15.17:0/549771081 conn(0x7f6048101ce0 msgr2=0x7f6048104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.256+0000 7f604dd76640 1 -- 172.21.15.17:0/549771081 shutdown_connections 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.256+0000 7f604dd76640 1 -- 172.21.15.17:0/549771081 wait complete. 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.256+0000 7f604dd76640 1 Processor -- start 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.256+0000 7f604dd76640 1 -- start start 2024-09-16T00:53:20.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f604dd76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f604dd76640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f604810b950 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f60477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f60477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48858/0 (socket says 172.21.15.17:48858) 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f60477fe640 1 -- 172.21.15.17:0/2178600901 learned_addr learned my addr 172.21.15.17:0/2178600901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f60477fe640 1 -- 172.21.15.17:0/2178600901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048107e00 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f60477fe640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f60380097f0 tx=0x7f6038030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6038037040 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6038032bb0 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6048105ff0 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603803a390 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.257+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6048106530 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.258+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f603803a580 con 0x7f6048108040 2024-09-16T00:53:20.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.259+0000 7f6044ff9640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 0x7f603003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.258+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60481084a0 con 0x7f6048108040 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.259+0000 7f6046ffd640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 0x7f603003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.259+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f603806c5f0 con 0x7f6048108040 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.259+0000 7f6046ffd640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 0x7f603003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f603c0098c0 tx=0x7f603c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.263+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6038049d80 con 0x7f6048108040 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:16.447+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) -- 0x7f6048106e80 con 0x7f6030039200 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.380+0000 7f6044ff9640 1 -- 172.21.15.17:0/2178600901 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6048106e80 con 0x7f6030039200 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.383+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 msgr2=0x7f603003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.383+0000 7f604dd76640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 0x7f603003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f603c0098c0 tx=0x7f603c006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 msgr2=0x7f60481078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f60380097f0 tx=0x7f6038030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 shutdown_connections 2024-09-16T00:53:20.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f6030039200 0x7f603003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:20.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 --2- 172.21.15.17:0/2178600901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6048108040 0x7f60481078c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:20.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 >> 172.21.15.17:0/2178600901 conn(0x7f6048101ce0 msgr2=0x7f60481028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:20.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 shutdown_connections 2024-09-16T00:53:20.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:20.384+0000 7f604dd76640 1 -- 172.21.15.17:0/2178600901 wait complete. 2024-09-16T00:53:20.978 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2024-09-16T00:53:21.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:21 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:21.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:21 smithi017 ceph-mon[31211]: Added host smithi017 2024-09-16T00:53:21.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:21 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:22.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3acedde640 1 Processor -- start 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3acedde640 1 -- start start 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3acedde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3acedde640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac807bdf0 con 0x7f3ac8108110 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3accb7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3accb7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46350/0 (socket says 172.21.15.17:46350) 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3accb7a640 1 -- 172.21.15.17:0/4036925603 learned_addr learned my addr 172.21.15.17:0/4036925603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.439+0000 7f3accb7a640 1 -- 172.21.15.17:0/4036925603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac810aa40 con 0x7f3ac8108110 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.440+0000 7f3accb7a640 1 --2- 172.21.15.17:0/4036925603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009820 tx=0x7f3abc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc85c93834b9385 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.440+0000 7f3ac77fe640 1 -- 172.21.15.17:0/4036925603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3abc037070 con 0x7f3ac8108110 2024-09-16T00:53:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.440+0000 7f3ac77fe640 1 -- 172.21.15.17:0/4036925603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3abc0328d0 con 0x7f3ac8108110 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.440+0000 7f3ac77fe640 1 -- 172.21.15.17:0/4036925603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3abc0307d0 con 0x7f3ac8108110 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 -- 172.21.15.17:0/4036925603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 msgr2=0x7f3ac810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 --2- 172.21.15.17:0/4036925603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009820 tx=0x7f3abc02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 -- 172.21.15.17:0/4036925603 shutdown_connections 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 --2- 172.21.15.17:0/4036925603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac810a500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 -- 172.21.15.17:0/4036925603 >> 172.21.15.17:0/4036925603 conn(0x7f3ac8101d90 msgr2=0x7f3ac81041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 -- 172.21.15.17:0/4036925603 shutdown_connections 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.441+0000 7f3acedde640 1 -- 172.21.15.17:0/4036925603 wait complete. 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3acedde640 1 Processor -- start 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3acedde640 1 -- start start 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3acedde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3acedde640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac810b9c0 con 0x7f3ac8108110 2024-09-16T00:53:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3accb7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3accb7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46360/0 (socket says 172.21.15.17:46360) 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3accb7a640 1 -- 172.21.15.17:0/3051538083 learned_addr learned my addr 172.21.15.17:0/3051538083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3accb7a640 1 -- 172.21.15.17:0/3051538083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac819ba90 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3accb7a640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0097f0 tx=0x7f3abc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.442+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3abc037040 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.443+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3abc032bb0 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.443+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac819bd20 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.443+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3abc03a390 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.443+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac819ea10 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3abc03b3f0 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac8108570 con 0x7f3ac8108110 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3ac5ffb640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 0x7f3ab803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:22.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3abc06c590 con 0x7f3ac8108110 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3ac7fff640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 0x7f3ab803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.444+0000 7f3ac7fff640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 0x7f3ab803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.449+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3abc040210 con 0x7f3ac8108110 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.639+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3ac8103030 con 0x7f3ab8039200 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.644+0000 7f3ac5ffb640 1 -- 172.21.15.17:0/3051538083 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3ac8103030 con 0x7f3ab8039200 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 msgr2=0x7f3ab803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 0x7f3ab803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab4006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 msgr2=0x7f3ac819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0097f0 tx=0x7f3abc030d00 comp rx=0 tx=0).stop 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 shutdown_connections 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f3ab8039200 0x7f3ab803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:22.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 --2- 172.21.15.17:0/3051538083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ac8108110 0x7f3ac819b550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:22.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 >> 172.21.15.17:0/3051538083 conn(0x7f3ac8101d90 msgr2=0x7f3ac8102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:22.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 shutdown_connections 2024-09-16T00:53:22.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:21.647+0000 7f3acedde640 1 -- 172.21.15.17:0/3051538083 wait complete. 2024-09-16T00:53:22.273 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2024-09-16T00:53:22.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:22 smithi017 ceph-mon[31211]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:22.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:22 smithi017 ceph-mon[31211]: Saving service mon spec with placement count:5 2024-09-16T00:53:22.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:22 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:23.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T00:53:23.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.647+0000 7f9899836640 1 Processor -- start 2024-09-16T00:53:23.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.647+0000 7f9899836640 1 -- start start 2024-09-16T00:53:23.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9899836640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:23.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9899836640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9894107f90 con 0x7f9894107650 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46366/0 (socket says 172.21.15.17:46366) 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9892ffd640 1 -- 172.21.15.17:0/1523937857 learned_addr learned my addr 172.21.15.17:0/1523937857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.648+0000 7f9892ffd640 1 -- 172.21.15.17:0/1523937857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9894108110 con 0x7f9894107650 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.649+0000 7f9892ffd640 1 --2- 172.21.15.17:0/1523937857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9884009820 tx=0x7f988402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763a0e1461fe50f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.649+0000 7f9891ffb640 1 -- 172.21.15.17:0/1523937857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9884037070 con 0x7f9894107650 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.649+0000 7f9891ffb640 1 -- 172.21.15.17:0/1523937857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f98840328d0 con 0x7f9894107650 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.649+0000 7f9891ffb640 1 -- 172.21.15.17:0/1523937857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98840307d0 con 0x7f9894107650 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- 172.21.15.17:0/1523937857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 msgr2=0x7f9894107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 --2- 172.21.15.17:0/1523937857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9884009820 tx=0x7f988402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- 172.21.15.17:0/1523937857 shutdown_connections 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 --2- 172.21.15.17:0/1523937857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f9894107a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:23.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- 172.21.15.17:0/1523937857 >> 172.21.15.17:0/1523937857 conn(0x7f9894102e60 msgr2=0x7f98941052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- 172.21.15.17:0/1523937857 shutdown_connections 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- 172.21.15.17:0/1523937857 wait complete. 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 Processor -- start 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.650+0000 7f9899836640 1 -- start start 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9899836640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9899836640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f989410bac0 con 0x7f9894107650 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46370/0 (socket says 172.21.15.17:46370) 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9892ffd640 1 -- 172.21.15.17:0/4005527233 learned_addr learned my addr 172.21.15.17:0/4005527233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9892ffd640 1 -- 172.21.15.17:0/4005527233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989407e0a0 con 0x7f9894107650 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9892ffd640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9884032e10 tx=0x7f9884032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:23.478 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9884042070 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9884030c80 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.651+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989407c290 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.652+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9884037040 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.652+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989407c7d0 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.652+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9884045070 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.653+0000 7f9898834640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 0x7f987c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.653+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f988406c210 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.653+0000 7f98927fc640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 0x7f987c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.653+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989410bc40 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.653+0000 7f98927fc640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 0x7f987c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98880098c0 tx=0x7f9888006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.658+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9884045360 con 0x7f9894107650 2024-09-16T00:53:23.479 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.850+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f989407cf50 con 0x7f987c039200 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.854+0000 7f9898834640 1 -- 172.21.15.17:0/4005527233 <== mgr.14118 v2:172.21.15.17:6800/944475972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f989407cf50 con 0x7f987c039200 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 msgr2=0x7f987c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 0x7f987c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98880098c0 tx=0x7f9888006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 msgr2=0x7f989407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9884032e10 tx=0x7f9884032e40 comp rx=0 tx=0).stop 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 shutdown_connections 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f987c039200 0x7f987c03b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 --2- 172.21.15.17:0/4005527233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9894107650 0x7f989407db60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 >> 172.21.15.17:0/4005527233 conn(0x7f9894102e60 msgr2=0x7f98941039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 shutdown_connections 2024-09-16T00:53:23.480 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:22.856+0000 7f9899836640 1 -- 172.21.15.17:0/4005527233 wait complete. 2024-09-16T00:53:24.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:23 smithi017 ceph-mon[31211]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:24.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:23 smithi017 ceph-mon[31211]: Saving service mgr spec with placement count:2 2024-09-16T00:53:24.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:23 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f526783b640 1 Processor -- start 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f526783b640 1 -- start start 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f526783b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f526783b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5260106ea0 con 0x7f52601064d0 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f52655d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f52655d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46384/0 (socket says 172.21.15.17:46384) 2024-09-16T00:53:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f52655d7640 1 -- 172.21.15.17:0/2673253405 learned_addr learned my addr 172.21.15.17:0/2673253405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.310+0000 7f52655d7640 1 -- 172.21.15.17:0/2673253405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5260107680 con 0x7f52601064d0 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.311+0000 7f52655d7640 1 --2- 172.21.15.17:0/2673253405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f525c009820 tx=0x7f525c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68819d84894bf0a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.311+0000 7f5257fff640 1 -- 172.21.15.17:0/2673253405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c037070 con 0x7f52601064d0 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.311+0000 7f5257fff640 1 -- 172.21.15.17:0/2673253405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f525c0328d0 con 0x7f52601064d0 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.311+0000 7f5257fff640 1 -- 172.21.15.17:0/2673253405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c0307d0 con 0x7f52601064d0 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 -- 172.21.15.17:0/2673253405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 msgr2=0x7f52601068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 --2- 172.21.15.17:0/2673253405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f525c009820 tx=0x7f525c02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 -- 172.21.15.17:0/2673253405 shutdown_connections 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 --2- 172.21.15.17:0/2673253405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601068d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 -- 172.21.15.17:0/2673253405 >> 172.21.15.17:0/2673253405 conn(0x7f5260101ce0 msgr2=0x7f5260104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 -- 172.21.15.17:0/2673253405 shutdown_connections 2024-09-16T00:53:25.338 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.312+0000 7f526783b640 1 -- 172.21.15.17:0/2673253405 wait complete. 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f526783b640 1 Processor -- start 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f526783b640 1 -- start start 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f526783b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f526783b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f526010aa30 con 0x7f52601064d0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f52655d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f52655d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46392/0 (socket says 172.21.15.17:46392) 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f52655d7640 1 -- 172.21.15.17:0/653499662 learned_addr learned my addr 172.21.15.17:0/653499662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.313+0000 7f52655d7640 1 -- 172.21.15.17:0/653499662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5260191bf0 con 0x7f52601064d0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f52655d7640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f525c009940 tx=0x7f525c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c042070 con 0x7f52601064d0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526018fde0 con 0x7f52601064d0 2024-09-16T00:53:25.339 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f525c030c80 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c037040 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.314+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5260190320 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.315+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f525c045070 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.315+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526010abb0 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.315+0000 7f52567fc640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.315+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f525c06c350 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.315+0000 7f5264dd6640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.316+0000 7f5264dd6640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 0x7f524c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f52500098c0 tx=0x7f5250006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.320+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f525c046bd0 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.496+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5260106950 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.499+0000 7f52567fc640 1 -- 172.21.15.17:0/653499662 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f525c046db0 con 0x7f52601064d0 2024-09-16T00:53:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 msgr2=0x7f524c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 0x7f524c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f52500098c0 tx=0x7f5250006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 msgr2=0x7f52601916b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f525c009940 tx=0x7f525c032e10 comp rx=0 tx=0).stop 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 shutdown_connections 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 --2- 172.21.15.17:0/653499662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52601064d0 0x7f52601916b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 >> 172.21.15.17:0/653499662 conn(0x7f5260101ce0 msgr2=0x7f5260102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 shutdown_connections 2024-09-16T00:53:25.341 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:24.501+0000 7f526783b640 1 -- 172.21.15.17:0/653499662 wait complete. 2024-09-16T00:53:25.623 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:25 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/653499662' entity='client.admin' 2024-09-16T00:53:25.623 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:25 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.706+0000 7ff9a9a3f640 1 Processor -- start 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.706+0000 7ff9a9a3f640 1 -- start start 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a9a3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a9a3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a407bdf0 con 0x7ff9a4108110 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46402/0 (socket says 172.21.15.17:46402) 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/1355226359 learned_addr learned my addr 172.21.15.17:0/1355226359 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.707+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/1355226359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a410aa40 con 0x7ff9a4108110 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.708+0000 7ff9a2ffd640 1 --2- 172.21.15.17:0/1355226359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff994009820 tx=0x7ff99402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878504dd3df2d56f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:26.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.708+0000 7ff9a1ffb640 1 -- 172.21.15.17:0/1355226359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff994037070 con 0x7ff9a4108110 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.708+0000 7ff9a1ffb640 1 -- 172.21.15.17:0/1355226359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9940328f0 con 0x7ff9a4108110 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.708+0000 7ff9a1ffb640 1 -- 172.21.15.17:0/1355226359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff994030740 con 0x7ff9a4108110 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/1355226359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 msgr2=0x7ff9a410a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/1355226359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff994009820 tx=0x7ff99402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/1355226359 shutdown_connections 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/1355226359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a410a500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/1355226359 >> 172.21.15.17:0/1355226359 conn(0x7ff9a4101d90 msgr2=0x7ff9a41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/1355226359 shutdown_connections 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.709+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/1355226359 wait complete. 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a9a3f640 1 Processor -- start 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a9a3f640 1 -- start start 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a9a3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:26.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a9a3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a410ba00 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46418/0 (socket says 172.21.15.17:46418) 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.710+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/2763914969 learned_addr learned my addr 172.21.15.17:0/2763914969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/2763914969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4107ed0 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a2ffd640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097f0 tx=0x7ff994030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff994042070 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff994030d80 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff994037040 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a41060c0 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.711+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a4106600 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.712+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a4108570 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.712+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff994045070 con 0x7ff9a4108110 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.712+0000 7ff9a8a3d640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 0x7ff98c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:26.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.713+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff99406c460 con 0x7ff9a4108110 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.713+0000 7ff9a27fc640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 0x7ff98c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.713+0000 7ff9a27fc640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 0x7ff98c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9980098c0 tx=0x7ff998006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.717+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff99403be10 con 0x7ff9a4108110 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.900+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ff9a4106e10 con 0x7ff9a4108110 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.903+0000 7ff9a8a3d640 1 -- 172.21.15.17:0/2763914969 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ff99403cc50 con 0x7ff9a4108110 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 msgr2=0x7ff98c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 0x7ff98c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9980098c0 tx=0x7ff998006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 msgr2=0x7ff9a4107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9940097f0 tx=0x7ff994030c70 comp rx=0 tx=0).stop 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 shutdown_connections 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7ff98c0391b0 0x7ff98c03b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 --2- 172.21.15.17:0/2763914969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a4108110 0x7ff9a4107990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:26.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.905+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 >> 172.21.15.17:0/2763914969 conn(0x7ff9a4101d90 msgr2=0x7ff9a4102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:26.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.906+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 shutdown_connections 2024-09-16T00:53:26.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:25.906+0000 7ff9a9a3f640 1 -- 172.21.15.17:0/2763914969 wait complete. 2024-09-16T00:53:26.488 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-09-16T00:53:27.184 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:26 smithi017 ceph-mon[31211]: from='mgr.14118 172.21.15.17:0/1966043375' entity='mgr.x' 2024-09-16T00:53:27.184 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:26 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2763914969' entity='client.admin' 2024-09-16T00:53:28.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:27 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1988368741' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T00:53:28.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-16T00:53:28.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-16T00:53:28.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:27.928+0000 7ffae35a9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:53:28.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:27.987+0000 7ffae35a9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:53:28.367 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.144+0000 7ffae35a9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:53:28.367 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.213+0000 7ffae35a9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:53:28.368 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.367+0000 7ffae35a9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:53:28.431 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f357c1d1640 1 Processor -- start 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f357c1d1640 1 -- start start 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f357c1d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f357c1d1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f357410a230 con 0x7f3574109860 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f3579f6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f3579f6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46428/0 (socket says 172.21.15.17:46428) 2024-09-16T00:53:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f3579f6d640 1 -- 172.21.15.17:0/3359187672 learned_addr learned my addr 172.21.15.17:0/3359187672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:28.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.937+0000 7f3579f6d640 1 -- 172.21.15.17:0/3359187672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357410aa30 con 0x7f3574109860 2024-09-16T00:53:28.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.938+0000 7f3579f6d640 1 --2- 172.21.15.17:0/3359187672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3570009820 tx=0x7f357002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7add3c5abdbe1b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:28.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.938+0000 7f3578f6b640 1 -- 172.21.15.17:0/3359187672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570037070 con 0x7f3574109860 2024-09-16T00:53:28.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.938+0000 7f3578f6b640 1 -- 172.21.15.17:0/3359187672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35700328f0 con 0x7f3574109860 2024-09-16T00:53:28.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.938+0000 7f3578f6b640 1 -- 172.21.15.17:0/3359187672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570030740 con 0x7f3574109860 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 -- 172.21.15.17:0/3359187672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 msgr2=0x7f3574109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 --2- 172.21.15.17:0/3359187672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3570009820 tx=0x7f357002a270 comp rx=0 tx=0).stop 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 -- 172.21.15.17:0/3359187672 shutdown_connections 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 --2- 172.21.15.17:0/3359187672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f3574109c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 -- 172.21.15.17:0/3359187672 >> 172.21.15.17:0/3359187672 conn(0x7f357407ced0 msgr2=0x7f357407d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:28.434 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 -- 172.21.15.17:0/3359187672 shutdown_connections 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.939+0000 7f357c1d1640 1 -- 172.21.15.17:0/3359187672 wait complete. 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f357c1d1640 1 Processor -- start 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f357c1d1640 1 -- start start 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f357c1d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f357c1d1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f357410dde0 con 0x7f3574109860 2024-09-16T00:53:28.435 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f3579f6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f3579f6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46440/0 (socket says 172.21.15.17:46440) 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f3579f6d640 1 -- 172.21.15.17:0/1988368741 learned_addr learned my addr 172.21.15.17:0/1988368741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f3579f6d640 1 -- 172.21.15.17:0/1988368741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357419dcd0 con 0x7f3574109860 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f3579f6d640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3570009940 tx=0x7f3570030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570042070 con 0x7f3574109860 2024-09-16T00:53:28.436 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3570030e30 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.940+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357419df60 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.941+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3570037040 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.941+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35741a0c50 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.941+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3570045070 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.941+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3574109ce0 con 0x7f3574109860 2024-09-16T00:53:28.437 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.942+0000 7f356affd640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 0x7f356003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.942+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f357006c3d0 con 0x7f3574109860 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.942+0000 7f357976c640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 0x7f356003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.942+0000 7f357976c640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 0x7f356003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35640098c0 tx=0x7f3564006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:26.947+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f357006bd20 con 0x7f3574109860 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.183+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f35741a0e20 con 0x7f3574109860 2024-09-16T00:53:28.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.777+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f357002fd90 con 0x7f3574109860 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.779+0000 7f356affd640 1 -- 172.21.15.17:0/1988368741 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f357003d950 con 0x7f3574109860 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 msgr2=0x7f356003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 0x7f356003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35640098c0 tx=0x7f3564006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 msgr2=0x7f357419d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3570009940 tx=0x7f3570030cc0 comp rx=0 tx=0).stop 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 shutdown_connections 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f35600391b0 0x7f356003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 --2- 172.21.15.17:0/1988368741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3574109860 0x7f357419d790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 >> 172.21.15.17:0/1988368741 conn(0x7f357407ced0 msgr2=0x7f3574107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 shutdown_connections 2024-09-16T00:53:28.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:27.780+0000 7f357c1d1640 1 -- 172.21.15.17:0/1988368741 wait complete. 2024-09-16T00:53:28.657 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.517+0000 7ffae35a9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:53:28.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1988368741' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T00:53:28.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-mon[31211]: mgrmap e9: x(active, since 18s) 2024-09-16T00:53:28.922 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.857+0000 7ffae35a9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:53:28.922 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:28.921+0000 7ffae35a9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:53:29.186 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:29.125+0000 7ffae35a9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:53:29.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.836+0000 7f9cba4cf640 1 Processor -- start 2024-09-16T00:53:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.836+0000 7f9cba4cf640 1 -- start start 2024-09-16T00:53:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.836+0000 7f9cba4cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.836+0000 7f9cba4cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb407be50 con 0x7f9cb4108040 2024-09-16T00:53:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.837+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.837+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46470/0 (socket says 172.21.15.17:46470) 2024-09-16T00:53:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.837+0000 7f9cb3fff640 1 -- 172.21.15.17:0/3213142672 learned_addr learned my addr 172.21.15.17:0/3213142672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.837+0000 7f9cb3fff640 1 -- 172.21.15.17:0/3213142672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb410a970 con 0x7f9cb4108040 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cb3fff640 1 --2- 172.21.15.17:0/3213142672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009820 tx=0x7f9ca402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d4d602990c7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cb2ffd640 1 -- 172.21.15.17:0/3213142672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4037070 con 0x7f9cb4108040 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cb2ffd640 1 -- 172.21.15.17:0/3213142672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ca40328f0 con 0x7f9cb4108040 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cb2ffd640 1 -- 172.21.15.17:0/3213142672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4030740 con 0x7f9cb4108040 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cba4cf640 1 -- 172.21.15.17:0/3213142672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 msgr2=0x7f9cb410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:29.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.838+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/3213142672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009820 tx=0x7f9ca402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- 172.21.15.17:0/3213142672 shutdown_connections 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/3213142672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb410a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- 172.21.15.17:0/3213142672 >> 172.21.15.17:0/3213142672 conn(0x7f9cb4101ce0 msgr2=0x7f9cb4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- 172.21.15.17:0/3213142672 shutdown_connections 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- 172.21.15.17:0/3213142672 wait complete. 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 Processor -- start 2024-09-16T00:53:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- start start 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.839+0000 7f9cba4cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb410b990 con 0x7f9cb4108040 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46486/0 (socket says 172.21.15.17:46486) 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb3fff640 1 -- 172.21.15.17:0/1290831251 learned_addr learned my addr 172.21.15.17:0/1290831251 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb3fff640 1 -- 172.21.15.17:0/1290831251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb419dc70 con 0x7f9cb4108040 2024-09-16T00:53:29.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb3fff640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40097f0 tx=0x7f9ca4030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:29.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4042070 con 0x7f9cb4108040 2024-09-16T00:53:29.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb419df00 con 0x7f9cb4108040 2024-09-16T00:53:29.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ca4030d80 con 0x7f9cb4108040 2024-09-16T00:53:29.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4037040 con 0x7f9cb4108040 2024-09-16T00:53:29.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.840+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb41a0bf0 con 0x7f9cb4108040 2024-09-16T00:53:29.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.841+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb41084a0 con 0x7f9cb4108040 2024-09-16T00:53:29.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.841+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f9ca4045070 con 0x7f9cb4108040 2024-09-16T00:53:29.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.842+0000 7f9cb17fa640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.842+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9ca406c340 con 0x7f9cb4108040 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.842+0000 7f9cb37fe640 1 -- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.842+0000 7f9cb37fe640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:28.846+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ca4043260 con 0x7f9cb4108040 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.043+0000 7f9cb37fe640 1 -- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.043+0000 7f9cb37fe640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.072+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9cb41a0dc0 con 0x7f9cb4108040 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.073+0000 7f9cb17fa640 1 -- 172.21.15.17:0/1290831251 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f9cb41a0dc0 con 0x7f9cb4108040 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 msgr2=0x7f9cb419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:29.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40097f0 tx=0x7f9ca4030c70 comp rx=0 tx=0).stop 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 shutdown_connections 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 --2- 172.21.15.17:0/1290831251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb4108040 0x7f9cb419d730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 >> 172.21.15.17:0/1290831251 conn(0x7f9cb4101ce0 msgr2=0x7f9cb4102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 shutdown_connections 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:29.075+0000 7f9cba4cf640 1 -- 172.21.15.17:0/1290831251 wait complete. 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-16T00:53:29.713 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-09-16T00:53:30.037 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:29 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1290831251' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:53:30.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:30.060+0000 7ffae35a9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:53:30.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:30.133+0000 7ffae35a9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:53:30.996 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:30.875+0000 7ffae35a9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:53:30.996 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:30.995+0000 7ffae35a9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:53:31.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.144+0000 7ffae35a9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:53:31.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.208+0000 7ffae35a9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:53:31.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.363+0000 7ffae35a9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:53:31.662 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.434+0000 7ffae35a9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:53:31.662 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.496+0000 7ffae35a9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:53:31.662 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.662+0000 7ffae35a9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:53:31.937 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.729+0000 7ffae35a9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:53:31.937 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.798+0000 7ffae35a9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:53:31.937 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.885+0000 7ffae35a9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:53:32.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:31.947+0000 7ffae35a9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:53:32.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:32.008+0000 7ffae35a9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:53:33.089 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:32.833+0000 7ffae35a9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:53:33.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: Active manager daemon x restarted 2024-09-16T00:53:33.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: Activating manager daemon x 2024-09-16T00:53:33.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: mgrmap e10: x(active, starting, since 0.00315636s) 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: Manager daemon x is now available 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:53:33.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T00:53:34.521 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:34.343+0000 7ffa49072640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:00:53:34] ENGINE Error in HTTPServer.serve 2024-09-16T00:53:34.521 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Traceback (most recent call last): 2024-09-16T00:53:34.521 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._run(expiration_interval) 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:53:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self.do_handshake() 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:53:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T00:53:34.812 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af794e640 1 Processor -- start 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af794e640 1 -- start start 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af794e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af794e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0af010a700 con 0x7f0af007bce0 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af56ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af56ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46488/0 (socket says 172.21.15.17:46488) 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af56ea640 1 -- 172.21.15.17:0/1130834187 learned_addr learned my addr 172.21.15.17:0/1130834187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.118+0000 7f0af56ea640 1 -- 172.21.15.17:0/1130834187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af010a880 con 0x7f0af007bce0 2024-09-16T00:53:34.813 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.119+0000 7f0af56ea640 1 --2- 172.21.15.17:0/1130834187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009820 tx=0x7f0aec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5737f133d69ab518 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.119+0000 7f0ae7fff640 1 -- 172.21.15.17:0/1130834187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aec037070 con 0x7f0af007bce0 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.119+0000 7f0ae7fff640 1 -- 172.21.15.17:0/1130834187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aec0328f0 con 0x7f0af007bce0 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.119+0000 7f0ae7fff640 1 -- 172.21.15.17:0/1130834187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aec030740 con 0x7f0af007bce0 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 -- 172.21.15.17:0/1130834187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 msgr2=0x7f0af010a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 --2- 172.21.15.17:0/1130834187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009820 tx=0x7f0aec02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 -- 172.21.15.17:0/1130834187 shutdown_connections 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 --2- 172.21.15.17:0/1130834187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af007bce0 0x7f0af010a130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 -- 172.21.15.17:0/1130834187 >> 172.21.15.17:0/1130834187 conn(0x7f0af0101ce0 msgr2=0x7f0af0104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 -- 172.21.15.17:0/1130834187 shutdown_connections 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.120+0000 7f0af794e640 1 -- 172.21.15.17:0/1130834187 wait complete. 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af794e640 1 Processor -- start 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af794e640 1 -- start start 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af794e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af794e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0af010b960 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af56ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af56ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46496/0 (socket says 172.21.15.17:46496) 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af56ea640 1 -- 172.21.15.17:0/1516301291 learned_addr learned my addr 172.21.15.17:0/1516301291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.121+0000 7f0af56ea640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af0107d80 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0af56ea640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aec030cc0 tx=0x7f0aec030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aec042070 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0aec030e60 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af0106610 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aec037040 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.122+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af0106af0 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f0aec045070 con 0x7f0af0107960 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0ae67fc640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:34.815 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0adc03be30 con 0x7f0adc039260 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0af4ee9640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 msgr2=0x7f0adc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0aec06c360 con 0x7f0af0107960 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.123+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.324+0000 7f0af4ee9640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 msgr2=0x7f0adc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.324+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.725+0000 7f0af4ee9640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 msgr2=0x7f0adc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:30.725+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:31.526+0000 7f0af4ee9640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 msgr2=0x7f0adc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/944475972 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:31.526+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:32.837+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f0aec06ae10 con 0x7f0af0107960 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:32.837+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 msgr2=0x7f0adc03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:32.837+0000 7f0ae67fc640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.838+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f0aec03c650 con 0x7f0af0107960 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.838+0000 7f0ae67fc640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 0x7f0adc03f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.838+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0aec065480 con 0x7f0adc03cd20 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.839+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 0x7f0adc03f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.840+0000 7f0af4ee9640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 0x7f0adc03f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0003980 tx=0x7f0ae00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.840+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0aec065480 con 0x7f0adc03cd20 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.847+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0af01081a0 con 0x7f0adc03cd20 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.847+0000 7f0ae67fc640 1 -- 172.21.15.17:0/1516301291 <== mgr.14150 v2:172.21.15.17:6800/333607551 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f0af01081a0 con 0x7f0adc03cd20 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 msgr2=0x7f0adc03f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 0x7f0adc03f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0003980 tx=0x7f0ae00092b0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 msgr2=0x7f0af01060d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0aec030cc0 tx=0x7f0aec030cf0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 shutdown_connections 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0adc03cd20 0x7f0adc03f110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:6800/944475972,v1:172.21.15.17:6801/944475972] conn(0x7f0adc039260 0x7f0adc03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 --2- 172.21.15.17:0/1516301291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0af0107960 0x7f0af01060d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 >> 172.21.15.17:0/1516301291 conn(0x7f0af0101ce0 msgr2=0x7f0af0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 shutdown_connections 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:33.848+0000 7f0af794e640 1 -- 172.21.15.17:0/1516301291 wait complete. 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-09-16T00:53:34.818 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-09-16T00:53:35.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: mgrmap e11: x(active, since 1.00594s) 2024-09-16T00:53:35.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:34] ENGINE Bus STARTING 2024-09-16T00:53:35.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:35.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:34] ENGINE Serving on http://172.21.15.17:8765 2024-09-16T00:53:35.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:34] ENGINE Serving on https://172.21.15.17:7150 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:34] ENGINE Bus STARTED 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:34 smithi017 ceph-mon[31211]: [16/Sep/2024:00:53:34] ENGINE Error in HTTPServer.serve 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:53:35.056 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-16T00:53:35.057 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:53:36.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T00:53:36.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.276+0000 7f8d55932640 1 Processor -- start 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.276+0000 7f8d55932640 1 -- start start 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d55932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d55932640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5007c830 con 0x7f8d5007dd80 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55008/0 (socket says 172.21.15.17:55008) 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d4effd640 1 -- 172.21.15.17:0/2132888657 learned_addr learned my addr 172.21.15.17:0/2132888657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.277+0000 7f8d4effd640 1 -- 172.21.15.17:0/2132888657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5007c9b0 con 0x7f8d5007dd80 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.278+0000 7f8d4effd640 1 --2- 172.21.15.17:0/2132888657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009820 tx=0x7f8d4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a8478fb3462934 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.278+0000 7f8d4dffb640 1 -- 172.21.15.17:0/2132888657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d48037070 con 0x7f8d5007dd80 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.278+0000 7f8d4dffb640 1 -- 172.21.15.17:0/2132888657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d480328f0 con 0x7f8d5007dd80 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.278+0000 7f8d4dffb640 1 -- 172.21.15.17:0/2132888657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d48030740 con 0x7f8d5007dd80 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 -- 172.21.15.17:0/2132888657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 msgr2=0x7f8d5007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 --2- 172.21.15.17:0/2132888657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009820 tx=0x7f8d4802a270 comp rx=0 tx=0).stop 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 -- 172.21.15.17:0/2132888657 shutdown_connections 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 --2- 172.21.15.17:0/2132888657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5007c2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 -- 172.21.15.17:0/2132888657 >> 172.21.15.17:0/2132888657 conn(0x7f8d50102f00 msgr2=0x7f8d50105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 -- 172.21.15.17:0/2132888657 shutdown_connections 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 -- 172.21.15.17:0/2132888657 wait complete. 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.279+0000 7f8d55932640 1 Processor -- start 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d55932640 1 -- start start 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d55932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d55932640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5010db70 con 0x7f8d5007dd80 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55018/0 (socket says 172.21.15.17:55018) 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d4effd640 1 -- 172.21.15.17:0/644550479 learned_addr learned my addr 172.21.15.17:0/644550479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:36.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d4effd640 1 -- 172.21.15.17:0/644550479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5019dcc0 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d4effd640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d480097f0 tx=0x7f8d48030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.280+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d48042070 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.281+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d48030d80 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.281+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d48037040 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.281+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5019df50 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.281+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d501a0c40 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.281+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8d48045070 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.282+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5007c370 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.282+0000 7f8d54930640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 0x7f8d3c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.282+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8d4806c580 con 0x7f8d5007dd80 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.282+0000 7f8d4e7fc640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 0x7f8d3c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.282+0000 7f8d4e7fc640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 0x7f8d3c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098c0 tx=0x7f8d38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.287+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d4803add0 con 0x7f8d5007dd80 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.469+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f8d501041c0 con 0x7f8d3c039260 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.584+0000 7f8d54930640 1 -- 172.21.15.17:0/644550479 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f8d501041c0 con 0x7f8d3c039260 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 msgr2=0x7f8d3c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 0x7f8d3c03b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098c0 tx=0x7f8d38006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 msgr2=0x7f8d5019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d480097f0 tx=0x7f8d48030c70 comp rx=0 tx=0).stop 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 shutdown_connections 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8d3c039260 0x7f8d3c03b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 --2- 172.21.15.17:0/644550479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5007dd80 0x7f8d5019d780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.586+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 >> 172.21.15.17:0/644550479 conn(0x7f8d50102f00 msgr2=0x7f8d50103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.587+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 shutdown_connections 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:35.587+0000 7f8d55932640 1 -- 172.21.15.17:0/644550479 wait complete. 2024-09-16T00:53:36.170 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-09-16T00:53:36.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:36 smithi017 ceph-mon[31211]: mgrmap e12: x(active, since 2s) 2024-09-16T00:53:36.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:36 smithi017 ceph-mon[31211]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:36.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:36.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:36.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:37.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:37 smithi017 ceph-mon[31211]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:37.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:37 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$egPM2O.abtJbnISCd3p3fuQgAUmOb92SJ3m8.iKUOwvH5IupiSr4O", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726448017, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.588+0000 7f9139d08640 1 Processor -- start 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.588+0000 7f9139d08640 1 -- start start 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f9139d08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f9139d08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9134106f10 con 0x7f9134106540 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f91337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f91337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55028/0 (socket says 172.21.15.17:55028) 2024-09-16T00:53:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f91337fe640 1 -- 172.21.15.17:0/3251369231 learned_addr learned my addr 172.21.15.17:0/3251369231 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.589+0000 7f91337fe640 1 -- 172.21.15.17:0/3251369231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91341076f0 con 0x7f9134106540 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.590+0000 7f91337fe640 1 --2- 172.21.15.17:0/3251369231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9124009820 tx=0x7f912402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cb9f730977bf87 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.590+0000 7f91327fc640 1 -- 172.21.15.17:0/3251369231 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9124037070 con 0x7f9134106540 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.590+0000 7f91327fc640 1 -- 172.21.15.17:0/3251369231 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91240328f0 con 0x7f9134106540 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.590+0000 7f91327fc640 1 -- 172.21.15.17:0/3251369231 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9124030740 con 0x7f9134106540 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 -- 172.21.15.17:0/3251369231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 msgr2=0x7f9134106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 --2- 172.21.15.17:0/3251369231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9124009820 tx=0x7f912402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 -- 172.21.15.17:0/3251369231 shutdown_connections 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 --2- 172.21.15.17:0/3251369231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134106940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 -- 172.21.15.17:0/3251369231 >> 172.21.15.17:0/3251369231 conn(0x7f9134101d90 msgr2=0x7f91341041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 -- 172.21.15.17:0/3251369231 shutdown_connections 2024-09-16T00:53:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 -- 172.21.15.17:0/3251369231 wait complete. 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.591+0000 7f9139d08640 1 Processor -- start 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9139d08640 1 -- start start 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9139d08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9139d08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f913410aaa0 con 0x7f9134106540 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f91337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f91337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55034/0 (socket says 172.21.15.17:55034) 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f91337fe640 1 -- 172.21.15.17:0/162210531 learned_addr learned my addr 172.21.15.17:0/162210531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f91337fe640 1 -- 172.21.15.17:0/162210531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9134191c60 con 0x7f9134106540 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f91337fe640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91240097f0 tx=0x7f9124030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9124042070 con 0x7f9134106540 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9124030d80 con 0x7f9134106540 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913418fe50 con 0x7f9134106540 2024-09-16T00:53:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9124037040 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.592+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9134190390 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.593+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f9124045070 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.593+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91341069c0 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.594+0000 7f9130ff9640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 0x7f912003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.594+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f912406c400 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.594+0000 7f9132ffd640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 0x7f912003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.594+0000 7f9132ffd640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 0x7f912003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098c0 tx=0x7f911c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.599+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9124045360 con 0x7f9134106540 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:36.791+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9134190610 con 0x7f9120039260 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.040+0000 7f9130ff9640 1 -- 172.21.15.17:0/162210531 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f9134190610 con 0x7f9120039260 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 msgr2=0x7f912003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 0x7f912003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098c0 tx=0x7f911c006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 msgr2=0x7f9134191720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91240097f0 tx=0x7f9124030c70 comp rx=0 tx=0).stop 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 shutdown_connections 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9120039260 0x7f912003b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 --2- 172.21.15.17:0/162210531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9134106540 0x7f9134191720 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 >> 172.21.15.17:0/162210531 conn(0x7f9134101d90 msgr2=0x7f9134102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.042+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 shutdown_connections 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:37.043+0000 7f9139d08640 1 -- 172.21.15.17:0/162210531 wait complete. 2024-09-16T00:53:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-09-16T00:53:38.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:38 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3117686926' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.111+0000 7f7447456640 1 Processor -- start 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.111+0000 7f7447456640 1 -- start start 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.111+0000 7f7447456640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.111+0000 7f7447456640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f744007bd90 con 0x7f7440108170 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.112+0000 7f74451f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.112+0000 7f74451f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55038/0 (socket says 172.21.15.17:55038) 2024-09-16T00:53:39.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.112+0000 7f74451f2640 1 -- 172.21.15.17:0/1680144416 learned_addr learned my addr 172.21.15.17:0/1680144416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.112+0000 7f74451f2640 1 -- 172.21.15.17:0/1680144416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744010aaa0 con 0x7f7440108170 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f74451f2640 1 --2- 172.21.15.17:0/1680144416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f743c009820 tx=0x7f743c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a543a819649618ef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f7437fff640 1 -- 172.21.15.17:0/1680144416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c037070 con 0x7f7440108170 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f7437fff640 1 -- 172.21.15.17:0/1680144416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f743c0328f0 con 0x7f7440108170 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f7437fff640 1 -- 172.21.15.17:0/1680144416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c030740 con 0x7f7440108170 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f7447456640 1 -- 172.21.15.17:0/1680144416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 msgr2=0x7f744010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.113+0000 7f7447456640 1 --2- 172.21.15.17:0/1680144416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f743c009820 tx=0x7f743c02a270 comp rx=0 tx=0).stop 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- 172.21.15.17:0/1680144416 shutdown_connections 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 --2- 172.21.15.17:0/1680144416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744010a560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- 172.21.15.17:0/1680144416 >> 172.21.15.17:0/1680144416 conn(0x7f7440101cf0 msgr2=0x7f7440104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- 172.21.15.17:0/1680144416 shutdown_connections 2024-09-16T00:53:39.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- 172.21.15.17:0/1680144416 wait complete. 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 Processor -- start 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- start start 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.114+0000 7f7447456640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f744010ba00 con 0x7f7440108170 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74451f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74451f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55042/0 (socket says 172.21.15.17:55042) 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74451f2640 1 -- 172.21.15.17:0/3117686926 learned_addr learned my addr 172.21.15.17:0/3117686926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74451f2640 1 -- 172.21.15.17:0/3117686926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744019bab0 con 0x7f7440108170 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74451f2640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f743c030cc0 tx=0x7f743c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c042070 con 0x7f7440108170 2024-09-16T00:53:39.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f743c030e60 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744019bd40 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c037040 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.115+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744019ea30 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.116+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74401085d0 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.116+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f743c045070 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.117+0000 7f74367fc640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 0x7f742c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.117+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f743c06c3f0 con 0x7f7440108170 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.117+0000 7f74449f1640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 0x7f742c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:39.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.117+0000 7f74449f1640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 0x7f742c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74300098c0 tx=0x7f7430006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.121+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f743c02fd90 con 0x7f7440108170 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.301+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f744019ec00 con 0x7f7440108170 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.301+0000 7f74367fc640 1 -- 172.21.15.17:0/3117686926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f743c03d950 con 0x7f7440108170 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.303+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 msgr2=0x7f742c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.303+0000 7f7447456640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 0x7f742c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74300098c0 tx=0x7f7430006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.303+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 msgr2=0x7f744019b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.303+0000 7f7447456640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f743c030cc0 tx=0x7f743c030cf0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 shutdown_connections 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f742c039260 0x7f742c03b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 --2- 172.21.15.17:0/3117686926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7440108170 0x7f744019b570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 >> 172.21.15.17:0/3117686926 conn(0x7f7440101cf0 msgr2=0x7f74401028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:39.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 shutdown_connections 2024-09-16T00:53:39.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:38.304+0000 7f7447456640 1 -- 172.21.15.17:0/3117686926 wait complete. 2024-09-16T00:53:39.268 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:53:39.268 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-16T00:53:39.276 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:53:39.276 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-16T00:53:39.276 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-16T00:53:39.276 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: Password: cosogaiuox 2024-09-16T00:53:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:39.279 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config directory 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.700+0000 7f0a7ad37640 1 Processor -- start 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.700+0000 7f0a7ad37640 1 -- start start 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a7ad37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a7ad37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74106ea0 con 0x7f0a741064d0 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a78ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a78ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55050/0 (socket says 172.21.15.17:55050) 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a78ad3640 1 -- 172.21.15.17:0/1767119498 learned_addr learned my addr 172.21.15.17:0/1767119498 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.701+0000 7f0a78ad3640 1 -- 172.21.15.17:0/1767119498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74107680 con 0x7f0a741064d0 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.702+0000 7f0a78ad3640 1 --2- 172.21.15.17:0/1767119498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009820 tx=0x7f0a6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0793b298c7154a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.702+0000 7f0a737fe640 1 -- 172.21.15.17:0/1767119498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64037070 con 0x7f0a741064d0 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.702+0000 7f0a737fe640 1 -- 172.21.15.17:0/1767119498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a640328f0 con 0x7f0a741064d0 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.702+0000 7f0a737fe640 1 -- 172.21.15.17:0/1767119498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64030740 con 0x7f0a741064d0 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- 172.21.15.17:0/1767119498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 msgr2=0x7f0a741068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/1767119498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009820 tx=0x7f0a6402a270 comp rx=0 tx=0).stop 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- 172.21.15.17:0/1767119498 shutdown_connections 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/1767119498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741068d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- 172.21.15.17:0/1767119498 >> 172.21.15.17:0/1767119498 conn(0x7f0a74101ce0 msgr2=0x7f0a74104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- 172.21.15.17:0/1767119498 shutdown_connections 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- 172.21.15.17:0/1767119498 wait complete. 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 Processor -- start 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- start start 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a7ad37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7410aa30 con 0x7f0a741064d0 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.703+0000 7f0a78ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a78ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55064/0 (socket says 172.21.15.17:55064) 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a78ad3640 1 -- 172.21.15.17:0/139459449 learned_addr learned my addr 172.21.15.17:0/139459449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a78ad3640 1 -- 172.21.15.17:0/139459449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74191bf0 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a78ad3640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009940 tx=0x7f0a64030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64042070 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a64030e30 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7418fde0 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64037040 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.704+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a74190320 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.705+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0a64045070 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.705+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7410abb0 con 0x7f0a741064d0 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.705+0000 7f0a71ffb640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 0x7f0a5c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.705+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0a6406c4c0 con 0x7f0a741064d0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.705+0000 7f0a73fff640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 0x7f0a5c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.706+0000 7f0a73fff640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 0x7f0a5c03b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a680098c0 tx=0x7f0a68006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.710+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a6403b330 con 0x7f0a741064d0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.976+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f0a74106950 con 0x7f0a741064d0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.978+0000 7f0a71ffb640 1 -- 172.21.15.17:0/139459449 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f0a6403d950 con 0x7f0a741064d0 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 msgr2=0x7f0a5c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 0x7f0a5c03b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a680098c0 tx=0x7f0a68006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 msgr2=0x7f0a741916b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009940 tx=0x7f0a64030cc0 comp rx=0 tx=0).stop 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 shutdown_connections 2024-09-16T00:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0a5c039300 0x7f0a5c03b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 --2- 172.21.15.17:0/139459449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a741064d0 0x7f0a741916b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 >> 172.21.15.17:0/139459449 conn(0x7f0a74101ce0 msgr2=0x7f0a74102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 shutdown_connections 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-16T00:53:39.981+0000 7f0a7ad37640 1 -- 172.21.15.17:0/139459449 wait complete. 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T00:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-09-16T00:53:40.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:40 smithi017 ceph-mon[31211]: mgrmap e13: x(active, since 6s) 2024-09-16T00:53:40.507 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:40 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/139459449' entity='client.admin' 2024-09-16T00:53:40.523 INFO:tasks.cephadm:Fetching config... 2024-09-16T00:53:40.523 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:53:40.523 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T00:53:40.540 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T00:53:40.540 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:53:40.540 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T00:53:40.596 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T00:53:40.596 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:53:40.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-16T00:53:40.661 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T00:53:40.662 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:53:40.662 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T00:53:40.718 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T00:53:40.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:53:40.794 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:40.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:53:40.860 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:40.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:53:40.930 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxsYW4rKi0fhFJJ4bPo2aPSvOd93oXm5MqwSnaD0DRlMmc49bWuaMH9olxgx8UD/0i0Sdq646aJeNFKq6EXbYbifoqlmJrz3ZQWA38b4AcwvOTik9rD7HHzsvldUXW/gMXYkGMCyR9nrpcI/c+bzlxsFF9tuuOv17OECqrQq7pInz6PdDjLC5XnFl6cPUO1wI8KFfmZlaf0MaBvNWF+JjbmWOJ58mdGtGuE/v1xUE3gd2DlKLsxmt/s4sX0iVRNdtxYlgSDgJimMAc80pbUmjjDWMIBUXJ03zMhv/0Caa0mEEtcP7C/HEOEBKkbWwDuz9gjZSkyA+ZG7GgeEPrLXHhzcQKNPkL4wYMV94Is5GuZMosuRqzc1BgLPoBFe8m2J5OGTAprjerRwRY0X1NM46ExQBNMkRpf9ComQ8Ws9R1uSzCCaBAdZT7aQ5fXBYH6+oEThV3ER3aW11Qj2+obz1ODLjd1Wa9SBR86xsh3Bg4iaKp6+ulvNxNaknJUjELzvU= ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:53:40.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T00:53:41.198 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 -- 172.21.15.17:0/673125119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 msgr2=0x7f5868100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 --2- 172.21.15.17:0/673125119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5858009880 tx=0x7f585802a5d0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 -- 172.21.15.17:0/673125119 shutdown_connections 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 --2- 172.21.15.17:0/673125119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 -- 172.21.15.17:0/673125119 >> 172.21.15.17:0/673125119 conn(0x7f58680fbcd0 msgr2=0x7f58680fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 -- 172.21.15.17:0/673125119 shutdown_connections 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 -- 172.21.15.17:0/673125119 wait complete. 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.693+0000 7f586d7d0640 1 Processor -- start 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f586d7d0640 1 -- start start 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f586d7d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f586d7d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58681064a0 con 0x7f5868100540 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33616/0 (socket says 172.21.15.17:33616) 2024-09-16T00:53:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f5866ffd640 1 -- 172.21.15.17:0/1281394680 learned_addr learned my addr 172.21.15.17:0/1281394680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f5866ffd640 1 -- 172.21.15.17:0/1281394680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58681993d0 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f5866ffd640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ec0 tx=0x7f58580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.694+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585803f070 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5858003aa0 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5868199660 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5858035030 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586819c350 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5858042070 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.695+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5868106c20 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.696+0000 7f584ffff640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 0x7f585003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.696+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f585806d090 con 0x7f5868100540 2024-09-16T00:53:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.696+0000 7f58667fc640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 0x7f585003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.696+0000 7f58667fc640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 0x7f585003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f585c0098c0 tx=0x7f585c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.700+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5858040df0 con 0x7f5868100540 2024-09-16T00:53:41.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.877+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f586819c7a0 con 0x7f5868100540 2024-09-16T00:53:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.879+0000 7f584ffff640 1 -- 172.21.15.17:0/1281394680 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f5858049060 con 0x7f5868100540 2024-09-16T00:53:41.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 msgr2=0x7f585003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 0x7f585003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f585c0098c0 tx=0x7f585c006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 msgr2=0x7f5868198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ec0 tx=0x7f58580048f0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 shutdown_connections 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58500392a0 0x7f585003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 --2- 172.21.15.17:0/1281394680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5868100540 0x7f5868198e90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.881+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 >> 172.21.15.17:0/1281394680 conn(0x7f58680fbcd0 msgr2=0x7f58680fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.882+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 shutdown_connections 2024-09-16T00:53:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:41.882+0000 7f586d7d0640 1 -- 172.21.15.17:0/1281394680 wait complete. 2024-09-16T00:53:42.492 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T00:53:42.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T00:53:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:43.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:42 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1281394680' entity='client.admin' 2024-09-16T00:53:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 -- 172.21.15.17:0/3748738201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 msgr2=0x7feee0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 --2- 172.21.15.17:0/3748738201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feed0009880 tx=0x7feed002a5d0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 -- 172.21.15.17:0/3748738201 shutdown_connections 2024-09-16T00:53:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 --2- 172.21.15.17:0/3748738201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 -- 172.21.15.17:0/3748738201 >> 172.21.15.17:0/3748738201 conn(0x7feee00fbc80 msgr2=0x7feee00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 -- 172.21.15.17:0/3748738201 shutdown_connections 2024-09-16T00:53:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.404+0000 7feee4fac640 1 -- 172.21.15.17:0/3748738201 wait complete. 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feee4fac640 1 Processor -- start 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feee4fac640 1 -- start start 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feee4fac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feee4fac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feee01064d0 con 0x7feee0100510 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feede59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feede59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33626/0 (socket says 172.21.15.17:33626) 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feede59c640 1 -- 172.21.15.17:0/4036787563 learned_addr learned my addr 172.21.15.17:0/4036787563 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feede59c640 1 -- 172.21.15.17:0/4036787563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01971f0 con 0x7feee0100510 2024-09-16T00:53:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.405+0000 7feede59c640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feed0009230 tx=0x7feed00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed003f070 con 0x7feee0100510 2024-09-16T00:53:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feed0003aa0 con 0x7feee0100510 2024-09-16T00:53:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee0197480 con 0x7feee0100510 2024-09-16T00:53:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed0035030 con 0x7feee0100510 2024-09-16T00:53:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee019a170 con 0x7feee0100510 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.406+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7feed0042070 con 0x7feee0100510 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.407+0000 7feed77fe640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 0x7feecc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.407+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee0106c50 con 0x7feee0100510 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.407+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feed006d240 con 0x7feee0100510 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.407+0000 7feed7fff640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 0x7feecc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.407+0000 7feed7fff640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 0x7feecc03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feec80098c0 tx=0x7feec8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.412+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feed0042360 con 0x7feee0100510 2024-09-16T00:53:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.593+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7feee002d8c0 con 0x7feecc039300 2024-09-16T00:53:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.597+0000 7feed77fe640 1 -- 172.21.15.17:0/4036787563 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feee002d8c0 con 0x7feecc039300 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 msgr2=0x7feecc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 0x7feecc03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feec80098c0 tx=0x7feec8006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 msgr2=0x7feee0196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feed0009230 tx=0x7feed00048f0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 shutdown_connections 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feecc039300 0x7feecc03b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 --2- 172.21.15.17:0/4036787563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee0100510 0x7feee0196cb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.599+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 >> 172.21.15.17:0/4036787563 conn(0x7feee00fbc80 msgr2=0x7feee006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.600+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 shutdown_connections 2024-09-16T00:53:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:43.600+0000 7feee4fac640 1 -- 172.21.15.17:0/4036787563 wait complete. 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:44.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:44.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:44.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T00:53:44.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:43 smithi017 ceph-mon[31211]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:53:44.431 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi088 2024-09-16T00:53:44.431 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:53:44.431 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/etc/ceph/ceph.conf 2024-09-16T00:53:44.451 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:53:44.451 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:53:44.509 INFO:tasks.cephadm:Adding host smithi088 to orchestrator... 2024-09-16T00:53:44.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch host add smithi088 2024-09-16T00:53:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:45.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 -- 172.21.15.17:0/778373768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 msgr2=0x7f21d4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 --2- 172.21.15.17:0/778373768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009880 tx=0x7f21c402a5d0 comp rx=0 tx=0).stop 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 -- 172.21.15.17:0/778373768 shutdown_connections 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 --2- 172.21.15.17:0/778373768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 -- 172.21.15.17:0/778373768 >> 172.21.15.17:0/778373768 conn(0x7f21d40fc130 msgr2=0x7f21d40fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 -- 172.21.15.17:0/778373768 shutdown_connections 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.192+0000 7f21dabac640 1 -- 172.21.15.17:0/778373768 wait complete. 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.193+0000 7f21dabac640 1 Processor -- start 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.193+0000 7f21dabac640 1 -- start start 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.193+0000 7f21dabac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.193+0000 7f21dabac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21d410aa20 con 0x7f21d4106540 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d8948640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:45.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d8948640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33656/0 (socket says 172.21.15.17:33656) 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d8948640 1 -- 172.21.15.17:0/4264744151 learned_addr learned my addr 172.21.15.17:0/4264744151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d8948640 1 -- 172.21.15.17:0/4264744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d41964d0 con 0x7f21d4106540 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d8948640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009230 tx=0x7f21c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21c4035070 con 0x7f21d4106540 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d4196760 con 0x7f21d4106540 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21c4003aa0 con 0x7f21d4106540 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.194+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21c40388a0 con 0x7f21d4106540 2024-09-16T00:53:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.195+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d4196bc0 con 0x7f21d4106540 2024-09-16T00:53:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.195+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f21c4038b70 con 0x7f21d4106540 2024-09-16T00:53:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.195+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d4101bb0 con 0x7f21d4106540 2024-09-16T00:53:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.196+0000 7f21d1ffb640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 0x7f21bc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.196+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f21c403e070 con 0x7f21d4106540 2024-09-16T00:53:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.196+0000 7f21d3fff640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 0x7f21bc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:45.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.196+0000 7f21d3fff640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 0x7f21bc03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098c0 tx=0x7f21c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:45.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.200+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21c4049340 con 0x7f21d4106540 2024-09-16T00:53:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:45.378+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi088", "target": ["mon-mgr", ""]}) -- 0x7f21d4197360 con 0x7f21bc0392a0 2024-09-16T00:53:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:45 smithi017 ceph-mon[31211]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:53:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:45 smithi017 ceph-mon[31211]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:53:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:45 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:45.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:45 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:45.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:45 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:46 smithi017 ceph-mon[31211]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:47 smithi017 ceph-mon[31211]: Deploying cephadm binary to smithi088 2024-09-16T00:53:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.253+0000 7f21d1ffb640 1 -- 172.21.15.17:0/4264744151 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f21d4197360 con 0x7f21bc0392a0 2024-09-16T00:53:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi088' with addr '172.21.15.88' 2024-09-16T00:53:49.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 msgr2=0x7f21bc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:49.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 0x7f21bc03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098c0 tx=0x7f21c8006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 msgr2=0x7f21d4195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009230 tx=0x7f21c40048f0 comp rx=0 tx=0).stop 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 shutdown_connections 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f21bc0392a0 0x7f21bc03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 --2- 172.21.15.17:0/4264744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d4106540 0x7f21d4195f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.255+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 >> 172.21.15.17:0/4264744151 conn(0x7f21d40fc130 msgr2=0x7f21d40fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.256+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 shutdown_connections 2024-09-16T00:53:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:49.256+0000 7f21dabac640 1 -- 172.21.15.17:0/4264744151 wait complete. 2024-09-16T00:53:49.852 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T00:53:50.105 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:50.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:50.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:50 smithi017 ceph-mon[31211]: Added host smithi088 2024-09-16T00:53:50.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:50.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:50.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:50.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.517+0000 7f3e996a2640 1 -- 172.21.15.17:0/1756218837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 msgr2=0x7f3e94106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:50.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.517+0000 7f3e996a2640 1 --2- 172.21.15.17:0/1756218837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94106920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009c10 tx=0x7f3e8402aa10 comp rx=0 tx=0).stop 2024-09-16T00:53:50.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.517+0000 7f3e996a2640 1 -- 172.21.15.17:0/1756218837 shutdown_connections 2024-09-16T00:53:50.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.518+0000 7f3e996a2640 1 --2- 172.21.15.17:0/1756218837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94106920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.518+0000 7f3e996a2640 1 -- 172.21.15.17:0/1756218837 >> 172.21.15.17:0/1756218837 conn(0x7f3e94077310 msgr2=0x7f3e940fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.518+0000 7f3e996a2640 1 -- 172.21.15.17:0/1756218837 shutdown_connections 2024-09-16T00:53:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.518+0000 7f3e996a2640 1 -- 172.21.15.17:0/1756218837 wait complete. 2024-09-16T00:53:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.518+0000 7f3e996a2640 1 Processor -- start 2024-09-16T00:53:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e996a2640 1 -- start start 2024-09-16T00:53:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e996a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e996a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9410aa20 con 0x7f3e94106540 2024-09-16T00:53:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47072/0 (socket says 172.21.15.17:47072) 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e92ffd640 1 -- 172.21.15.17:0/903588585 learned_addr learned my addr 172.21.15.17:0/903588585 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e92ffd640 1 -- 172.21.15.17:0/903588585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e94198420 con 0x7f3e94106540 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.519+0000 7f3e92ffd640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e84005dd0 tx=0x7f3e8402f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.520+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e84034070 con 0x7f3e94106540 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.520+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e8402feb0 con 0x7f3e94106540 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.520+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e941986b0 con 0x7f3e94106540 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.520+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e84004360 con 0x7f3e94106540 2024-09-16T00:53:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.520+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e94198ab0 con 0x7f3e94106540 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3e84037020 con 0x7f3e94106540 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94101bb0 con 0x7f3e94106540 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e7bfff640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 0x7f3e7c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3e8406d270 con 0x7f3e94106540 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e927fc640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 0x7f3e7c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.521+0000 7f3e927fc640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 0x7f3e7c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e880098c0 tx=0x7f3e88006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.526+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e8403f070 con 0x7f3e94106540 2024-09-16T00:53:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.707+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e94069ca0 con 0x7f3e7c0392a0 2024-09-16T00:53:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.708+0000 7f3e7bfff640 1 -- 172.21.15.17:0/903588585 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f3e94069ca0 con 0x7f3e7c0392a0 2024-09-16T00:53:50.708 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:50.708 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}] 2024-09-16T00:53:50.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 msgr2=0x7f3e7c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 0x7f3e7c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e880098c0 tx=0x7f3e88006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 msgr2=0x7f3e94197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e84005dd0 tx=0x7f3e8402f980 comp rx=0 tx=0).stop 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 shutdown_connections 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f3e7c0392a0 0x7f3e7c03b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 --2- 172.21.15.17:0/903588585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e94106540 0x7f3e94197ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 >> 172.21.15.17:0/903588585 conn(0x7f3e94077310 msgr2=0x7f3e940fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 shutdown_connections 2024-09-16T00:53:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:50.710+0000 7f3e996a2640 1 -- 172.21.15.17:0/903588585 wait complete. 2024-09-16T00:53:51.345 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-16T00:53:51.363 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:53:51.363 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-16T00:53:51.382 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:53:51.382 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:53:51.441 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-16T00:53:51.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch host add smithi154 2024-09-16T00:53:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:51.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:51 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:51.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:51 smithi017 ceph-mon[31211]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 -- 172.21.15.17:0/607701227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 msgr2=0x7f35c8106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 --2- 172.21.15.17:0/607701227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c8106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009c10 tx=0x7f35c002aa10 comp rx=0 tx=0).stop 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 -- 172.21.15.17:0/607701227 shutdown_connections 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 --2- 172.21.15.17:0/607701227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c8106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 -- 172.21.15.17:0/607701227 >> 172.21.15.17:0/607701227 conn(0x7f35c8077310 msgr2=0x7f35c80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 -- 172.21.15.17:0/607701227 shutdown_connections 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 -- 172.21.15.17:0/607701227 wait complete. 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.130+0000 7f35cf072640 1 Processor -- start 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cf072640 1 -- start start 2024-09-16T00:53:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cf072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cf072640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810aa20 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cce0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cce0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47088/0 (socket says 172.21.15.17:47088) 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cce0e640 1 -- 172.21.15.17:0/3441949935 learned_addr learned my addr 172.21.15.17:0/3441949935 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cce0e640 1 -- 172.21.15.17:0/3441949935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c80ff370 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35cce0e640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009d30 tx=0x7f35c002f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.131+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c0034070 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.132+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35c0003970 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.132+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c80fd9c0 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.132+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c0004430 con 0x7f35c8106540 2024-09-16T00:53:52.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.132+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c80fddc0 con 0x7f35c8106540 2024-09-16T00:53:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f35c0037020 con 0x7f35c8106540 2024-09-16T00:53:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8101bb0 con 0x7f35c8106540 2024-09-16T00:53:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35c5ffb640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 0x7f35b003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f35c006d500 con 0x7f35c8106540 2024-09-16T00:53:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35c7fff640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 0x7f35b003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:52.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.133+0000 7f35c7fff640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 0x7f35b003b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0098c0 tx=0x7f35bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:52.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.138+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35c003f070 con 0x7f35c8106540 2024-09-16T00:53:52.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:52.320+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) -- 0x7f35c80fe9b0 con 0x7f35b0039300 2024-09-16T00:53:53.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:52 smithi017 ceph-mon[31211]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:53:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: Deploying cephadm binary to smithi154 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:54.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:55.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:55 smithi017 ceph-mon[31211]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:53:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.349+0000 7f35c5ffb640 1 -- 172.21.15.17:0/3441949935 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f35c80fe9b0 con 0x7f35b0039300 2024-09-16T00:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-16T00:53:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 msgr2=0x7f35b003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 0x7f35b003b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0098c0 tx=0x7f35bc006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 msgr2=0x7f35c80fd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009d30 tx=0x7f35c002f980 comp rx=0 tx=0).stop 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 shutdown_connections 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f35b0039300 0x7f35b003b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 --2- 172.21.15.17:0/3441949935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35c8106540 0x7f35c80fd480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 >> 172.21.15.17:0/3441949935 conn(0x7f35c8077310 msgr2=0x7f35c80696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 shutdown_connections 2024-09-16T00:53:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:56.351+0000 7f35cf072640 1 -- 172.21.15.17:0/3441949935 wait complete. 2024-09-16T00:53:56.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:56 smithi017 ceph-mon[31211]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:56.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T00:53:57.215 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:57.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:57.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:57 smithi017 ceph-mon[31211]: Added host smithi154 2024-09-16T00:53:57.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:57.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:57.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 -- 172.21.15.17:0/3429235166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 msgr2=0x7f45a0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 --2- 172.21.15.17:0/3429235166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a0102b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4590009880 tx=0x7f459002a670 comp rx=0 tx=0).stop 2024-09-16T00:53:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 -- 172.21.15.17:0/3429235166 shutdown_connections 2024-09-16T00:53:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 --2- 172.21.15.17:0/3429235166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a0102b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 -- 172.21.15.17:0/3429235166 >> 172.21.15.17:0/3429235166 conn(0x7f45a00fc1b0 msgr2=0x7f45a00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 -- 172.21.15.17:0/3429235166 shutdown_connections 2024-09-16T00:53:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.677+0000 7f45a67e9640 1 -- 172.21.15.17:0/3429235166 wait complete. 2024-09-16T00:53:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.678+0000 7f45a67e9640 1 Processor -- start 2024-09-16T00:53:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.678+0000 7f45a67e9640 1 -- start start 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f45a67e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f45a67e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010bb70 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47114/0 (socket says 172.21.15.17:47114) 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459ffff640 1 -- 172.21.15.17:0/426771573 learned_addr learned my addr 172.21.15.17:0/426771573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459ffff640 1 -- 172.21.15.17:0/426771573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0197630 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459ffff640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4590009230 tx=0x7f45900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459003f070 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4590004d10 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a01978c0 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4590035030 con 0x7f45a0102750 2024-09-16T00:53:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.679+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a0197d20 con 0x7f45a0102750 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.680+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4590042070 con 0x7f45a0102750 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.680+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a006a7b0 con 0x7f45a0102750 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.680+0000 7f459dffb640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 0x7f458c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.681+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f459006d1b0 con 0x7f45a0102750 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.681+0000 7f4597fff640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 0x7f458c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.681+0000 7f4597fff640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 0x7f458c03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45880098c0 tx=0x7f4588006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.685+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4590039350 con 0x7f45a0102750 2024-09-16T00:53:57.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.879+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45a01984b0 con 0x7f458c039300 2024-09-16T00:53:57.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.880+0000 7f459dffb640 1 -- 172.21.15.17:0/426771573 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f45a01984b0 con 0x7f458c039300 2024-09-16T00:53:57.881 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:53:57.881 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-16T00:53:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 msgr2=0x7f458c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 0x7f458c03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f45880098c0 tx=0x7f4588006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 msgr2=0x7f45a01970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4590009230 tx=0x7f45900048f0 comp rx=0 tx=0).stop 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 shutdown_connections 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f458c039300 0x7f458c03b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 --2- 172.21.15.17:0/426771573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a0102750 0x7f45a01970f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 >> 172.21.15.17:0/426771573 conn(0x7f45a00fc1b0 msgr2=0x7f45a0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 shutdown_connections 2024-09-16T00:53:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:57.882+0000 7f45a67e9640 1 -- 172.21.15.17:0/426771573 wait complete. 2024-09-16T00:53:58.479 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T00:53:58.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T00:53:58.732 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:53:58.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:58 smithi017 ceph-mon[31211]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:53:58.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 -- 172.21.15.17:0/4103665180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 msgr2=0x7f19f8102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 --2- 172.21.15.17:0/4103665180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009880 tx=0x7f19e802a670 comp rx=0 tx=0).stop 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 -- 172.21.15.17:0/4103665180 shutdown_connections 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 --2- 172.21.15.17:0/4103665180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8102b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 -- 172.21.15.17:0/4103665180 >> 172.21.15.17:0/4103665180 conn(0x7f19f80fc1b0 msgr2=0x7f19f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 -- 172.21.15.17:0/4103665180 shutdown_connections 2024-09-16T00:53:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.192+0000 7f19fd08b640 1 -- 172.21.15.17:0/4103665180 wait complete. 2024-09-16T00:53:59.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.193+0000 7f19fd08b640 1 Processor -- start 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.193+0000 7f19fd08b640 1 -- start start 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.193+0000 7f19fd08b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.193+0000 7f19fd08b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810bb60 con 0x7f19f81027b0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47138/0 (socket says 172.21.15.17:47138) 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f6d9d640 1 -- 172.21.15.17:0/1008450694 learned_addr learned my addr 172.21.15.17:0/1008450694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f6d9d640 1 -- 172.21.15.17:0/1008450694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f8102300 con 0x7f19f81027b0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f6d9d640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009230 tx=0x7f19e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e803f070 con 0x7f19f81027b0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f8100950 con 0x7f19f81027b0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19e8004d10 con 0x7f19f81027b0 2024-09-16T00:53:59.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e8035030 con 0x7f19f81027b0 2024-09-16T00:53:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.194+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f8100e10 con 0x7f19f81027b0 2024-09-16T00:53:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.195+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f19e8042070 con 0x7f19f81027b0 2024-09-16T00:53:59.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.195+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f806a750 con 0x7f19f81027b0 2024-09-16T00:53:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.195+0000 7f19f4d99640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 0x7f19e403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.195+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f19e806d220 con 0x7f19f81027b0 2024-09-16T00:53:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.195+0000 7f19effff640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 0x7f19e403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:59.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.196+0000 7f19effff640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 0x7f19e403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19e00098c0 tx=0x7f19e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.200+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19e8039350 con 0x7f19f81027b0 2024-09-16T00:53:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.380+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f19f8101940 con 0x7f19f81027b0 2024-09-16T00:53:59.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.703+0000 7f19f4d99640 1 -- 172.21.15.17:0/1008450694 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f19e802f300 con 0x7f19f81027b0 2024-09-16T00:53:59.704 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-16T00:53:59.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 msgr2=0x7f19e403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:59.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 0x7f19e403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19e00098c0 tx=0x7f19e0006db0 comp rx=0 tx=0).stop 2024-09-16T00:53:59.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 msgr2=0x7f19f8100410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:59.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009230 tx=0x7f19e80048f0 comp rx=0 tx=0).stop 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 shutdown_connections 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f19e40392a0 0x7f19e403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 --2- 172.21.15.17:0/1008450694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19f81027b0 0x7f19f8100410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 >> 172.21.15.17:0/1008450694 conn(0x7f19f80fc1b0 msgr2=0x7f19f8103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 shutdown_connections 2024-09-16T00:53:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:53:59.705+0000 7f19fd08b640 1 -- 172.21.15.17:0/1008450694 wait complete. 2024-09-16T00:54:00.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:59 smithi017 ceph-mon[31211]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:54:00.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:53:59 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1008450694' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T00:54:00.342 INFO:tasks.cephadm:Adding mon.a on smithi017 2024-09-16T00:54:00.342 INFO:tasks.cephadm:Adding mon.b on smithi088 2024-09-16T00:54:00.342 INFO:tasks.cephadm:Adding mon.c on smithi154 2024-09-16T00:54:00.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi088:172.21.15.88=b;smithi154:172.21.15.154=c' 2024-09-16T00:54:00.588 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:54:00.633 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:54:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- 172.21.15.154:0/3075753469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 msgr2=0x7fb9601019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 --2- 172.21.15.154:0/3075753469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb9601019e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009880 tx=0x7fb95c02a5d0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- 172.21.15.154:0/3075753469 shutdown_connections 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 --2- 172.21.15.154:0/3075753469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb9601019e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- 172.21.15.154:0/3075753469 >> 172.21.15.154:0/3075753469 conn(0x7fb9600fcd70 msgr2=0x7fb9600ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- 172.21.15.154:0/3075753469 shutdown_connections 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- 172.21.15.154:0/3075753469 wait complete. 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 Processor -- start 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- start start 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.100+0000 7fb967e34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601075a0 con 0x7fb9601015e0 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.101+0000 7fb965bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.101+0000 7fb965bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.154:59866/0 (socket says 172.21.15.154:59866) 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.101+0000 7fb965bd0640 1 -- 172.21.15.154:0/3060218969 learned_addr learned my addr 172.21.15.154:0/3060218969 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.101+0000 7fb965bd0640 1 -- 172.21.15.154:0/3060218969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9601971f0 con 0x7fb9601015e0 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.101+0000 7fb965bd0640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009230 tx=0x7fb95c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.102+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb95c03f070 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.102+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb95c003aa0 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.102+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb960197480 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.102+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb95c035030 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.102+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96019a170 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.103+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb95c042070 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.103+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb960107d20 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.103+0000 7fb956ffd640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 0x7fb94c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.103+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb95c06d240 con 0x7fb9601015e0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.103+0000 7fb9653cf640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 0x7fb94c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.104+0000 7fb9653cf640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 0x7fb94c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9500098c0 tx=0x7fb950006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.108+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb95c039350 con 0x7fb9601015e0 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1008450694' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:01.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.311+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi088:172.21.15.88=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}) -- 0x7fb96002d8f0 con 0x7fb94c0392a0 2024-09-16T00:54:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.317+0000 7fb956ffd640 1 -- 172.21.15.154:0/3060218969 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb96002d8f0 con 0x7fb94c0392a0 2024-09-16T00:54:01.317 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-09-16T00:54:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 msgr2=0x7fb94c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 0x7fb94c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9500098c0 tx=0x7fb950006db0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 msgr2=0x7fb960196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009230 tx=0x7fb95c0048f0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 shutdown_connections 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb94c0392a0 0x7fb94c03b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 --2- 172.21.15.154:0/3060218969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015e0 0x7fb960196cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 >> 172.21.15.154:0/3060218969 conn(0x7fb9600fcd70 msgr2=0x7fb9600fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 shutdown_connections 2024-09-16T00:54:01.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:01.319+0000 7fb967e34640 1 -- 172.21.15.154:0/3060218969 wait complete. 2024-09-16T00:54:01.874 DEBUG:teuthology.orchestra.run.smithi088:mon.b> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.b.service 2024-09-16T00:54:01.877 DEBUG:teuthology.orchestra.run.smithi154:mon.c> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.c.service 2024-09-16T00:54:01.880 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:54:01.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:02.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:02.846 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi088:172.21.15.88=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi088:172.21.15.88=b;smithi154:172.21.15.154=c;count:3 2024-09-16T00:54:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:02 smithi017 ceph-mon[31211]: Deploying daemon mon.c on smithi154 2024-09-16T00:54:03.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- 172.21.15.154:0/4289566451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 msgr2=0x7f6d54106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:03.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 --2- 172.21.15.154:0/4289566451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009880 tx=0x7f6d5002a5d0 comp rx=0 tx=0).stop 2024-09-16T00:54:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- 172.21.15.154:0/4289566451 shutdown_connections 2024-09-16T00:54:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 --2- 172.21.15.154:0/4289566451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- 172.21.15.154:0/4289566451 >> 172.21.15.154:0/4289566451 conn(0x7f6d540fc130 msgr2=0x7f6d540fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- 172.21.15.154:0/4289566451 shutdown_connections 2024-09-16T00:54:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- 172.21.15.154:0/4289566451 wait complete. 2024-09-16T00:54:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 Processor -- start 2024-09-16T00:54:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.821+0000 7f6d5c723640 1 -- start start 2024-09-16T00:54:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5c723640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5c723640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5410aa20 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5a4bf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5a4bf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.154:59882/0 (socket says 172.21.15.154:59882) 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5a4bf640 1 -- 172.21.15.154:0/863259013 learned_addr learned my addr 172.21.15.154:0/863259013 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.822+0000 7f6d5a4bf640 1 -- 172.21.15.154:0/863259013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d54198440 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d5a4bf640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009230 tx=0x7f6d500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d5003f070 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d541986d0 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d50004d10 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d50035030 con 0x7f6d54106540 2024-09-16T00:54:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.823+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d54198b30 con 0x7f6d54106540 2024-09-16T00:54:03.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.824+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6d50042070 con 0x7f6d54106540 2024-09-16T00:54:03.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.824+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d54101bb0 con 0x7f6d54106540 2024-09-16T00:54:03.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.824+0000 7f6d477fe640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 0x7f6d4003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:03.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.824+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6d5006d080 con 0x7f6d54106540 2024-09-16T00:54:03.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.824+0000 7f6d59cbe640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 0x7f6d4003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:03.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.825+0000 7f6d59cbe640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 0x7f6d4003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:03.829+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d50042360 con 0x7f6d54106540 2024-09-16T00:54:04.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.062+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6d541069a0 con 0x7f6d54106540 2024-09-16T00:54:04.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.062+0000 7f6d477fe640 1 -- 172.21.15.154:0/863259013 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f6d5002fdc0 con 0x7f6d54106540 2024-09-16T00:54:04.063 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:54:04.063 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:52:44.041107Z","created":"2024-09-16T00:52:44.041107Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:54:04.063 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.064+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 msgr2=0x7f6d4003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.064+0000 7f6d5c723640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 0x7f6d4003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).stop 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.064+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 msgr2=0x7f6d54197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.064+0000 7f6d5c723640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009230 tx=0x7f6d500048f0 comp rx=0 tx=0).stop 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 shutdown_connections 2024-09-16T00:54:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6d400392a0 0x7f6d4003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 --2- 172.21.15.154:0/863259013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d54106540 0x7f6d54197f00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 >> 172.21.15.154:0/863259013 conn(0x7f6d540fc130 msgr2=0x7f6d540fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 shutdown_connections 2024-09-16T00:54:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:04.065+0000 7f6d5c723640 1 -- 172.21.15.154:0/863259013 wait complete. 2024-09-16T00:54:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:04 smithi017 ceph-mon[31211]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:04 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/863259013' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:06.005 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:54:06.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:54:06.260 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:11.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 -- 172.21.15.154:0/1378706789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f4003530 msgr2=0x7fb7f40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 --2- 172.21.15.154:0/1378706789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f4003530 0x7fb7f40059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb80c102b00 tx=0x7fb7fc02c490 comp rx=0 tx=0).stop 2024-09-16T00:54:11.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 -- 172.21.15.154:0/1378706789 shutdown_connections 2024-09-16T00:54:11.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 --2- 172.21.15.154:0/1378706789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f4003530 0x7fb7f40059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 -- 172.21.15.154:0/1378706789 >> 172.21.15.154:0/1378706789 conn(0x7fb80c0fd330 msgr2=0x7fb80c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 -- 172.21.15.154:0/1378706789 shutdown_connections 2024-09-16T00:54:11.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.083+0000 7fb8111f1640 1 -- 172.21.15.154:0/1378706789 wait complete. 2024-09-16T00:54:11.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 Processor -- start 2024-09-16T00:54:11.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 -- start start 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 0x7fb80c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c109640 con 0x7fb80c197730 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb8111f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c1094c0 con 0x7fb7f4003530 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.085+0000 7fb80ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56800/0 (socket says 172.21.15.154:56800) 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 -- 172.21.15.154:0/7761115 learned_addr learned my addr 172.21.15.154:0/7761115 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:11.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80a59c640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 0x7fb80c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 -- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 msgr2=0x7fb80c1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 -- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 msgr2=0x7fb80c1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80ad9d640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80a59c640 1 -- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 msgr2=0x7fb80c1971f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80a59c640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80a59c640 1 -- 172.21.15.154:0/7761115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c197d50 con 0x7fb80c197730 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.086+0000 7fb80a59c640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 0x7fb80c19bac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b3d0 tx=0x7fb80000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.087+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb800011630 con 0x7fb80c197730 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.087+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb800011c80 con 0x7fb80c197730 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.087+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb800010d80 con 0x7fb80c197730 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.087+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c19c000 con 0x7fb80c197730 2024-09-16T00:54:11.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.087+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c19c540 con 0x7fb80c197730 2024-09-16T00:54:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.088+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb800018020 con 0x7fb80c197730 2024-09-16T00:54:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.088+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80c102db0 con 0x7fb80c197730 2024-09-16T00:54:11.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.088+0000 7fb7f3fff640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 0x7fb7f803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.088+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb80004c1b0 con 0x7fb80c197730 2024-09-16T00:54:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.089+0000 7fb80ad9d640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 0x7fb7f803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.089+0000 7fb80ad9d640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 0x7fb7f803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc012c10 tx=0x7fb7fc0323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.093+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb80001f020 con 0x7fb80c197730 2024-09-16T00:54:11.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.333+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb80c19c880 con 0x7fb80c197730 2024-09-16T00:54:11.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.334+0000 7fb7f3fff640 1 -- 172.21.15.154:0/7761115 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fb800010510 con 0x7fb80c197730 2024-09-16T00:54:11.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:54:11.336 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:54:05.944479Z","created":"2024-09-16T00:52:44.041107Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:54:11.336 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 msgr2=0x7fb7f803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 0x7fb7f803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc012c10 tx=0x7fb7fc0323a0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 msgr2=0x7fb80c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 0x7fb80c19bac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb80000b3d0 tx=0x7fb80000b890 comp rx=0 tx=0).stop 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 shutdown_connections 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7f8039090 0x7fb7f803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb80c197730 0x7fb80c19bac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 --2- 172.21.15.154:0/7761115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f4003530 0x7fb80c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 >> 172.21.15.154:0/7761115 conn(0x7fb80c0fd330 msgr2=0x7fb80c105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 shutdown_connections 2024-09-16T00:54:11.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:11.336+0000 7fb8111f1640 1 -- 172.21.15.154:0/7761115 wait complete. 2024-09-16T00:54:11.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:11.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: mon.a calling monitor election 2024-09-16T00:54:11.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: mon.c calling monitor election 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: monmap epoch 2 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: last_changed 2024-09-16T00:54:05.944479+0000 2024-09-16T00:54:11.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: election_strategy: 1 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: fsmap 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: mgrmap e13: x(active, since 38s) 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: overall HEALTH_OK 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:11.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:12.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:12.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:12 smithi017 ceph-mon[31211]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:12.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:12 smithi017 ceph-mon[31211]: Deploying daemon mon.b on smithi088 2024-09-16T00:54:12.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:12 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/7761115' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:12.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:12.857 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:54:12.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:54:13.113 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.518+0000 7fba49db9640 1 -- 172.21.15.154:0/1299026083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 msgr2=0x7fba44106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.518+0000 7fba49db9640 1 --2- 172.21.15.154:0/1299026083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba44106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba34009880 tx=0x7fba3402a5d0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 -- 172.21.15.154:0/1299026083 shutdown_connections 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 --2- 172.21.15.154:0/1299026083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba44106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 -- 172.21.15.154:0/1299026083 >> 172.21.15.154:0/1299026083 conn(0x7fba440fc220 msgr2=0x7fba440fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 -- 172.21.15.154:0/1299026083 shutdown_connections 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 -- 172.21.15.154:0/1299026083 wait complete. 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 Processor -- start 2024-09-16T00:54:13.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.519+0000 7fba49db9640 1 -- start start 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba49db9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba49db9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba49db9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410ab10 con 0x7fba44106630 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba49db9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410a990 con 0x7fba440fcc10 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.154:39982/0 (socket says 172.21.15.154:39982) 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56816/0 (socket says 172.21.15.154:56816) 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 -- 172.21.15.154:0/3593402503 learned_addr learned my addr 172.21.15.154:0/3593402503 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 -- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 msgr2=0x7fba440fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 -- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 msgr2=0x7fba440fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:54:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba42ffd640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 -- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 msgr2=0x7fba440fd070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 -- 172.21.15.154:0/3593402503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440fe5c0 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba437fe640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba34004f10 tx=0x7fba34005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba34035030 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba34005360 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.520+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba441a3430 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.521+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba34031900 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.521+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba441a3960 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.522+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fba34042070 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.522+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba44101ca0 con 0x7fba44106630 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.522+0000 7fba40ff9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 0x7fba2c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:13.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.522+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba3406d100 con 0x7fba44106630 2024-09-16T00:54:13.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.522+0000 7fba42ffd640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 0x7fba2c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:13.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.523+0000 7fba42ffd640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 0x7fba2c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba38006fd0 tx=0x7fba38008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.527+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba34005510 con 0x7fba44106630 2024-09-16T00:54:13.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.754+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fba441a3c10 con 0x7fba44106630 2024-09-16T00:54:13.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.755+0000 7fba40ff9640 1 -- 172.21.15.154:0/3593402503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fba34039350 con 0x7fba44106630 2024-09-16T00:54:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:54:13.756 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:54:05.944479Z","created":"2024-09-16T00:52:44.041107Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:54:13.756 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 msgr2=0x7fba2c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 0x7fba2c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba38006fd0 tx=0x7fba38008040 comp rx=0 tx=0).stop 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 msgr2=0x7fba440fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fba34004f10 tx=0x7fba34005e50 comp rx=0 tx=0).stop 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 shutdown_connections 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fba2c039040 0x7fba2c03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba440fcc10 0x7fba440fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 --2- 172.21.15.154:0/3593402503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44106630 0x7fba440fc6d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 >> 172.21.15.154:0/3593402503 conn(0x7fba440fc220 msgr2=0x7fba44104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 shutdown_connections 2024-09-16T00:54:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:13.757+0000 7fba49db9640 1 -- 172.21.15.154:0/3593402503 wait complete. 2024-09-16T00:54:14.310 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:14 smithi154 ceph-mon[34759]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:14.310 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:14 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3593402503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:14.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:14 smithi017 ceph-mon[31211]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:14.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:14 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3593402503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:14.811 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:14 smithi088 ceph-mon[34093]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-16T00:54:14.811 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:14 smithi088 bash[34074]: 410fd8b94557f516491fc50387ad4f3bf0b60934feb07afbcc912356b820fb36 2024-09-16T00:54:15.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:14 smithi088 systemd[1]: Started Ceph mon.b for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:54:15.339 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T00:54:15.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:54:15.592 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: mon.a calling monitor election 2024-09-16T00:54:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: mon.c calling monitor election 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: mon.b calling monitor election 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:54:20.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: monmap epoch 3 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: last_changed 2024-09-16T00:54:14.791656+0000 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: min_mon_release 19 (squid) 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: election_strategy: 1 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: 2: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.b 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: fsmap 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: mgrmap e13: x(active, since 46s) 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: overall HEALTH_OK 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.146 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: mon.a calling monitor election 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: mon.c calling monitor election 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: mon.b calling monitor election 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: monmap epoch 3 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: last_changed 2024-09-16T00:54:14.791656+0000 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: min_mon_release 19 (squid) 2024-09-16T00:54:20.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: election_strategy: 1 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: 2: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.b 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: fsmap 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: mgrmap e13: x(active, since 46s) 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: overall HEALTH_OK 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:54:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: mon.a calling monitor election 2024-09-16T00:54:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: mon.c calling monitor election 2024-09-16T00:54:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: mon.b calling monitor election 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: monmap epoch 3 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: last_changed 2024-09-16T00:54:14.791656+0000 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: created 2024-09-16T00:52:44.041107+0000 2024-09-16T00:54:20.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: election_strategy: 1 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: 2: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.b 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: fsmap 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: mgrmap e13: x(active, since 46s) 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: overall HEALTH_OK 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:20.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 -- 172.21.15.154:0/3814698985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 msgr2=0x7f32e80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 --2- 172.21.15.154:0/3814698985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f32e80059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f330006aa60 tx=0x7f32f002c490 comp rx=0 tx=0).stop 2024-09-16T00:54:20.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 -- 172.21.15.154:0/3814698985 shutdown_connections 2024-09-16T00:54:20.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 --2- 172.21.15.154:0/3814698985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f32e80059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 -- 172.21.15.154:0/3814698985 >> 172.21.15.154:0/3814698985 conn(0x7f33000fc220 msgr2=0x7f33000fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:20.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 -- 172.21.15.154:0/3814698985 shutdown_connections 2024-09-16T00:54:20.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.412+0000 7f3305f1c640 1 -- 172.21.15.154:0/3814698985 wait complete. 2024-09-16T00:54:20.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 Processor -- start 2024-09-16T00:54:20.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 -- start start 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f330019dcb0 0x7f330019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f330010fbe0 con 0x7f32e8003530 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f330010fa60 con 0x7f330019dcb0 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.413+0000 7f3305f1c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f330010fd60 con 0x7f33001a3be0 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.154:46020/0 (socket says 172.21.15.154:46020) 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 -- 172.21.15.154:0/2944576453 learned_addr learned my addr 172.21.15.154:0/2944576453 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32feffd640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32feffd640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 msgr2=0x7f330019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:54:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32feffd640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 msgr2=0x7f330019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32feffd640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32feffd640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32fffff640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f330019dcb0 0x7f330019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 msgr2=0x7f330019d770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f330019dcb0 msgr2=0x7f330019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f330019dcb0 0x7f330019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 -- 172.21.15.154:0/2944576453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33001aa450 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32ff7fe640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32f002ca00 tx=0x7f32f0033a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0040020 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33001aa680 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f32f003c410 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.414+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0038040 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.415+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001aab90 con 0x7f32e8003530 2024-09-16T00:54:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.415+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f32f0043020 con 0x7f32e8003530 2024-09-16T00:54:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.416+0000 7f32fcff9640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 0x7f32ec03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.416+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330006ad10 con 0x7f32e8003530 2024-09-16T00:54:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.416+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f32f006e930 con 0x7f32e8003530 2024-09-16T00:54:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.416+0000 7f32feffd640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 0x7f32ec03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.416+0000 7f32feffd640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 0x7f32ec03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006fd0 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.421+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32f004a020 con 0x7f32e8003530 2024-09-16T00:54:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.666+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3300110cf0 con 0x7f32e8003530 2024-09-16T00:54:20.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.667+0000 7f32fcff9640 1 -- 172.21.15.154:0/2944576453 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f32f00422c0 con 0x7f32e8003530 2024-09-16T00:54:20.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:54:20.668 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","modified":"2024-09-16T00:54:14.791656Z","created":"2024-09-16T00:52:44.041107Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-16T00:54:20.668 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 3 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 msgr2=0x7f32ec03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 0x7f32ec03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006fd0 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 msgr2=0x7f33001a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32f002ca00 tx=0x7f32f0033a20 comp rx=0 tx=0).stop 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 shutdown_connections 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f32ec039730 0x7f32ec03bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f330019dcb0 0x7f330019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33001a3be0 0x7f330019d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 --2- 172.21.15.154:0/2944576453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e8003530 0x7f33001a36a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:20.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 >> 172.21.15.154:0/2944576453 conn(0x7f33000fc220 msgr2=0x7f3300104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:20.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 shutdown_connections 2024-09-16T00:54:20.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:20.669+0000 7f3305f1c640 1 -- 172.21.15.154:0/2944576453 wait complete. 2024-09-16T00:54:21.009 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:20 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/2944576453' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:21.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:20 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/2944576453' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:21.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:20 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/2944576453' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:54:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:54:21.706 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T00:54:21.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T00:54:21.997 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:21.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:21.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:22.000 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.000 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:21 smithi017 ceph-mon[31211]: Reconfiguring daemon mon.a on smithi017 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:21 smithi088 ceph-mon[34093]: Reconfiguring daemon mon.a on smithi017 2024-09-16T00:54:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:21 smithi154 ceph-mon[34759]: Reconfiguring daemon mon.a on smithi017 2024-09-16T00:54:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:54:23.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 -- 172.21.15.17:0/1857087809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc074590 msgr2=0x7f95fc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:23.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 --2- 172.21.15.17:0/1857087809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc074590 0x7f95fc074970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009900 tx=0x7f95f802a480 comp rx=0 tx=0).stop 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 -- 172.21.15.17:0/1857087809 shutdown_connections 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 --2- 172.21.15.17:0/1857087809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc112ba0 0x7f95fc114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 --2- 172.21.15.17:0/1857087809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074eb0 0x7f95fc112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 --2- 172.21.15.17:0/1857087809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc074590 0x7f95fc074970 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 -- 172.21.15.17:0/1857087809 >> 172.21.15.17:0/1857087809 conn(0x7f95fc0fd8f0 msgr2=0x7f95fc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 -- 172.21.15.17:0/1857087809 shutdown_connections 2024-09-16T00:54:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.780+0000 7f96045fd640 1 -- 172.21.15.17:0/1857087809 wait complete. 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 Processor -- start 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 -- start start 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 0x7f95fc1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc074eb0 0x7f95fc1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc118410 con 0x7f95fc112ba0 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc118290 con 0x7f95fc074590 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f96045fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc118590 con 0x7f95fc074eb0 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50126/0 (socket says 172.21.15.17:50126) 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602399640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 0x7f95fc1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9601b98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc074eb0 0x7f95fc1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 -- 172.21.15.17:0/1616416711 learned_addr learned my addr 172.21.15.17:0/1616416711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 -- 172.21.15.17:0/1616416711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc074eb0 msgr2=0x7f95fc1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc074eb0 0x7f95fc1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 -- 172.21.15.17:0/1616416711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 msgr2=0x7f95fc1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 0x7f95fc1a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602b9a640 1 -- 172.21.15.17:0/1616416711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc19efc0 con 0x7f95fc112ba0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.781+0000 7f9602399640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 0x7f95fc1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f9602b9a640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e9d0 tx=0x7f95f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f400cd80 con 0x7f95fc112ba0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95f4005020 con 0x7f95fc112ba0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc19f2b0 con 0x7f95fc112ba0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40116d0 con 0x7f95fc112ba0 2024-09-16T00:54:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.782+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc1ab500 con 0x7f95fc112ba0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.783+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f95f4011870 con 0x7f95fc112ba0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.783+0000 7f95f37fe640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 0x7f95e803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.783+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f95f404c850 con 0x7f95fc112ba0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.783+0000 7f9602399640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 0x7f95e803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.783+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc075cd0 con 0x7f95fc112ba0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.784+0000 7f9602399640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 0x7f95e803b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95f8031440 tx=0x7f95f8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.789+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95f4016030 con 0x7f95fc112ba0 2024-09-16T00:54:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.969+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f95fc19fdf0 con 0x7f95fc112ba0 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:23 smithi017 ceph-mon[31211]: Reconfiguring daemon mon.b on smithi088 2024-09-16T00:54:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.969+0000 7f95f37fe640 1 -- 172.21.15.17:0/1616416711 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f95f40071c0 con 0x7f95fc112ba0 2024-09-16T00:54:23.972 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:23.972 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-16T00:54:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T00:54:23.972 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-16T00:54:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 msgr2=0x7f95e803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 0x7f95e803b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95f8031440 tx=0x7f95f8005b50 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 msgr2=0x7f95fc19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e9d0 tx=0x7f95f400ee90 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 shutdown_connections 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f95e80394d0 0x7f95e803b990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95fc112ba0 0x7f95fc19e820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95fc074eb0 0x7f95fc1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 --2- 172.21.15.17:0/1616416711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95fc074590 0x7f95fc1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 >> 172.21.15.17:0/1616416711 conn(0x7f95fc0fd8f0 msgr2=0x7f95fc0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.971+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 shutdown_connections 2024-09-16T00:54:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:23.972+0000 7f96045fd640 1 -- 172.21.15.17:0/1616416711 wait complete. 2024-09-16T00:54:24.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:23 smithi088 ceph-mon[34093]: Reconfiguring daemon mon.b on smithi088 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: Reconfiguring mon.b (monmap changed)... 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:24.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:24.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:23 smithi154 ceph-mon[34759]: Reconfiguring daemon mon.b on smithi088 2024-09-16T00:54:24.622 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T00:54:24.622 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:54:24.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:54:24.652 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:54:24.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:54:24.718 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:54:24.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:54:24.747 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:54:24.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:54:24.813 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:54:24.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:54:24.841 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:54:24.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:54:24.907 INFO:tasks.cephadm:Adding mgr.x on smithi017 2024-09-16T00:54:24.907 INFO:tasks.cephadm:Adding mgr.y on smithi088 2024-09-16T00:54:24.907 INFO:tasks.cephadm:Adding mgr.z on smithi154 2024-09-16T00:54:24.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi017=x;smithi088=y;smithi154=z' 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1616416711' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.080 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:24 smithi154 ceph-mon[34759]: Reconfiguring daemon mon.c on smithi154 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1616416711' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:24 smithi088 ceph-mon[34093]: Reconfiguring daemon mon.c on smithi154 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1616416711' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: Reconfiguring mon.c (monmap changed)... 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:24 smithi017 ceph-mon[31211]: Reconfiguring daemon mon.c on smithi154 2024-09-16T00:54:25.718 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:54:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2824785478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c100b00 msgr2=0x7fdb7c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2824785478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c100b00 0x7fdb7c100f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c02a410 comp rx=0 tx=0).stop 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2824785478 shutdown_connections 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2824785478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 0x7fdb7c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2824785478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c101d00 0x7fdb7c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2824785478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c100b00 0x7fdb7c100f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2824785478 >> 172.21.15.154:0/2824785478 conn(0x7fdb7c0fc270 msgr2=0x7fdb7c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2824785478 shutdown_connections 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.144+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2824785478 wait complete. 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.145+0000 7fdb80ea7640 1 Processor -- start 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 -- start start 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c100b00 0x7fdb7c196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 0x7fdb7c19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c10c6e0 con 0x7fdb7c1026c0 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c10c560 con 0x7fdb7c100b00 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb80ea7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c10c860 con 0x7fdb7c101d00 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50612/0 (socket says 172.21.15.154:50612) 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 -- 172.21.15.154:0/2081394804 learned_addr learned my addr 172.21.15.154:0/2081394804 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb7a59c640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c100b00 0x7fdb7c196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb7ad9d640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 0x7fdb7c19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 -- 172.21.15.154:0/2081394804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c100b00 msgr2=0x7fdb7c196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c100b00 0x7fdb7c196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 -- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 msgr2=0x7fdb7c19e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 0x7fdb7c19e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 -- 172.21.15.154:0/2081394804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c19ea30 con 0x7fdb7c101d00 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.146+0000 7fdb71d9b640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400b4a0 tx=0x7fdb6400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.147+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64014070 con 0x7fdb7c101d00 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.147+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c19ed20 con 0x7fdb7c101d00 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.147+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb64010ac0 con 0x7fdb7c101d00 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.147+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64017c30 con 0x7fdb7c101d00 2024-09-16T00:54:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.147+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c19f280 con 0x7fdb7c101d00 2024-09-16T00:54:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdb64017070 con 0x7fdb7c101d00 2024-09-16T00:54:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c107f90 con 0x7fdb7c101d00 2024-09-16T00:54:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb73fff640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 0x7fdb6803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdb6404ba00 con 0x7fdb7c101d00 2024-09-16T00:54:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb7a59c640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 0x7fdb6803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:26.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.148+0000 7fdb7a59c640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 0x7fdb6803b9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0314e0 tx=0x7fdb6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:26.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.153+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb64020300 con 0x7fdb7c101d00 2024-09-16T00:54:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.331+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi088=y;smithi154=z", "target": ["mon-mgr", ""]}) -- 0x7fdb7c0626c0 con 0x7fdb68039500 2024-09-16T00:54:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.337+0000 7fdb73fff640 1 -- 172.21.15.154:0/2081394804 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdb7c0626c0 con 0x7fdb68039500 2024-09-16T00:54:26.338 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 msgr2=0x7fdb6803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 0x7fdb6803b9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0314e0 tx=0x7fdb6c005a20 comp rx=0 tx=0).stop 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 msgr2=0x7fdb7c197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400b4a0 tx=0x7fdb6400b960 comp rx=0 tx=0).stop 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 shutdown_connections 2024-09-16T00:54:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb68039500 0x7fdb6803b9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb7c1026c0 0x7fdb7c19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb7c101d00 0x7fdb7c197340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 --2- 172.21.15.154:0/2081394804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c100b00 0x7fdb7c196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.339+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 >> 172.21.15.154:0/2081394804 conn(0x7fdb7c0fc270 msgr2=0x7fdb7c105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.340+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 shutdown_connections 2024-09-16T00:54:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:54:26.340+0000 7fdb80ea7640 1 -- 172.21.15.154:0/2081394804 wait complete. 2024-09-16T00:54:26.928 DEBUG:teuthology.orchestra.run.smithi088:mgr.y> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.y.service 2024-09-16T00:54:26.930 DEBUG:teuthology.orchestra.run.smithi154:mgr.z> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.z.service 2024-09-16T00:54:26.933 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T00:54:26.933 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T00:54:26.933 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:26.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.952 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:54:26.952 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-16T00:54:26.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:26.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:26.954 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:26.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.955 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:26.956 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:26.957 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:26.957 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:26.957 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-16 00:53:41.376122806 +0000 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-16 00:49:42.532835919 +0000 2024-09-16T00:54:27.011 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-16 00:49:42.532835919 +0000 2024-09-16T00:54:27.012 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-16 00:49:42.532835919 +0000 2024-09-16T00:54:27.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:54:27.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-16T00:54:27.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-16T00:54:27.080 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000130112 s, 3.9 MB/s 2024-09-16T00:54:27.081 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:54:27.142 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-16 00:53:41.408122466 +0000 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-16 00:49:42.866832560 +0000 2024-09-16T00:54:27.202 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-16 00:49:42.866832560 +0000 2024-09-16T00:54:27.203 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-16 00:49:42.866832560 +0000 2024-09-16T00:54:27.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:54:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-16T00:54:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-16T00:54:27.270 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000125474 s, 4.1 MB/s 2024-09-16T00:54:27.271 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:54:27.329 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-16T00:54:27.387 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:54:27.387 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.387 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T00:54:27.387 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.388 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.388 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-16 00:53:41.442122105 +0000 2024-09-16T00:54:27.388 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-16 00:49:43.183829429 +0000 2024-09-16T00:54:27.388 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-16 00:49:43.183829429 +0000 2024-09-16T00:54:27.388 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-16 00:49:43.183829429 +0000 2024-09-16T00:54:27.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:54:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-16T00:54:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-16T00:54:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000116191 s, 4.4 MB/s 2024-09-16T00:54:27.456 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:54:27.513 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-16 00:53:41.477121734 +0000 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-16 00:49:43.497826327 +0000 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-16 00:49:43.497826327 +0000 2024-09-16T00:54:27.571 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-16 00:49:43.497826327 +0000 2024-09-16T00:54:27.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:54:27.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-16T00:54:27.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-16T00:54:27.636 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000116643 s, 4.4 MB/s 2024-09-16T00:54:27.637 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:54:27.697 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-16T00:54:27.697 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:54:27.716 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:54:27.717 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-09-16T00:54:27.774 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:54:27.774 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.774 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T00:54:27.774 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.775 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.775 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-16 00:54:14.291389092 +0000 2024-09-16T00:54:27.775 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-16 00:49:39.662918386 +0000 2024-09-16T00:54:27.775 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-16 00:49:39.662918386 +0000 2024-09-16T00:54:27.775 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-16 00:49:39.662918386 +0000 2024-09-16T00:54:27.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:54:27.841 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-16T00:54:27.841 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-16T00:54:27.841 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000225273 s, 2.3 MB/s 2024-09-16T00:54:27.842 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:54:27.900 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-09-16T00:54:27.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:27 smithi017 ceph-mon[31211]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi088=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:27.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:27 smithi017 ceph-mon[31211]: Saving service mgr spec with placement smithi017=x;smithi088=y;smithi154=z;count:3 2024-09-16T00:54:27.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:27 smithi017 ceph-mon[31211]: Deploying daemon mgr.z on smithi154 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-16 00:54:14.291389092 +0000 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-16 00:49:40.018910971 +0000 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-16 00:49:40.018910971 +0000 2024-09-16T00:54:27.957 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-16 00:49:40.018910971 +0000 2024-09-16T00:54:27.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:54:28.020 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:27 smithi088 ceph-mon[34093]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi088=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:28.020 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:27 smithi088 ceph-mon[34093]: Saving service mgr spec with placement smithi017=x;smithi088=y;smithi154=z;count:3 2024-09-16T00:54:28.020 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:27 smithi088 ceph-mon[34093]: Deploying daemon mgr.z on smithi154 2024-09-16T00:54:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-16T00:54:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-16T00:54:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000198142 s, 2.6 MB/s 2024-09-16T00:54:28.023 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:54:28.081 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-09-16T00:54:28.116 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:27 smithi154 ceph-mon[34759]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi088=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:28.116 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:27 smithi154 ceph-mon[34759]: Saving service mgr spec with placement smithi017=x;smithi088=y;smithi154=z;count:3 2024-09-16T00:54:28.116 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:27 smithi154 ceph-mon[34759]: Deploying daemon mgr.z on smithi154 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-16 00:54:14.292389071 +0000 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-16 00:49:40.344904181 +0000 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-16 00:49:40.344904181 +0000 2024-09-16T00:54:28.138 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-16 00:49:40.344904181 +0000 2024-09-16T00:54:28.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:54:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-16T00:54:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-16T00:54:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000239893 s, 2.1 MB/s 2024-09-16T00:54:28.204 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:54:28.261 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:28.317 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-16 00:54:14.292389071 +0000 2024-09-16T00:54:28.318 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-16 00:49:40.658897640 +0000 2024-09-16T00:54:28.318 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-16 00:49:40.658897640 +0000 2024-09-16T00:54:28.318 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-09-16 00:49:40.658897640 +0000 2024-09-16T00:54:28.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:54:28.381 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-16T00:54:28.381 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-16T00:54:28.381 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000256783 s, 2.0 MB/s 2024-09-16T00:54:28.383 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:54:28.440 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-16T00:54:28.440 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:54:28.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:54:28.456 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-16 00:54:28.505407898 +0000 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-16 00:49:39.664203770 +0000 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-16 00:49:39.664203770 +0000 2024-09-16T00:54:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-16 00:49:39.664203770 +0000 2024-09-16T00:54:28.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:54:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-16T00:54:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-16T00:54:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000213718 s, 2.4 MB/s 2024-09-16T00:54:28.580 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:54:28.637 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-16 00:54:28.505407898 +0000 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-16 00:49:40.000194890 +0000 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-16 00:49:40.000194890 +0000 2024-09-16T00:54:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-16 00:49:40.000194890 +0000 2024-09-16T00:54:28.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:54:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-16T00:54:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-16T00:54:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000185977 s, 2.8 MB/s 2024-09-16T00:54:28.760 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:54:28.817 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-16T00:54:28.872 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:54:28.872 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-16 00:54:28.506407871 +0000 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-16 00:49:40.347185720 +0000 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-16 00:49:40.347185720 +0000 2024-09-16T00:54:28.873 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-16 00:49:40.347185720 +0000 2024-09-16T00:54:28.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:54:28.971 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:28 smithi154 ceph-mon[34759]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:28.974 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-16T00:54:28.974 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-16T00:54:28.974 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000210696 s, 2.4 MB/s 2024-09-16T00:54:28.975 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:54:29.031 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-16 00:54:28.506407871 +0000 2024-09-16T00:54:29.087 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-16 00:49:40.681176893 +0000 2024-09-16T00:54:29.088 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-16 00:49:40.681176893 +0000 2024-09-16T00:54:29.088 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-16 00:49:40.681176893 +0000 2024-09-16T00:54:29.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:54:29.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:28 smithi088 ceph-mon[34093]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-16T00:54:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-16T00:54:29.156 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000183098 s, 2.8 MB/s 2024-09-16T00:54:29.157 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:54:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:28 smithi017 ceph-mon[31211]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:29.213 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-09-16T00:54:29.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:54:29.243 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.179+0000 7f52d4060040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:54:29.243 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.242+0000 7f52d4060040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:54:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:54:29.600 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.389+0000 7f52d4060040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:54:29.600 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.454+0000 7f52d4060040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:54:29.600 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.599+0000 7f52d4060040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:54:29.903 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:29.738+0000 7f52d4060040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:54:30.403 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:30.050+0000 7f52d4060040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:54:30.403 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:30.109+0000 7f52d4060040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:30.294+0000 7f52d4060040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:30.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:30.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:30 smithi154 ceph-mon[34759]: Deploying daemon mgr.y on smithi088 2024-09-16T00:54:30.484 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:30.485 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:30 smithi088 ceph-mon[34093]: Deploying daemon mgr.y on smithi088 2024-09-16T00:54:30.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:30.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:30.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:30.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:54:30.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:30.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:30.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:30 smithi017 ceph-mon[31211]: Deploying daemon mgr.y on smithi088 2024-09-16T00:54:31.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 podman[35472]: 2024-09-16 00:54:31.070903377 +0000 UTC m=+0.142395814 container create 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-16T00:54:31.425 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 podman[35472]: 2024-09-16 00:54:31.281737407 +0000 UTC m=+0.353229847 container init 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-16T00:54:31.425 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 podman[35472]: 2024-09-16 00:54:31.284801276 +0000 UTC m=+0.356293710 container start 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T00:54:31.425 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-mgr[35492]: -- 172.21.15.88:0/3019330718 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b7927d0e0 con 0x560b7925a800 2024-09-16T00:54:31.425 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 bash[35472]: 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 2024-09-16T00:54:31.425 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 systemd[1]: Started Ceph mgr.y for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:54:31.653 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:31.169+0000 7f52d4060040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:54:31.653 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:31.237+0000 7f52d4060040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:54:31.706 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:31.424+0000 7f5fbf76f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T00:54:31.706 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:31.481+0000 7f5fbf76f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T00:54:31.706 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:31.637+0000 7f5fbf76f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T00:54:31.706 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:31.705+0000 7f5fbf76f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T00:54:31.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:54:32.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-09-16T00:54:32.021 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:31.871+0000 7f5fbf76f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:54:32.021 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:32.020+0000 7f5fbf76f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T00:54:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:54:32.263 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:31.994+0000 7f52d4060040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:54:32.263 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.114+0000 7f52d4060040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:54:32.263 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.262+0000 7f52d4060040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:54:32.557 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.323+0000 7f52d4060040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.482+0000 7f52d4060040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.556+0000 7f52d4060040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.558 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:32.605 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:32.343+0000 7f5fbf76f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T00:54:32.606 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:32.405+0000 7f5fbf76f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T00:54:32.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:32.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:32.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 -- 172.21.15.17:0/18947943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 msgr2=0x7fa034108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 --2- 172.21.15.17:0/18947943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa034108f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009ca0 tx=0x7fa02c02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 -- 172.21.15.17:0/18947943 shutdown_connections 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 --2- 172.21.15.17:0/18947943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa034108f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 --2- 172.21.15.17:0/18947943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 0x7fa034102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 --2- 172.21.15.17:0/18947943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 -- 172.21.15.17:0/18947943 >> 172.21.15.17:0/18947943 conn(0x7fa0340fc280 msgr2=0x7fa0340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 -- 172.21.15.17:0/18947943 shutdown_connections 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.734+0000 7fa03aab6640 1 -- 172.21.15.17:0/18947943 wait complete. 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 Processor -- start 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 -- start start 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 0x7fa03419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa0341a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410c600 con 0x7fa034102690 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410c480 con 0x7fa034100ad0 2024-09-16T00:54:32.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa03aab6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa03410c780 con 0x7fa034101cd0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa039053640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa0341a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:55696/0 (socket says 172.21.15.17:55696) 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 -- 172.21.15.17:0/1712449669 learned_addr learned my addr 172.21.15.17:0/1712449669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa033fff640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 0x7fa03419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 -- 172.21.15.17:0/1712449669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 msgr2=0x7fa03419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 0x7fa03419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 -- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 msgr2=0x7fa0341a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa0341a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 -- 172.21.15.17:0/1712449669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0341a1c10 con 0x7fa034100ad0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.735+0000 7fa038852640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa02400e9c0 tx=0x7fa02400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.736+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02400cd80 con 0x7fa034100ad0 2024-09-16T00:54:32.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.736+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0240035f0 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.736+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0341a1f00 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.736+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024010690 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.736+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0341a2350 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa024010830 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa031ffb640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 0x7fa01c03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa02404ca20 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa033fff640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 0x7fa01c03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0341a2610 con 0x7fa034100ad0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.737+0000 7fa033fff640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 0x7fa01c03b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa03419b500 tx=0x7fa028005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:32.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.742+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa024010da0 con 0x7fa034100ad0 2024-09-16T00:54:32.846 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.617+0000 7f52d4060040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:54:32.846 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.780+0000 7f52d4060040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:54:32.846 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.845+0000 7f52d4060040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:54:32.892 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:32.604+0000 7f5fbf76f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T00:54:32.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:32.934+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa03406a6f0 con 0x7fa01c039500 2024-09-16T00:54:33.115 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.913+0000 7f52d4060040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:54:33.115 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:32.996+0000 7f52d4060040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:54:33.115 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:33.055+0000 7f52d4060040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:54:33.115 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:33.114+0000 7f52d4060040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:54:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: Reconfiguring daemon mgr.x on smithi017 2024-09-16T00:54:33.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:33.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:33.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.892 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:33.485+0000 7f5fbf76f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:33.552+0000 7f5fbf76f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:54:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: Reconfiguring daemon mgr.x on smithi017 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:33.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:33.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: Reconfiguring daemon mgr.x on smithi017 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:54:33.902 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:34.153 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 00:54:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T00:54:33.900+0000 7f52d4060040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:54:34.517 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.264+0000 7f5fbf76f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T00:54:34.517 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.376+0000 7f5fbf76f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T00:54:34.517 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.515+0000 7f5fbf76f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T00:54:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:34.644+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fa024021960 con 0x7fa034100ad0 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.576+0000 7f5fbf76f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.725+0000 7f5fbf76f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.792+0000 7f5fbf76f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: Standby manager daemon z started 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:54:34.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:34.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:34.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: Standby manager daemon z started 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:34.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: Standby manager daemon z started 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/1829803585' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:34.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:34.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:34.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:34.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:35.072 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:34.851+0000 7f5fbf76f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T00:54:35.072 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.007+0000 7f5fbf76f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T00:54:35.072 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.070+0000 7f5fbf76f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T00:54:35.335 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.136+0000 7f5fbf76f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T00:54:35.336 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.217+0000 7f5fbf76f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T00:54:35.336 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.275+0000 7f5fbf76f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T00:54:35.336 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:35.333+0000 7f5fbf76f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T00:54:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:35 smithi154 ceph-mon[34759]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:54:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:54:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:35 smithi017 ceph-mon[31211]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:54:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:54:36.112 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-mon[34093]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-16T00:54:36.113 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T00:54:36.392 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T00:54:36.110+0000 7f5fbf76f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T00:54:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:36.658+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mon.2 v2:172.21.15.88:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa02401f340 con 0x7fa034100ad0 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: Standby manager daemon y started 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]: dispatch 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]': finished 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:54:36.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: Standby manager daemon y started 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]: dispatch 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]': finished 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:54:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: Standby manager daemon y started 2024-09-16T00:54:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T00:54:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2024880449' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]: dispatch 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2644420681' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df210cfa-2f35-4f3b-b149-52700132d8f3"}]': finished 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T00:54:37.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:37 smithi017 ceph-mon[31211]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:54:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:37 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:54:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:37 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3118695483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:38.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:37 smithi088 ceph-mon[34093]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:54:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:37 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:54:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:37 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3118695483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:37 smithi154 ceph-mon[34759]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-16T00:54:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:37 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T00:54:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:37 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3118695483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:54:38.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:38 smithi017 ceph-mon[31211]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:39.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:38 smithi088 ceph-mon[34093]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:39.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:38 smithi154 ceph-mon[34759]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:40.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:40 smithi017 ceph-mon[31211]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:41.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:40 smithi088 ceph-mon[34093]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:40 smithi154 ceph-mon[34759]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:42.907 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:42 smithi017 ceph-mon[31211]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:42.945 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:42 smithi088 ceph-mon[34093]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:42.955 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:42 smithi154 ceph-mon[34759]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:44 smithi017 ceph-mon[31211]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:54:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:45.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:44 smithi088 ceph-mon[34093]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:54:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:45.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:44 smithi154 ceph-mon[34759]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:45.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:54:45.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:45.791 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:45 smithi017 ceph-mon[31211]: Deploying daemon osd.0 on smithi017 2024-09-16T00:54:46.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:45 smithi088 ceph-mon[34093]: Deploying daemon osd.0 on smithi017 2024-09-16T00:54:46.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:45 smithi154 ceph-mon[34759]: Deploying daemon osd.0 on smithi017 2024-09-16T00:54:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:46 smithi017 ceph-mon[31211]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:47.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:46 smithi088 ceph-mon[34093]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:47.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:46 smithi154 ceph-mon[34759]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:48 smithi017 ceph-mon[31211]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:49.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:48 smithi088 ceph-mon[34093]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:49.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:48 smithi154 ceph-mon[34759]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:50 smithi017 ceph-mon[31211]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:51.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:50 smithi088 ceph-mon[34093]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:50 smithi154 ceph-mon[34759]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:52.776 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:52 smithi017 ceph-mon[31211]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:52.776 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:52 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:52.776 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:52 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:53.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:52 smithi088 ceph-mon[34093]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:53.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:52 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:53.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:52 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:53.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:52 smithi154 ceph-mon[34759]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:53.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:52 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:53.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:52 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:53 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:53 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:53 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:54.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:53 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:54.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:53 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:54.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:53 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:54.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:53 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:53 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:53 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.549+0000 7fa031ffb640 1 -- 172.21.15.17:0/1712449669 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa03406a6f0 con 0x7fa01c039500 2024-09-16T00:54:54.550 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 msgr2=0x7fa01c03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 0x7fa01c03b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa03419b500 tx=0x7fa028005f90 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 msgr2=0x7fa034199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa02400e9c0 tx=0x7fa02400ee80 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 shutdown_connections 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa01c039500 0x7fa01c03b9c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa034102690 0x7fa0341a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa034101cd0 0x7fa03419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 --2- 172.21.15.17:0/1712449669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa034100ad0 0x7fa034199fe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 >> 172.21.15.17:0/1712449669 conn(0x7fa0340fc280 msgr2=0x7fa034069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 shutdown_connections 2024-09-16T00:54:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:54:54.553+0000 7fa03aab6640 1 -- 172.21.15.17:0/1712449669 wait complete. 2024-09-16T00:54:54.907 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:54 smithi017 ceph-mon[31211]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:54.907 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:54.908 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:54.908 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:55.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:54 smithi088 ceph-mon[34093]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:55.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:54 smithi154 ceph-mon[34759]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:55.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:55.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:55.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:55.205 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T00:54:55.208 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_4... 2024-09-16T00:54:55.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:54:55.427 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:54:55 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T00:54:55.399+0000 7fe041505640 -1 osd.0 0 log_to_monitors true 2024-09-16T00:54:55.447 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:54:55.885 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:55 smithi088 ceph-mon[34093]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:54:56.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:55 smithi154 ceph-mon[34759]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:54:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:55 smithi017 ceph-mon[31211]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:54:56.717 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:56 smithi088 ceph-mon[34093]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:56.718 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:56 smithi088 ceph-mon[34093]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:54:56.718 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:56 smithi088 ceph-mon[34093]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:54:56.718 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:56 smithi088 ceph-mon[34093]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:54:56.718 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:56 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:56 smithi154 ceph-mon[34759]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:56 smithi154 ceph-mon[34759]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:54:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:56 smithi154 ceph-mon[34759]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:54:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:56 smithi154 ceph-mon[34759]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:54:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:56 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-mon[31211]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-mon[31211]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:54:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-mon[31211]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:54:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-mon[31211]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:54:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:57.188 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T00:54:56.708+0000 7fe03d488640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T00:54:57.188 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:54:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T00:54:56.714+0000 7fe0392b0640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:54:57.849 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:54:57.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2024-09-16T00:54:58.121 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:54:58.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:57 smithi088 ceph-mon[34093]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:54:58.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:57 smithi088 ceph-mon[34093]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:54:58.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:57 smithi154 ceph-mon[34759]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:54:58.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:57 smithi154 ceph-mon[34759]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:54:58.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:57 smithi017 ceph-mon[31211]: from='osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:54:58.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:57 smithi017 ceph-mon[31211]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:54:58.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.565+0000 7f707aaa4640 1 -- 172.21.15.88:0/522732840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 msgr2=0x7f707410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.565+0000 7f707aaa4640 1 --2- 172.21.15.88:0/522732840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707410a050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f706c009ca0 tx=0x7f706c02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- 172.21.15.88:0/522732840 shutdown_connections 2024-09-16T00:54:58.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- 172.21.15.88:0/522732840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707410a050 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- 172.21.15.88:0/522732840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 0x7f7074103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- 172.21.15.88:0/522732840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- 172.21.15.88:0/522732840 >> 172.21.15.88:0/522732840 conn(0x7f70740fd390 msgr2=0x7f70740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- 172.21.15.88:0/522732840 shutdown_connections 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- 172.21.15.88:0/522732840 wait complete. 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 Processor -- start 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- start start 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 0x7f7074198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f707410d760 con 0x7f7074101c00 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f707410d5e0 con 0x7f70741037c0 2024-09-16T00:54:58.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.566+0000 7f707aaa4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f707410d8e0 con 0x7f7074102e00 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41382/0 (socket says 172.21.15.88:41382) 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 -- 172.21.15.88:0/884012166 learned_addr learned my addr 172.21.15.88:0/884012166 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7078840640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f706bfff640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 0x7f7074198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 -- 172.21.15.88:0/884012166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 msgr2=0x7f7074198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 0x7f7074198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 -- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 msgr2=0x7f7074197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 -- 172.21.15.88:0/884012166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707419f960 con 0x7f70741037c0 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7078840640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7079041640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f706c031040 tx=0x7f706c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:58.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c004040 con 0x7f70741037c0 2024-09-16T00:54:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f706c004690 con 0x7f70741037c0 2024-09-16T00:54:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707419fbf0 con 0x7f70741037c0 2024-09-16T00:54:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c03b410 con 0x7f70741037c0 2024-09-16T00:54:58.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.567+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741a0180 con 0x7f70741037c0 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.569+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7074108f80 con 0x7f70741037c0 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.570+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f706c0305c0 con 0x7f70741037c0 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.570+0000 7f7069ffb640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 0x7f705c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.570+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f706c0ef430 con 0x7f70741037c0 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.570+0000 7f7078840640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 0x7f705c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:58.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.571+0000 7f7078840640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 0x7f705c0a5720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7074102c60 tx=0x7f707000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:58.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.575+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f706c0bdbc0 con 0x7f70741037c0 2024-09-16T00:54:58.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:54:58.748+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7074062630 con 0x7f705c0a3260 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] boot 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:58.750 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.751 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:58.751 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:58.751 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:54:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:54:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] boot 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:58.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:54:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: osd.0 [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] boot 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:00.064 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi017 2024-09-16T00:55:00.064 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-16T00:55:00.065 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:00.065 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:00.065 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:00.065 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:00.065 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:54:59 smithi088 ceph-mon[34093]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi017 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:00.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:54:59 smithi154 ceph-mon[34759]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi017 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:54:59 smithi017 ceph-mon[31211]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T00:55:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:00 smithi088 ceph-mon[34093]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:00 smithi154 ceph-mon[34759]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:00 smithi017 ceph-mon[31211]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/530964099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]': finished 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:01 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/2649972834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/530964099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]': finished 2024-09-16T00:55:02.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:55:02.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:02.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:01 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/2649972834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/530964099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]: dispatch 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2edb955-6522-41b5-955a-cc55dfcbc826"}]': finished 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:01 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/2649972834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:03.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:02 smithi088 ceph-mon[34093]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:03.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:02 smithi154 ceph-mon[34759]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:03.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:02 smithi017 ceph-mon[31211]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:05.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:04 smithi088 ceph-mon[34093]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:04 smithi154 ceph-mon[34759]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:04 smithi017 ceph-mon[31211]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:07.124 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:06 smithi088 ceph-mon[34093]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:07.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:06 smithi154 ceph-mon[34759]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:07.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:06 smithi017 ceph-mon[31211]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:08.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:08 smithi017 ceph-mon[31211]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:09.135 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:08 smithi088 ceph-mon[34093]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:09.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:08 smithi154 ceph-mon[34759]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:09.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:09 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:55:09.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:09 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:09 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:55:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:09 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:10.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:09 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:55:10.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:09 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:10.970 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:10 smithi088 ceph-mon[34093]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:10.970 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:10 smithi088 ceph-mon[34093]: Deploying daemon osd.1 on smithi088 2024-09-16T00:55:11.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:10 smithi017 ceph-mon[31211]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:11.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:10 smithi017 ceph-mon[31211]: Deploying daemon osd.1 on smithi088 2024-09-16T00:55:11.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:10 smithi154 ceph-mon[34759]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:11.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:10 smithi154 ceph-mon[34759]: Deploying daemon osd.1 on smithi088 2024-09-16T00:55:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:12 smithi088 ceph-mon[34093]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:12 smithi154 ceph-mon[34759]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:13.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:12 smithi017 ceph-mon[31211]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:14.856 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:14 smithi088 ceph-mon[34093]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:15.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:14 smithi154 ceph-mon[34759]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:14 smithi017 ceph-mon[31211]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:15.866 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:15.866 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:15.866 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:17.032 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:16 smithi088 ceph-mon[34093]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:16 smithi154 ceph-mon[34759]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:17.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:16 smithi017 ceph-mon[31211]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:18.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:18.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:18.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:18.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:18.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.373+0000 7f7069ffb640 1 -- 172.21.15.88:0/884012166 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7074062630 con 0x7f705c0a3260 2024-09-16T00:55:19.374 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 msgr2=0x7f705c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 0x7f705c0a5720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7074102c60 tx=0x7f707000a2d0 comp rx=0 tx=0).stop 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 msgr2=0x7f707419f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f706c031040 tx=0x7f706c003c10 comp rx=0 tx=0).stop 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 shutdown_connections 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f705c0a3260 0x7f705c0a5720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70741037c0 0x7f707419f2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:19.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074102e00 0x7f7074198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:19.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 --2- 172.21.15.88:0/884012166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7074101c00 0x7f7074197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:19.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 >> 172.21.15.88:0/884012166 conn(0x7f70740fd390 msgr2=0x7f7074106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:19.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 shutdown_connections 2024-09-16T00:55:19.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:55:19.375+0000 7f707aaa4640 1 -- 172.21.15.88:0/884012166 wait complete. 2024-09-16T00:55:19.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:19.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:19.965 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T00:55:19.968 INFO:tasks.cephadm:Deploying osd.2 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-16T00:55:19.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:55:20.219 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:55:20.847 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:20 smithi088 ceph-mon[34093]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:20.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:20 smithi154 ceph-mon[34759]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:20.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:20 smithi017 ceph-mon[31211]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:21.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T00:55:21.208+0000 7f44ed902640 -1 osd.1 0 log_to_monitors true 2024-09-16T00:55:21.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:21 smithi154 ceph-mon[34759]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:21.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:21 smithi154 ceph-mon[34759]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:21.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:21 smithi088 ceph-mon[34093]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:21.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:21 smithi088 ceph-mon[34093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:21.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:21 smithi017 ceph-mon[31211]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:21.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:21 smithi017 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:55:22.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:55:22.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-16T00:55:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:55:22.762 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:22.762 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:55:22.762 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:22.762 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:55:22.763 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:22.763 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-mon[34093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:55:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:55:22.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:22.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:22 smithi154 ceph-mon[34759]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: from='osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:22 smithi017 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:55:23.142 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T00:55:22.996+0000 7f44e9885640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T00:55:23.143 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T00:55:22.999+0000 7f44e16a5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:55:23.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 -- 172.21.15.154:0/1391417028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38102690 msgr2=0x7f6f38108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:23.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/1391417028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38102690 0x7f6f38108f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009ca0 tx=0x7f6f3002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 -- 172.21.15.154:0/1391417028 shutdown_connections 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/1391417028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38102690 0x7f6f38108f20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/1391417028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 0x7f6f38102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/1391417028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38100ad0 0x7f6f38100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 -- 172.21.15.154:0/1391417028 >> 172.21.15.154:0/1391417028 conn(0x7f6f380fc280 msgr2=0x7f6f380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:23.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 -- 172.21.15.154:0/1391417028 shutdown_connections 2024-09-16T00:55:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.189+0000 7f6f3e04f640 1 -- 172.21.15.154:0/1391417028 wait complete. 2024-09-16T00:55:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 Processor -- start 2024-09-16T00:55:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 -- start start 2024-09-16T00:55:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 0x7f6f38103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:23.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38102690 0x7f6f38103850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:23.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3810c5e0 con 0x7f6f38102690 2024-09-16T00:55:23.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3810c460 con 0x7f6f38101cd0 2024-09-16T00:55:23.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f3e04f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3810c760 con 0x7f6f38100ad0 2024-09-16T00:55:23.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:23.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40682/0 (socket says 172.21.15.154:40682) 2024-09-16T00:55:23.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.190+0000 7f6f377fe640 1 -- 172.21.15.154:0/3087946259 learned_addr learned my addr 172.21.15.154:0/3087946259 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:55:23.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f36ffd640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 0x7f6f38103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:23.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f37fff640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38102690 0x7f6f38103850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 -- 172.21.15.154:0/3087946259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 msgr2=0x7f6f38103310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 0x7f6f38103310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 -- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38102690 msgr2=0x7f6f38103850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38102690 0x7f6f38103850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 -- 172.21.15.154:0/3087946259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f38104070 con 0x7f6f38100ad0 2024-09-16T00:55:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f377fe640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00d770 tx=0x7f6f2c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c017070 con 0x7f6f38100ad0 2024-09-16T00:55:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f2c009c30 con 0x7f6f38100ad0 2024-09-16T00:55:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f381a1ed0 con 0x7f6f38100ad0 2024-09-16T00:55:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c003d00 con 0x7f6f38100ad0 2024-09-16T00:55:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.191+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f381a2380 con 0x7f6f38100ad0 2024-09-16T00:55:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.192+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f381a26a0 con 0x7f6f38100ad0 2024-09-16T00:55:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.194+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f6f2c003ea0 con 0x7f6f38100ad0 2024-09-16T00:55:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.195+0000 7f6f34ff9640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 0x7f6f200a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.195+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f6f2c0cdce0 con 0x7f6f38100ad0 2024-09-16T00:55:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.195+0000 7f6f36ffd640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 0x7f6f200a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.196+0000 7f6f36ffd640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 0x7f6f200a56f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f381049d0 tx=0x7f6f2800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.198+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f2c09c3f0 con 0x7f6f38100ad0 2024-09-16T00:55:23.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:23.379+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6f381a2870 con 0x7f6f200a3230 2024-09-16T00:55:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi088 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 17088M 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='osd.1 ' entity='osd.1' 2024-09-16T00:55:23.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:23.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:23.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi088 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 17088M 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='osd.1 ' entity='osd.1' 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:23.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi088 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 17088M 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='osd.1 ' entity='osd.1' 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:23.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:24.882 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] boot 2024-09-16T00:55:24.883 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:55:24.883 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:55:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] boot 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:55:24.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: osd.1 [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] boot 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T00:55:24.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3518259314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]': finished 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:55:26.265 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/3518259314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]': finished 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:55:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3518259314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]: dispatch 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83ea9ade-f366-48d6-bccb-f83f659606c7"}]': finished 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T00:55:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:27 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/3372035552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:27.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:27 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3372035552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:27 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3372035552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:28 smithi088 ceph-mon[34093]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:28.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:28 smithi154 ceph-mon[34759]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:28.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:28 smithi017 ceph-mon[31211]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:30.295 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:30 smithi154 ceph-mon[34759]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:30.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:30 smithi088 ceph-mon[34093]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:30.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:30 smithi017 ceph-mon[31211]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:32.276 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:32 smithi154 ceph-mon[34759]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:32.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:32 smithi088 ceph-mon[34093]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:32.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:32 smithi017 ceph-mon[31211]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:34.327 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:34 smithi154 ceph-mon[34759]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:34.327 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:55:34.327 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:34.328 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:34 smithi154 ceph-mon[34759]: Deploying daemon osd.2 on smithi154 2024-09-16T00:55:34.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:34 smithi088 ceph-mon[34093]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:34.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:55:34.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:34.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:34 smithi088 ceph-mon[34093]: Deploying daemon osd.2 on smithi154 2024-09-16T00:55:34.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:34 smithi017 ceph-mon[31211]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:34.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:55:34.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:34.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:34 smithi017 ceph-mon[31211]: Deploying daemon osd.2 on smithi154 2024-09-16T00:55:36.379 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:36 smithi154 ceph-mon[34759]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:36.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:36 smithi088 ceph-mon[34093]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:36.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:36 smithi017 ceph-mon[31211]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:38.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:38 smithi088 ceph-mon[34093]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:38.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:38 smithi154 ceph-mon[34759]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:38.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:38 smithi017 ceph-mon[31211]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:40.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:40 smithi088 ceph-mon[34093]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:40.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:40 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:40.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:40 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:40.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:40 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:40.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:40 smithi154 ceph-mon[34759]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:40.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:40 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:40.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:40 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:40.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:40 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:40.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:40 smithi017 ceph-mon[31211]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:40.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:40 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:40.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:40 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:40.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:40 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:42.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:42 smithi088 ceph-mon[34093]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:42.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:42 smithi154 ceph-mon[34759]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:42.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:42 smithi017 ceph-mon[31211]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:43.683 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:43 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.683 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:43 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.683 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:43 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:43.683 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:43 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:43.683 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:43 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.735 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 2 on host 'smithi154' 2024-09-16T00:55:43.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.734+0000 7f6f34ff9640 1 -- 172.21.15.154:0/3087946259 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6f381a2870 con 0x7f6f200a3230 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 msgr2=0x7f6f200a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 0x7f6f200a56f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f381049d0 tx=0x7f6f2800b590 comp rx=0 tx=0).stop 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 msgr2=0x7f6f38104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00d770 tx=0x7f6f2c00dc30 comp rx=0 tx=0).stop 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 shutdown_connections 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f200a3230 0x7f6f200a56f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f38102690 0x7f6f38103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f38101cd0 0x7f6f38103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:43.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 --2- 172.21.15.154:0/3087946259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38100ad0 0x7f6f38104c50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:43.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 >> 172.21.15.154:0/3087946259 conn(0x7f6f380fc280 msgr2=0x7f6f38069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:43.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 shutdown_connections 2024-09-16T00:55:43.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:55:43.736+0000 7f6f3e04f640 1 -- 172.21.15.154:0/3087946259 wait complete. 2024-09-16T00:55:43.853 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:43 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.853 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:43 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.853 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:43 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:43.853 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:43 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:43.854 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:43 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:43 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.374 DEBUG:teuthology.orchestra.run.smithi154:osd.2> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T00:55:44.376 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2024-09-16T00:55:44.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:55:44.626 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:44 smithi154 ceph-mon[34759]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:44.626 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:44.626 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.626 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:55:44.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:44 smithi017 ceph-mon[31211]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:44.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:44.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:44 smithi088 ceph-mon[34093]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:45.728 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T00:55:45.583+0000 7f3fe3e23640 -1 osd.2 0 log_to_monitors true 2024-09-16T00:55:46.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:46 smithi154 ceph-mon[34759]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:46.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:46 smithi154 ceph-mon[34759]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:46.786 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:46 smithi154 ceph-mon[34759]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:46.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:46 smithi088 ceph-mon[34093]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:46.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:46 smithi088 ceph-mon[34093]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:46.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:46 smithi088 ceph-mon[34093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:46 smithi017 ceph-mon[31211]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:46 smithi017 ceph-mon[31211]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:46 smithi017 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:55:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:55:47.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-09-16T00:55:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:55:47.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:55:47.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:47.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:47.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:47.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:47.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T00:55:47.595+0000 7f3fdfda6640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T00:55:47.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T00:55:47.599+0000 7f3fdbbce640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:55:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 -- 172.21.15.17:0/544048795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58102690 msgr2=0x7f6e58108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 --2- 172.21.15.17:0/544048795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58102690 0x7f6e58108f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009900 tx=0x7f6e5002a410 comp rx=0 tx=0).stop 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 -- 172.21.15.17:0/544048795 shutdown_connections 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 --2- 172.21.15.17:0/544048795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58102690 0x7f6e58108f20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 --2- 172.21.15.17:0/544048795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 0x7f6e58102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 --2- 172.21.15.17:0/544048795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58100ad0 0x7f6e58100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 -- 172.21.15.17:0/544048795 >> 172.21.15.17:0/544048795 conn(0x7f6e580fc280 msgr2=0x7f6e580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 -- 172.21.15.17:0/544048795 shutdown_connections 2024-09-16T00:55:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.132+0000 7f6e60629640 1 -- 172.21.15.17:0/544048795 wait complete. 2024-09-16T00:55:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 Processor -- start 2024-09-16T00:55:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 -- start start 2024-09-16T00:55:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 0x7f6e58109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58102690 0x7f6e58109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5810d6f0 con 0x7f6e58100ad0 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e60629640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5810d570 con 0x7f6e58102690 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e60629640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5810d870 con 0x7f6e58101cd0 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.133+0000 7f6e5e3c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46160/0 (socket says 172.21.15.17:46160) 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 -- 172.21.15.17:0/2749185511 learned_addr learned my addr 172.21.15.17:0/2749185511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5dbc4640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 0x7f6e58109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5ebc6640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58102690 0x7f6e58109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 -- 172.21.15.17:0/2749185511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 msgr2=0x7f6e58109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 0x7f6e58109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 -- 172.21.15.17:0/2749185511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58102690 msgr2=0x7f6e58109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58102690 0x7f6e58109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 -- 172.21.15.17:0/2749185511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5810a8a0 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e5e3c5640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800ccb0 tx=0x7f6e4800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e48003990 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e48004020 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e581a1f00 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800f6b0 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.134+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e581a22f0 con 0x7f6e58100ad0 2024-09-16T00:55:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.136+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e58107f20 con 0x7f6e58100ad0 2024-09-16T00:55:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.137+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f6e48003b30 con 0x7f6e58100ad0 2024-09-16T00:55:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.137+0000 7f6e577fe640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 0x7f6e400a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.138+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f6e480cddf0 con 0x7f6e58100ad0 2024-09-16T00:55:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.138+0000 7f6e5dbc4640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 0x7f6e400a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.138+0000 7f6e5dbc4640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 0x7f6e400a5670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e5810b1d0 tx=0x7f6e4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.142+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e48014030 con 0x7f6e58100ad0 2024-09-16T00:55:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:48.327+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6e58062630 con 0x7f6e400a31b0 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi154 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:48.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:48.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:48.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.897 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:55:48.897 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi154 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:48.898 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi154 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:49.786 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:49 smithi017 ceph-mon[31211]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:49 smithi017 ceph-mon[31211]: osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] boot 2024-09-16T00:55:49.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:49 smithi017 ceph-mon[31211]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:55:49.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:49 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:49.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:49 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:49 smithi088 ceph-mon[34093]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:49 smithi088 ceph-mon[34093]: osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] boot 2024-09-16T00:55:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:49 smithi088 ceph-mon[34093]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:55:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:49 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:49 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:49 smithi154 ceph-mon[34759]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:49 smithi154 ceph-mon[34759]: osd.2 [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] boot 2024-09-16T00:55:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:49 smithi154 ceph-mon[34759]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T00:55:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:49 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:55:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:49 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:50.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:50 smithi088 ceph-mon[34093]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:50 smithi088 ceph-mon[34093]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T00:55:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:50 smithi154 ceph-mon[34759]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:50 smithi154 ceph-mon[34759]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T00:55:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:50 smithi017 ceph-mon[31211]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:55:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:50 smithi017 ceph-mon[31211]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T00:55:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:55:51.387 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:51.387 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:51.387 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:51.387 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47423]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:51.687 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47448]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:51.687 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:51.687 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:51.687 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 00:55:51 smithi017 sudo[47448]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T00:55:51.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]: dispatch 2024-09-16T00:55:51.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]': finished 2024-09-16T00:55:51.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:55:51.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:55:51.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:51 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2678544956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:51.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:55:51.818+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6e48098280 con 0x7f6e58100ad0 2024-09-16T00:55:51.875 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:51.875 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T00:55:51.875 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]: dispatch 2024-09-16T00:55:51.875 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]': finished 2024-09-16T00:55:51.875 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:55:51.876 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:55:51.876 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:51 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2678544956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:55:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T00:55:51.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]: dispatch 2024-09-16T00:55:51.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2998223079' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e314fac-8a90-4825-9461-14e0385931bf"}]': finished 2024-09-16T00:55:51.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T00:55:51.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:55:51.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:51 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2678544956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:55:52.130 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:51 smithi088 sudo[42669]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:52.130 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:51 smithi088 sudo[42669]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:52.130 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:51 smithi088 sudo[42669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:52.130 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:51 smithi088 sudo[42669]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:52.392 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:52 smithi088 sudo[42672]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:52.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:52 smithi088 sudo[42672]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:52.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:52 smithi088 sudo[42672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:52.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 00:55:52 smithi088 sudo[42672]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:52.652 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43786]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:52.653 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43786]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:52.653 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:52.653 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43786]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:52.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:52 smithi154 ceph-mon[34759]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:52.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:52 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:52.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:52 smithi154 ceph-mon[34759]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:55:52.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:52 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:52.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:52 smithi088 ceph-mon[34093]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:52 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:52 smithi088 ceph-mon[34093]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:55:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:52 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:52.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43789]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:52.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43789]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:52.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:52.903 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 00:55:52 smithi154 sudo[43789]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:52 smithi017 ceph-mon[31211]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:52 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:52 smithi017 ceph-mon[31211]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T00:55:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:52 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[47846]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[47846]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[47846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[47846]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[48040]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[48040]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[48040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:53 smithi017 sudo[48040]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:54.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:53 smithi154 sudo[43792]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:54.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:53 smithi154 sudo[43792]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:54.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:53 smithi154 sudo[43792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:54.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:53 smithi154 sudo[43792]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 sudo[43795]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 sudo[43795]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 sudo[43795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 sudo[43795]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:54.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:54.460 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:54.460 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:54.460 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.460 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:54.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:54.592 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42675]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:55:54.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42675]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:54.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:54.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42675]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 sudo[42678]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:54.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:54.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:55.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:55 smithi088 ceph-mon[34093]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:55.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:55 smithi154 ceph-mon[34759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T00:55:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:55 smithi017 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:55:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:56 smithi017 ceph-mon[31211]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:56.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:56 smithi088 ceph-mon[34093]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:56.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:56 smithi154 ceph-mon[34759]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:58 smithi017 ceph-mon[31211]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:58.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:58 smithi088 ceph-mon[34093]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:58 smithi154 ceph-mon[34759]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:55:59.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:55:59.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:55:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:59.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:55:59.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:55:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:59.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:55:59.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:55:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:00.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:00 smithi088 ceph-mon[34093]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:00.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:00 smithi088 ceph-mon[34093]: Deploying daemon osd.3 on smithi017 2024-09-16T00:56:00.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:00 smithi154 ceph-mon[34759]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:00.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:00 smithi154 ceph-mon[34759]: Deploying daemon osd.3 on smithi017 2024-09-16T00:56:00.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:00 smithi017 ceph-mon[31211]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:00.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:00 smithi017 ceph-mon[31211]: Deploying daemon osd.3 on smithi017 2024-09-16T00:56:02.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:02 smithi088 ceph-mon[34093]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:02.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:02 smithi154 ceph-mon[34759]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:02.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:02 smithi017 ceph-mon[31211]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:04.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:04 smithi088 ceph-mon[34093]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:04.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:04 smithi154 ceph-mon[34759]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:04.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:04 smithi017 ceph-mon[31211]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:06.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:06 smithi017 ceph-mon[31211]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:06.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:06.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:06.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:06.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:06 smithi088 ceph-mon[34093]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:06.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:06.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:06.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:06.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:06 smithi154 ceph-mon[34759]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:06.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:06.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:06.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:09.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:09.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:09.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:09.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:09.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:09.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.645+0000 7f6e577fe640 1 -- 172.21.15.17:0/2749185511 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6e58062630 con 0x7f6e400a31b0 2024-09-16T00:56:09.647 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 msgr2=0x7f6e400a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 0x7f6e400a5670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e5810b1d0 tx=0x7f6e4c00b390 comp rx=0 tx=0).stop 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 msgr2=0x7f6e5810b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800ccb0 tx=0x7f6e4800a620 comp rx=0 tx=0).stop 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 shutdown_connections 2024-09-16T00:56:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e400a31b0 0x7f6e400a5670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e58102690 0x7f6e58109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e58101cd0 0x7f6e58109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 --2- 172.21.15.17:0/2749185511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e58100ad0 0x7f6e5810b450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 >> 172.21.15.17:0/2749185511 conn(0x7f6e580fc280 msgr2=0x7f6e581050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 shutdown_connections 2024-09-16T00:56:09.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:56:09.649+0000 7f6e60629640 1 -- 172.21.15.17:0/2749185511 wait complete. 2024-09-16T00:56:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:09 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:09 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:09 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:10.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:09 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:09 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:09 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:09 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:09 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:09 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:10.294 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T00:56:10.296 INFO:tasks.cephadm:Deploying osd.4 on smithi088 with /dev/vg_nvme/lv_3... 2024-09-16T00:56:10.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:56:10.549 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:56:10.992 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:10 smithi088 ceph-mon[34093]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:11.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:10 smithi154 ceph-mon[34759]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:11.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:10 smithi017 ceph-mon[31211]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:11.497 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 00:56:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T00:56:11.242+0000 7fd8bdb08640 -1 osd.3 0 log_to_monitors true 2024-09-16T00:56:11.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:11 smithi088 ceph-mon[34093]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:56:12.064 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:11 smithi154 ceph-mon[34759]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:56:12.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:11 smithi017 ceph-mon[31211]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:56:12.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:56:13.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:12 smithi088 ceph-mon[34093]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:13.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:12 smithi088 ceph-mon[34093]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:56:13.006 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:12 smithi088 ceph-mon[34093]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:56:13.007 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:12 smithi088 ceph-mon[34093]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:56:13.007 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:13.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2024-09-16T00:56:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:12 smithi017 ceph-mon[31211]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:12 smithi017 ceph-mon[31211]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:56:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:12 smithi017 ceph-mon[31211]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:56:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:12 smithi017 ceph-mon[31211]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:56:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:12 smithi154 ceph-mon[34759]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:12 smithi154 ceph-mon[34759]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:56:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:12 smithi154 ceph-mon[34759]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T00:56:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:12 smithi154 ceph-mon[34759]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:56:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:13.262 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:56:13.437 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T00:56:13.263+0000 7fd8ba29f640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T00:56:13.437 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T00:56:13.271+0000 7fd8b18ab640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 -- 172.21.15.88:0/2333634049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 msgr2=0x7f028810a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 --2- 172.21.15.88:0/2333634049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028810a040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ca0 tx=0x7f028002a8c0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 -- 172.21.15.88:0/2333634049 shutdown_connections 2024-09-16T00:56:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 --2- 172.21.15.88:0/2333634049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028810a040 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 --2- 172.21.15.88:0/2333634049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 0x7f0288103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 --2- 172.21.15.88:0/2333634049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 -- 172.21.15.88:0/2333634049 >> 172.21.15.88:0/2333634049 conn(0x7f02880fd3c0 msgr2=0x7f02880ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 -- 172.21.15.88:0/2333634049 shutdown_connections 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.722+0000 7f028f9f6640 1 -- 172.21.15.88:0/2333634049 wait complete. 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 Processor -- start 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 -- start start 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 0x7f0288198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f028810d700 con 0x7f0288101bf0 2024-09-16T00:56:13.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f028810d580 con 0x7f02881037b0 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028f9f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f028810d880 con 0x7f0288102df0 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028df93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028d792640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028d792640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.88:48678/0 (socket says 172.21.15.88:48678) 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028df93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56038/0 (socket says 172.21.15.88:56038) 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028d792640 1 -- 172.21.15.88:0/4131526044 learned_addr learned my addr 172.21.15.88:0/4131526044 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.723+0000 7f028cf91640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 0x7f0288198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 -- 172.21.15.88:0/4131526044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 msgr2=0x7f0288198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 0x7f0288198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 -- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 msgr2=0x7f0288197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:13.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 -- 172.21.15.88:0/4131526044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028819f980 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028d792640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028df93640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0280031040 tx=0x7f0280003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280004040 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028819fc10 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0280004690 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280030c30 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.724+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02881a0150 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.725+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0288109010 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.726+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f02800041e0 con 0x7f02881037b0 2024-09-16T00:56:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.727+0000 7f027e7fc640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 0x7f02740a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.727+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f02800efaf0 con 0x7f02881037b0 2024-09-16T00:56:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.727+0000 7f028d792640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 0x7f02740a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.728+0000 7f028d792640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 0x7f02740a5730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02840058c0 tx=0x7f0284005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.734+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02800bdbe0 con 0x7f02881037b0 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:13.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:13.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:13.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:13.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:13.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:13 smithi088 ceph-mon[34093]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' 2024-09-16T00:56:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:13.913+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0288062630 con 0x7f02740a3270 2024-09-16T00:56:14.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:13 smithi154 ceph-mon[34759]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:13 smithi017 ceph-mon[31211]: from='osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967]' entity='osd.3' 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi017 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] boot 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:14 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:15.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:56:15.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi017 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] boot 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:15.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:14 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi017 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: osd.3 [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] boot 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: osdmap e24: 4 total, 4 up, 4 in 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:56:15.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:15.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:15.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:14 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:16.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:15 smithi088 ceph-mon[34093]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:16.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:15 smithi088 ceph-mon[34093]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:56:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:15 smithi154 ceph-mon[34759]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:15 smithi154 ceph-mon[34759]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:56:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:15 smithi017 ceph-mon[31211]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:15 smithi017 ceph-mon[31211]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T00:56:17.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/960647433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]': finished 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:56:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T00:56:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/960647433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]': finished 2024-09-16T00:56:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:56:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:17.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:17.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T00:56:17.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/960647433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]: dispatch 2024-09-16T00:56:17.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777"}]': finished 2024-09-16T00:56:17.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: osdmap e27: 5 total, 4 up, 5 in 2024-09-16T00:56:17.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:17 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/3935396322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:17 smithi088 ceph-mon[34093]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:56:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:17 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:17 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/3935396322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:17 smithi154 ceph-mon[34759]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:56:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:17 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:18.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:17 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/3935396322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:18.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:17 smithi017 ceph-mon[31211]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T00:56:18.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:17 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:18 smithi088 ceph-mon[34093]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:18 smithi154 ceph-mon[34759]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:18 smithi017 ceph-mon[31211]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:21.138 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:20 smithi088 ceph-mon[34093]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:20 smithi154 ceph-mon[34759]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:20 smithi017 ceph-mon[31211]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:23.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:22 smithi088 ceph-mon[34093]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:22 smithi154 ceph-mon[34759]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:23.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:22 smithi017 ceph-mon[31211]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:56:25.119 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:24 smithi088 ceph-mon[34093]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:25.119 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:56:25.119 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:25.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:24 smithi154 ceph-mon[34759]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:25.156 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:56:25.156 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:24 smithi017 ceph-mon[31211]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-16T00:56:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:56:25.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:26.116 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:25 smithi088 ceph-mon[34093]: Deploying daemon osd.4 on smithi088 2024-09-16T00:56:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:25 smithi154 ceph-mon[34759]: Deploying daemon osd.4 on smithi088 2024-09-16T00:56:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:25 smithi017 ceph-mon[31211]: Deploying daemon osd.4 on smithi088 2024-09-16T00:56:27.030 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:26 smithi088 ceph-mon[34093]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-16T00:56:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:26 smithi154 ceph-mon[34759]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-16T00:56:27.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:26 smithi017 ceph-mon[31211]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-16T00:56:29.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:28 smithi088 ceph-mon[34093]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:28 smithi154 ceph-mon[34759]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:28 smithi017 ceph-mon[31211]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:56:30.917 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:30 smithi088 ceph-mon[34093]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-16T00:56:31.156 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:30 smithi154 ceph-mon[34759]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-16T00:56:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:30 smithi017 ceph-mon[31211]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-16T00:56:32.082 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:31 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:32.082 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:31 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:32.083 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:31 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:31 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:31 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:31 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:31 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:31 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:31 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:33.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:32 smithi088 ceph-mon[34093]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:56:33.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:32 smithi154 ceph-mon[34759]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:56:33.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:32 smithi017 ceph-mon[31211]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:56:34.592 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:34.592 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:34.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:34.593 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:34.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:34.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:34.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:34.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.932+0000 7f027e7fc640 1 -- 172.21.15.88:0/4131526044 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0288062630 con 0x7f02740a3270 2024-09-16T00:56:34.933 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 4 on host 'smithi088' 2024-09-16T00:56:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 msgr2=0x7f02740a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:34.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 0x7f02740a5730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02840058c0 tx=0x7f0284005f90 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 msgr2=0x7f028819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0280031040 tx=0x7f0280003ba0 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 shutdown_connections 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f02740a3270 0x7f02740a5730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02881037b0 0x7f028819f310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0288102df0 0x7f0288198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.934+0000 7f028f9f6640 1 --2- 172.21.15.88:0/4131526044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0288101bf0 0x7f0288197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.935+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 >> 172.21.15.88:0/4131526044 conn(0x7f02880fd3c0 msgr2=0x7f02881061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.935+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 shutdown_connections 2024-09-16T00:56:34.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:56:34.935+0000 7f028f9f6640 1 -- 172.21.15.88:0/4131526044 wait complete. 2024-09-16T00:56:35.539 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:35.539 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.539 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.565 DEBUG:teuthology.orchestra.run.smithi088:osd.4> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T00:56:35.567 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-16T00:56:35.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:56:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:35.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:56:36.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:36 smithi154 ceph-mon[34759]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:36 smithi017 ceph-mon[31211]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:36.753 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:36 smithi088 ceph-mon[34093]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:37.016 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 00:56:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T00:56:36.751+0000 7fc69846c640 -1 osd.4 0 log_to_monitors true 2024-09-16T00:56:37.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:37 smithi154 ceph-mon[34759]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:37.555 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:37 smithi154 ceph-mon[34759]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:37 smithi088 ceph-mon[34093]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:37 smithi088 ceph-mon[34093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:37 smithi017 ceph-mon[31211]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:37 smithi017 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:38.259 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:56:38.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-16T00:56:38.542 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:56:38.560 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:38.560 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:56:38.561 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:56:38.561 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:38.561 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:38.561 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:38 smithi154 ceph-mon[34759]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:38.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:38.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:56:38.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:56:38.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:38.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:38.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:38 smithi017 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:38.893 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T00:56:38.406+0000 7fc6943ef640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T00:56:38.893 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T00:56:38.412+0000 7fc690217640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: from='osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:38.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:38 smithi088 ceph-mon[34093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:56:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- 172.21.15.154:0/2829467407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844101cd0 msgr2=0x7f9844102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 --2- 172.21.15.154:0/2829467407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844101cd0 0x7f9844102150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9840009900 tx=0x7f984002a410 comp rx=0 tx=0).stop 2024-09-16T00:56:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- 172.21.15.154:0/2829467407 shutdown_connections 2024-09-16T00:56:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 --2- 172.21.15.154:0/2829467407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844102690 0x7f9844108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 --2- 172.21.15.154:0/2829467407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844101cd0 0x7f9844102150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 --2- 172.21.15.154:0/2829467407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844100ad0 0x7f9844100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- 172.21.15.154:0/2829467407 >> 172.21.15.154:0/2829467407 conn(0x7f98440fc280 msgr2=0x7f98440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- 172.21.15.154:0/2829467407 shutdown_connections 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- 172.21.15.154:0/2829467407 wait complete. 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 Processor -- start 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.003+0000 7f984b342640 1 -- start start 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844101cd0 0x7f9844198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844102690 0x7f984419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f984410c620 con 0x7f9844101cd0 2024-09-16T00:56:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f984410c4a0 con 0x7f9844102690 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f984410c7a0 con 0x7f9844100ad0 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58156/0 (socket says 172.21.15.154:58156) 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 -- 172.21.15.154:0/241760202 learned_addr learned my addr 172.21.15.154:0/241760202 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98498df640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844102690 0x7f984419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98488dd640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844101cd0 0x7f9844198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 -- 172.21.15.154:0/241760202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844102690 msgr2=0x7f984419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844102690 0x7f984419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 -- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844101cd0 msgr2=0x7f9844198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844101cd0 0x7f9844198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 -- 172.21.15.154:0/241760202 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984419fa60 con 0x7f9844100ad0 2024-09-16T00:56:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f98490de640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f983400d950 tx=0x7f983400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834017070 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984419fd50 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9834009c30 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.004+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983400f620 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.005+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98441a0180 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.006+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98441a03b0 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.006+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f983401a070 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.007+0000 7f983a7fc640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 0x7f98300a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.007+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f98340ce1b0 con 0x7f9844100ad0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.007+0000 7f98488dd640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 0x7f98300a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.008+0000 7f98488dd640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 0x7f98300a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9844199350 tx=0x7f98400314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:39.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.012+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f983409c060 con 0x7f9844100ad0 2024-09-16T00:56:39.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:39.193+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f984406a6b0 con 0x7f98300a3270 2024-09-16T00:56:39.578 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:56:39.578 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T00:56:39.578 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.578 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.578 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi088 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 8544M 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:39.579 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:39 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:56:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T00:56:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi088 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 8544M 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:39.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:39 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:56:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T00:56:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi088 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 8544M 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:56:39.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:39 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:40.575 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:56:40.575 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:56:40.576 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:40.576 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:40.576 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] boot 2024-09-16T00:56:40.576 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:56:40.576 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:40 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] boot 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:56:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:40 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: osd.4 [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] boot 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: osdmap e31: 5 total, 5 up, 5 in 2024-09-16T00:56:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:40 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:41.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:41 smithi154 ceph-mon[34759]: osdmap e32: 5 total, 5 up, 5 in 2024-09-16T00:56:41.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:41 smithi088 ceph-mon[34093]: osdmap e32: 5 total, 5 up, 5 in 2024-09-16T00:56:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:41 smithi017 ceph-mon[31211]: osdmap e32: 5 total, 5 up, 5 in 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/3620950646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]': finished 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:56:42.794 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:56:42.795 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:42 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/2482585857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:42.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:42.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3620950646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]': finished 2024-09-16T00:56:42.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:56:42.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:56:42.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:42 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/2482585857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3620950646' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]: dispatch 2024-09-16T00:56:42.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88c11364-316e-4f0b-8e9a-e81777fc1c69"}]': finished 2024-09-16T00:56:42.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: osdmap e33: 6 total, 5 up, 6 in 2024-09-16T00:56:42.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:56:42.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:42 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/2482585857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:56:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:44 smithi088 ceph-mon[34093]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:44.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:44 smithi154 ceph-mon[34759]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:44 smithi017 ceph-mon[31211]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:46.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:46 smithi088 ceph-mon[34093]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:46.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:46 smithi154 ceph-mon[34759]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:46 smithi017 ceph-mon[31211]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:48.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:48 smithi154 ceph-mon[34759]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:48.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:48 smithi088 ceph-mon[34093]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:48 smithi017 ceph-mon[31211]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:50 smithi088 ceph-mon[34093]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:56:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:50 smithi088 ceph-mon[34093]: Deploying daemon osd.5 on smithi154 2024-09-16T00:56:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:50 smithi154 ceph-mon[34759]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:56:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:50 smithi154 ceph-mon[34759]: Deploying daemon osd.5 on smithi154 2024-09-16T00:56:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:50 smithi017 ceph-mon[31211]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:56:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:50 smithi017 ceph-mon[31211]: Deploying daemon osd.5 on smithi154 2024-09-16T00:56:52.799 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:52 smithi154 ceph-mon[34759]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:52 smithi088 ceph-mon[34093]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:52 smithi017 ceph-mon[31211]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:54.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:54 smithi154 ceph-mon[34759]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:54.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:54 smithi088 ceph-mon[34093]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:54.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:54 smithi017 ceph-mon[31211]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:56.880 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:56 smithi154 ceph-mon[34759]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:56.880 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:56 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:56.880 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:56 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:56.881 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:56 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:56.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:56 smithi088 ceph-mon[34093]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:56.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:56 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:56.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:56 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:56.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:56 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:56 smithi017 ceph-mon[31211]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:56 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:56 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:56 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:56:58.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:58 smithi088 ceph-mon[34093]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:58.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:58 smithi154 ceph-mon[34759]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:58 smithi017 ceph-mon[31211]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:56:59.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.821+0000 7f983a7fc640 1 -- 172.21.15.154:0/241760202 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f984406a6b0 con 0x7f98300a3270 2024-09-16T00:56:59.822 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-09-16T00:56:59.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 msgr2=0x7f98300a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 0x7f98300a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9844199350 tx=0x7f98400314a0 comp rx=0 tx=0).stop 2024-09-16T00:56:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 msgr2=0x7f9844197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f983400d950 tx=0x7f983400de10 comp rx=0 tx=0).stop 2024-09-16T00:56:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 shutdown_connections 2024-09-16T00:56:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f98300a3270 0x7f98300a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9844102690 0x7f984419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9844101cd0 0x7f9844198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 --2- 172.21.15.154:0/241760202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9844100ad0 0x7f9844197e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 >> 172.21.15.154:0/241760202 conn(0x7f98440fc280 msgr2=0x7f9844069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 shutdown_connections 2024-09-16T00:56:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:56:59.823+0000 7f984b342640 1 -- 172.21.15.154:0/241760202 wait complete. 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:56:59 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:56:59 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:56:59 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:00.486 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T00:57:00.489 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2024-09-16T00:57:00.489 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:57:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:01.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:00 smithi017 ceph-mon[31211]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:01.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:00 smithi088 ceph-mon[34093]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:00 smithi154 ceph-mon[34759]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:02.644 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 00:57:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T00:57:02.301+0000 7f3a190b7640 -1 osd.5 0 log_to_monitors true 2024-09-16T00:57:02.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:02 smithi154 ceph-mon[34759]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:02.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:02 smithi154 ceph-mon[34759]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:02.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:02 smithi154 ceph-mon[34759]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:02 smithi017 ceph-mon[31211]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:02 smithi017 ceph-mon[31211]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:02 smithi017 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:03.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:02 smithi088 ceph-mon[34093]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:03.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:02 smithi088 ceph-mon[34093]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:03.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:02 smithi088 ceph-mon[34093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:57:03.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:57:03.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-09-16T00:57:03.762 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:57:04.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:04.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:04.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:04.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:57:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 -- 172.21.15.17:0/3652662883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb324102e00 msgr2=0x7fb324103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 --2- 172.21.15.17:0/3652662883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb324102e00 0x7fb324103280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb318009900 tx=0x7fb31802a410 comp rx=0 tx=0).stop 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 -- 172.21.15.17:0/3652662883 shutdown_connections 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 --2- 172.21.15.17:0/3652662883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3241037c0 0x7fb32410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 --2- 172.21.15.17:0/3652662883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb324102e00 0x7fb324103280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 --2- 172.21.15.17:0/3652662883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324101c00 0x7fb324102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 -- 172.21.15.17:0/3652662883 >> 172.21.15.17:0/3652662883 conn(0x7fb3240fd390 msgr2=0x7fb3240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 -- 172.21.15.17:0/3652662883 shutdown_connections 2024-09-16T00:57:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.286+0000 7fb32bb29640 1 -- 172.21.15.17:0/3652662883 wait complete. 2024-09-16T00:57:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 Processor -- start 2024-09-16T00:57:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 -- start start 2024-09-16T00:57:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 0x7fb324197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324102e00 0x7fb324198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb32410d780 con 0x7fb3241037c0 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb32410d600 con 0x7fb324101c00 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32bb29640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb32410d900 con 0x7fb324102e00 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32a0c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb3298c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 0x7fb324197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32a0c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48888/0 (socket says 172.21.15.17:48888) 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb32a0c6640 1 -- 172.21.15.17:0/2293176063 learned_addr learned my addr 172.21.15.17:0/2293176063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.287+0000 7fb3290c4640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324102e00 0x7fb324198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 -- 172.21.15.17:0/2293176063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324102e00 msgr2=0x7fb324198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324102e00 0x7fb324198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 -- 172.21.15.17:0/2293176063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 msgr2=0x7fb324197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 0x7fb324197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 -- 172.21.15.17:0/2293176063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32419fa70 con 0x7fb3241037c0 2024-09-16T00:57:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb3298c5640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 0x7fb324197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32a0c6640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00eb10 tx=0x7fb31c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c004b20 con 0x7fb3241037c0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb31c004cc0 con 0x7fb3241037c0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb324074480 con 0x7fb3241037c0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb324074990 con 0x7fb3241037c0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.288+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c010690 con 0x7fb3241037c0 2024-09-16T00:57:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.290+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3241090a0 con 0x7fb3241037c0 2024-09-16T00:57:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.291+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb31c005020 con 0x7fb3241037c0 2024-09-16T00:57:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.291+0000 7fb316ffd640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 0x7fb3100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.292+0000 7fb3298c5640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 0x7fb3100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.292+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7fb31c0cee90 con 0x7fb3241037c0 2024-09-16T00:57:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.292+0000 7fb3298c5640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 0x7fb3100a57b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb324102c60 tx=0x7fb320012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:04.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.296+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb31c09caf0 con 0x7fb3241037c0 2024-09-16T00:57:04.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:04.497+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb324062630 con 0x7fb3100a32f0 2024-09-16T00:57:04.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T00:57:04.278+0000 7f3a1584e640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T00:57:04.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T00:57:04.286+0000 7f3a0ce5a640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:57:05.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi154 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='osd.5 ' entity='osd.5' 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:05.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:04 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi154 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='osd.5 ' entity='osd.5' 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:05.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:04 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi154 2024-09-16T00:57:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-16T00:57:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:57:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='osd.5 ' entity='osd.5' 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:05.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:04 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:06.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:57:06.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:57:06.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:06.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] boot 2024-09-16T00:57:06.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:57:06.052 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:06.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:57:06.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:57:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] boot 2024-09-16T00:57:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:57:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:57:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:57:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:57:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: osd.5 [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] boot 2024-09-16T00:57:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: osdmap e36: 6 total, 6 up, 6 in 2024-09-16T00:57:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:57:07.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:06 smithi088 ceph-mon[34093]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:57:07.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:06 smithi154 ceph-mon[34759]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:57:07.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:06 smithi017 ceph-mon[31211]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]: dispatch 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]': finished 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:07 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1087770739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]: dispatch 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]': finished 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:07 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1087770739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]: dispatch 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/428577326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc10686b-395d-47c7-981e-096599f67648"}]': finished 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:07 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1087770739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:10.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:09 smithi088 ceph-mon[34093]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:09 smithi154 ceph-mon[34759]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:10.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:09 smithi017 ceph-mon[31211]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:12.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:11 smithi017 ceph-mon[31211]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-16T00:57:12.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:11 smithi154 ceph-mon[34759]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-16T00:57:12.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:11 smithi088 ceph-mon[34093]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-16T00:57:14.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:13 smithi154 ceph-mon[34759]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:13 smithi017 ceph-mon[31211]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:14.195 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:13 smithi088 ceph-mon[34093]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:57:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:15 smithi154 ceph-mon[34759]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:57:16.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:57:16.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:16.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:15 smithi154 ceph-mon[34759]: Deploying daemon osd.6 on smithi017 2024-09-16T00:57:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:15 smithi017 ceph-mon[31211]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:57:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:57:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:15 smithi017 ceph-mon[31211]: Deploying daemon osd.6 on smithi017 2024-09-16T00:57:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:15 smithi088 ceph-mon[34093]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:57:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T00:57:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:15 smithi088 ceph-mon[34093]: Deploying daemon osd.6 on smithi017 2024-09-16T00:57:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:17 smithi154 ceph-mon[34759]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:57:18.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:17 smithi017 ceph-mon[31211]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:57:18.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:17 smithi088 ceph-mon[34093]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:57:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:19 smithi017 ceph-mon[31211]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T00:57:20.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:19 smithi088 ceph-mon[34093]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T00:57:20.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:19 smithi154 ceph-mon[34759]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T00:57:22.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:21 smithi017 ceph-mon[31211]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:57:22.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:21 smithi088 ceph-mon[34093]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:57:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:21 smithi154 ceph-mon[34759]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:57:23.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:23.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:23.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:23.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:24 smithi017 ceph-mon[31211]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:24.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:24 smithi088 ceph-mon[34093]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:24 smithi154 ceph-mon[34759]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:25.918 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:25.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:25.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:25.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:25.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:25.961 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2024-09-16T00:57:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.959+0000 7fb316ffd640 1 -- 172.21.15.17:0/2293176063 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb324062630 con 0x7fb3100a32f0 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 msgr2=0x7fb3100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 0x7fb3100a57b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb324102c60 tx=0x7fb320012040 comp rx=0 tx=0).stop 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 msgr2=0x7fb32419f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00eb10 tx=0x7fb31c00c2d0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 shutdown_connections 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb3100a32f0 0x7fb3100a57b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.962+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3241037c0 0x7fb32419f400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.963+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb324102e00 0x7fb324198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.963+0000 7fb32bb29640 1 --2- 172.21.15.17:0/2293176063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb324101c00 0x7fb324197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.963+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 >> 172.21.15.17:0/2293176063 conn(0x7fb3240fd390 msgr2=0x7fb324106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.963+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 shutdown_connections 2024-09-16T00:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:57:25.963+0000 7fb32bb29640 1 -- 172.21.15.17:0/2293176063 wait complete. 2024-09-16T00:57:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.653 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.6.service 2024-09-16T00:57:26.656 INFO:tasks.cephadm:Deploying osd.7 on smithi088 with /dev/vg_nvme/lv_2... 2024-09-16T00:57:26.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:57:26.911 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:57:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:26 smithi017 ceph-mon[31211]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:26.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:27.031 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:26 smithi088 ceph-mon[34093]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:27.031 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:27.031 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:27.031 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:26 smithi154 ceph-mon[34759]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:27.798 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 00:57:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T00:57:27.610+0000 7fe94cf0f640 -1 osd.6 0 log_to_monitors true 2024-09-16T00:57:28.092 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:27 smithi088 ceph-mon[34093]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:57:28.147 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:27 smithi017 ceph-mon[31211]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:57:28.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:27 smithi154 ceph-mon[34759]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T00:57:29.135 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:28 smithi088 ceph-mon[34093]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:29.136 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:28 smithi088 ceph-mon[34093]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:57:29.136 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:28 smithi088 ceph-mon[34093]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:57:29.136 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:28 smithi088 ceph-mon[34093]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:57:29.136 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:28 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:28 smithi154 ceph-mon[34759]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:28 smithi154 ceph-mon[34759]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:57:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:28 smithi154 ceph-mon[34759]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:57:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:28 smithi154 ceph-mon[34759]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:57:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:28 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:29.187 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T00:57:28.808+0000 7fe948e92640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T00:57:29.187 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T00:57:28.818+0000 7fe944cba640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:57:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-mon[31211]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-mon[31211]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T00:57:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-mon[31211]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T00:57:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-mon[31211]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:57:29.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:28 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:29.431 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:57:29.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2024-09-16T00:57:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:57:30.009 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:57:30.009 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T00:57:30.009 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.009 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.009 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:30.010 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:29 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:57:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T00:57:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:29 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:57:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T00:57:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:29 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.241+0000 7f2eed904640 1 -- 172.21.15.88:0/3340939240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8101cd0 msgr2=0x7f2ee8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.241+0000 7f2eed904640 1 --2- 172.21.15.88:0/3340939240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8101cd0 0x7f2ee8102150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009900 tx=0x7f2ed002a410 comp rx=0 tx=0).stop 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- 172.21.15.88:0/3340939240 shutdown_connections 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- 172.21.15.88:0/3340939240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8102690 0x7f2ee8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- 172.21.15.88:0/3340939240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8101cd0 0x7f2ee8102150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- 172.21.15.88:0/3340939240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- 172.21.15.88:0/3340939240 >> 172.21.15.88:0/3340939240 conn(0x7f2ee80fc280 msgr2=0x7f2ee80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- 172.21.15.88:0/3340939240 shutdown_connections 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- 172.21.15.88:0/3340939240 wait complete. 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 Processor -- start 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- start start 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 0x7f2ee81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8102690 0x7f2ee819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee810d770 con 0x7f2ee8101cd0 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee810d5f0 con 0x7f2ee8100ad0 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2eed904640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee810d8f0 con 0x7f2ee8102690 2024-09-16T00:57:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2ee6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2ee6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51412/0 (socket says 172.21.15.88:51412) 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.242+0000 7f2ee6ffd640 1 -- 172.21.15.88:0/3307446106 learned_addr learned my addr 172.21.15.88:0/3307446106 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2edffff640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 0x7f2ee81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 -- 172.21.15.88:0/3307446106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8102690 msgr2=0x7f2ee819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8102690 0x7f2ee819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 -- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 msgr2=0x7f2ee81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 0x7f2ee81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 -- 172.21.15.88:0/3307446106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee819fad0 con 0x7f2ee8100ad0 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2edffff640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 0x7f2ee81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2ee6ffd640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d770 tx=0x7f2ed800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8017070 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee819fdc0 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ed8009c30 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8003d00 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.243+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81a0300 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.244+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee8107f90 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.246+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2ed8003ea0 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.247+0000 7f2eec902640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 0x7f2ed40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.247+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f2ed80cea20 con 0x7f2ee8100ad0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.247+0000 7f2edffff640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 0x7f2ed40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.248+0000 7f2edffff640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 0x7f2ed40a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0006010 tx=0x7f2ed0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:30.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.250+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ed809c450 con 0x7f2ee8100ad0 2024-09-16T00:57:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:30.435+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2ee8062630 con 0x7f2ed40a3270 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi017 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] boot 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:30.990 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:30.991 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:30 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:31.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:57:31.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:57:31.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi017 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] boot 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:30 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi017 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: osd.6 [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] boot 2024-09-16T00:57:31.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: osdmap e43: 7 total, 7 up, 7 in 2024-09-16T00:57:31.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T00:57:31.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:31.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:31.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:30 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:32.092 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:31 smithi088 ceph-mon[34093]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:32.092 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:31 smithi088 ceph-mon[34093]: osdmap e44: 7 total, 7 up, 7 in 2024-09-16T00:57:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:31 smithi154 ceph-mon[34759]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:31 smithi154 ceph-mon[34759]: osdmap e44: 7 total, 7 up, 7 in 2024-09-16T00:57:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:31 smithi017 ceph-mon[31211]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:31 smithi017 ceph-mon[31211]: osdmap e44: 7 total, 7 up, 7 in 2024-09-16T00:57:33.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:32 smithi088 ceph-mon[34093]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:33.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:32 smithi154 ceph-mon[34759]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:33.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:32 smithi017 ceph-mon[31211]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/3285675236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]': finished 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/986007807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/3285675236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]': finished 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/986007807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/3285675236' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]: dispatch 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9f171b1-68c5-4ab6-94c0-13647aa06ab1"}]': finished 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: osdmap e45: 8 total, 7 up, 8 in 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/986007807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:34 smithi088 ceph-mon[34093]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:35.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:34 smithi154 ceph-mon[34759]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:35.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:34 smithi017 ceph-mon[31211]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:36 smithi088 ceph-mon[34093]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:36 smithi154 ceph-mon[34759]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:37.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:36 smithi017 ceph-mon[31211]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:39.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:38 smithi088 ceph-mon[34093]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:39.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:38 smithi154 ceph-mon[34759]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:39.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:38 smithi017 ceph-mon[31211]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:41.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:40 smithi088 ceph-mon[34093]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:40 smithi154 ceph-mon[34759]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:41.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:40 smithi017 ceph-mon[31211]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:42.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:41 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:57:42.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:41 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:41 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:57:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:41 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:42.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:41 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T00:57:42.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:41 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:43.097 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:42 smithi088 ceph-mon[34093]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:43.098 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:42 smithi088 ceph-mon[34093]: Deploying daemon osd.7 on smithi088 2024-09-16T00:57:43.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:42 smithi154 ceph-mon[34759]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:43.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:42 smithi154 ceph-mon[34759]: Deploying daemon osd.7 on smithi088 2024-09-16T00:57:43.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:42 smithi017 ceph-mon[31211]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:43.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:42 smithi017 ceph-mon[31211]: Deploying daemon osd.7 on smithi088 2024-09-16T00:57:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:44 smithi088 ceph-mon[34093]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:45.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:44 smithi154 ceph-mon[34759]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:45.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:44 smithi017 ceph-mon[31211]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:47.054 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:46 smithi088 ceph-mon[34093]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:47.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:46 smithi154 ceph-mon[34759]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:47.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:46 smithi017 ceph-mon[31211]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:48.084 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:48.084 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:48.084 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:49.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:48 smithi088 ceph-mon[34093]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:49.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:48 smithi154 ceph-mon[34759]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:49.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:48 smithi017 ceph-mon[31211]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:50.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.765+0000 7f2eec902640 1 -- 172.21.15.88:0/3307446106 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2ee8062630 con 0x7f2ed40a3270 2024-09-16T00:57:50.768 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 7 on host 'smithi088' 2024-09-16T00:57:50.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 msgr2=0x7f2ed40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:50.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 0x7f2ed40a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0006010 tx=0x7f2ed0000bc0 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 msgr2=0x7f2ee8197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d770 tx=0x7f2ed800dc30 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 shutdown_connections 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2ed40a3270 0x7f2ed40a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8102690 0x7f2ee819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8101cd0 0x7f2ee81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 --2- 172.21.15.88:0/3307446106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ee8100ad0 0x7f2ee8197ea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.767+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 >> 172.21.15.88:0/3307446106 conn(0x7f2ee80fc280 msgr2=0x7f2ee8105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.768+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 shutdown_connections 2024-09-16T00:57:50.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:57:50.768+0000 7f2eed904640 1 -- 172.21.15.88:0/3307446106 wait complete. 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:51.518 DEBUG:teuthology.orchestra.run.smithi088:osd.7> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.7.service 2024-09-16T00:57:51.520 INFO:tasks.cephadm:Deploying osd.8 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-16T00:57:51.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:57:51.773 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:57:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:52 smithi088 ceph-mon[34093]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:53.143 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:52 smithi154 ceph-mon[34759]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:53.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:52 smithi017 ceph-mon[31211]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:53.393 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 00:57:53 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T00:57:53.132+0000 7f574e9a6640 -1 osd.7 0 log_to_monitors true 2024-09-16T00:57:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:53 smithi088 ceph-mon[34093]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:53 smithi088 ceph-mon[34093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:54.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:53 smithi154 ceph-mon[34759]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:54.027 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:53 smithi154 ceph-mon[34759]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:53 smithi017 ceph-mon[31211]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:53 smithi017 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T00:57:54.381 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:57:54.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-16T00:57:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:54.894 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:54.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:55.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3223747826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c102690 msgr2=0x7f8e6c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:55.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3223747826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c102690 0x7f8e6c108f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009ca0 tx=0x7f8e6402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3223747826 shutdown_connections 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3223747826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c102690 0x7f8e6c108f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3223747826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3223747826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 0x7f8e6c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3223747826 >> 172.21.15.154:0/3223747826 conn(0x7f8e6c0fc280 msgr2=0x7f8e6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3223747826 shutdown_connections 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3223747826 wait complete. 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 Processor -- start 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.126+0000 7f8e73ee5640 1 -- start start 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 0x7f8e6c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c102690 0x7f8e6c19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c10c5e0 con 0x7f8e6c100ad0 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c10c460 con 0x7f8e6c102690 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c10c760 con 0x7f8e6c101cd0 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47440/0 (socket says 172.21.15.154:47440) 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 -- 172.21.15.154:0/3067915262 learned_addr learned my addr 172.21.15.154:0/3067915262 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e72482640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c102690 0x7f8e6c19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71c81640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 0x7f8e6c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 -- 172.21.15.154:0/3067915262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c102690 msgr2=0x7f8e6c19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c102690 0x7f8e6c19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 -- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 msgr2=0x7f8e6c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 0x7f8e6c06ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 -- 172.21.15.154:0/3067915262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c19f9d0 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e71480640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d950 tx=0x7f8e6800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68017070 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e68009c30 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c19fcc0 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.127+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800f620 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.128+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c1a01b0 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.128+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c107f90 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.130+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8e680109a0 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.130+0000 7f8e62ffd640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 0x7f8e580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.131+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f8e680ce820 con 0x7f8e6c101cd0 2024-09-16T00:57:55.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.131+0000 7f8e71c81640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 0x7f8e580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:55.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.131+0000 7f8e71c81640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 0x7f8e580a5700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06b050 tx=0x7f8e5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:55.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.135+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e68009de0 con 0x7f8e6c101cd0 2024-09-16T00:57:55.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: osdmap e46: 8 total, 7 up, 8 in 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:55.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:55.190 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:57:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:57:55.319+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8e6c062630 con 0x7f8e580a3240 2024-09-16T00:57:55.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T00:57:55.236+0000 7f574a929640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T00:57:55.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T00:57:55.243+0000 7f5742749640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi088 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 5696M 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:55.871 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:55.872 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='osd.7 ' entity='osd.7' 2024-09-16T00:57:55.872 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:55.872 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:55.872 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:55.872 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:55 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi088 2024-09-16T00:57:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 5696M 2024-09-16T00:57:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:57:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T00:57:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='osd.7 ' entity='osd.7' 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:56.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:55 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi088 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 5696M 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='osd.7 ' entity='osd.7' 2024-09-16T00:57:56.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:57:56.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:57:56.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:56.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:55 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] boot 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:57:56.862 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:56 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] boot 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:57:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:56 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: osd.7 [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] boot 2024-09-16T00:57:57.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: osdmap e48: 8 total, 8 up, 8 in 2024-09-16T00:57:57.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:56 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T00:57:58.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:57:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/3625901148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]': finished 2024-09-16T00:57:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: osdmap e50: 9 total, 8 up, 9 in 2024-09-16T00:57:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3625901148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]': finished 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: osdmap e50: 9 total, 8 up, 9 in 2024-09-16T00:57:58.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: osdmap e49: 8 total, 8 up, 8 in 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3625901148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]: dispatch 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9dc9ff0e-49eb-4681-a903-eb42ed1853ad"}]': finished 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: osdmap e50: 9 total, 8 up, 9 in 2024-09-16T00:57:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:57:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:58 smithi088 ceph-mon[34093]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:57:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:58 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/3916922944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:58 smithi088 ceph-mon[34093]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:57:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:57:58 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:57:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:58 smithi154 ceph-mon[34759]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:57:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:58 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/3916922944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:58 smithi154 ceph-mon[34759]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:57:59.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:57:58 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:57:59.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:58 smithi017 ceph-mon[31211]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:57:59.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:58 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/3916922944' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:57:59.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:58 smithi017 ceph-mon[31211]: osdmap e51: 9 total, 8 up, 9 in 2024-09-16T00:57:59.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:57:58 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:00.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:00 smithi088 ceph-mon[34093]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:00.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:00 smithi088 ceph-mon[34093]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:58:00.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:00 smithi154 ceph-mon[34759]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:00 smithi154 ceph-mon[34759]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:58:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:00 smithi017 ceph-mon[31211]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:00 smithi017 ceph-mon[31211]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T00:58:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:02.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:02 smithi154 ceph-mon[34759]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:02.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:02 smithi088 ceph-mon[34093]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:02 smithi017 ceph-mon[31211]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:04.607 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:04 smithi154 ceph-mon[34759]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:04.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:04 smithi088 ceph-mon[34093]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:04.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:04 smithi017 ceph-mon[31211]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:06.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:06 smithi088 ceph-mon[34093]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:06.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:58:06.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:06 smithi154 ceph-mon[34759]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:58:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:06 smithi017 ceph-mon[31211]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T00:58:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:07.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:07 smithi088 ceph-mon[34093]: Deploying daemon osd.8 on smithi154 2024-09-16T00:58:07.893 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:07 smithi154 ceph-mon[34759]: Deploying daemon osd.8 on smithi154 2024-09-16T00:58:07.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:07 smithi017 ceph-mon[31211]: Deploying daemon osd.8 on smithi154 2024-09-16T00:58:08.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:08 smithi088 ceph-mon[34093]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:08.897 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:08 smithi154 ceph-mon[34759]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:08.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:08 smithi017 ceph-mon[31211]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:10.628 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:10 smithi154 ceph-mon[34759]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:10.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:10 smithi088 ceph-mon[34093]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:10 smithi017 ceph-mon[31211]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:12.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:12 smithi088 ceph-mon[34093]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:12.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:12.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:12.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:12.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:12 smithi154 ceph-mon[34759]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:12.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:12.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:12.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:12 smithi017 ceph-mon[31211]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:14.764 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:14 smithi154 ceph-mon[34759]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:14.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:14 smithi088 ceph-mon[34093]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:14.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:14 smithi017 ceph-mon[31211]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:15.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.077+0000 7f8e62ffd640 1 -- 172.21.15.154:0/3067915262 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e6c062630 con 0x7f8e580a3240 2024-09-16T00:58:15.079 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 8 on host 'smithi154' 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 msgr2=0x7f8e580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 0x7f8e580a5700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06b050 tx=0x7f8e5c00b390 comp rx=0 tx=0).stop 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 msgr2=0x7f8e6c19cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d950 tx=0x7f8e6800de10 comp rx=0 tx=0).stop 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 shutdown_connections 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8e580a3240 0x7f8e580a5700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e6c102690 0x7f8e6c19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e6c101cd0 0x7f8e6c19cac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 --2- 172.21.15.154:0/3067915262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c100ad0 0x7f8e6c06ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:15.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 >> 172.21.15.154:0/3067915262 conn(0x7f8e6c0fc280 msgr2=0x7f8e6c105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:15.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 shutdown_connections 2024-09-16T00:58:15.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:58:15.080+0000 7f8e73ee5640 1 -- 172.21.15.154:0/3067915262 wait complete. 2024-09-16T00:58:15.722 DEBUG:teuthology.orchestra.run.smithi154:osd.8> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.8.service 2024-09-16T00:58:15.724 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2024-09-16T00:58:15.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:58:15.998 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:16.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:16 smithi154 ceph-mon[34759]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:16.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.323 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:16 smithi017 ceph-mon[31211]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:16.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:16 smithi088 ceph-mon[34093]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:16.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:17.904 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 00:58:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T00:58:17.638+0000 7f0f387df640 -1 osd.8 0 log_to_monitors true 2024-09-16T00:58:18.170 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:18 smithi017 ceph-mon[31211]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:18.171 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:18 smithi017 ceph-mon[31211]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.171 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:18 smithi017 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:18 smithi088 ceph-mon[34093]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:18.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:18 smithi088 ceph-mon[34093]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:18 smithi088 ceph-mon[34093]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:18 smithi154 ceph-mon[34759]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:18.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:18 smithi154 ceph-mon[34759]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:18 smithi154 ceph-mon[34759]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T00:58:18.967 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:58:19.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2024-09-16T00:58:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:58:19.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:58:19.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:19.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:19.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:19.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:19.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:19.903 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T00:58:19.515+0000 7f0f34762640 -1 osd.8 0 waiting for initial osdmap 2024-09-16T00:58:19.903 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 00:58:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T00:58:19.525+0000 7f0f2c582640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2303711148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 msgr2=0x7fdff0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2303711148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff0109d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009ca0 tx=0x7fdfe802a8c0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2303711148 shutdown_connections 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2303711148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff0109d50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2303711148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 0x7fdff01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2303711148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2303711148 >> 172.21.15.17:0/2303711148 conn(0x7fdff00fc2a0 msgr2=0x7fdff00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2303711148 shutdown_connections 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.930+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2303711148 wait complete. 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 Processor -- start 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 -- start start 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 0x7fdff01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010d750 con 0x7fdff0107900 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010d5d0 con 0x7fdff0104fd0 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdff5f4a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010d8d0 con 0x7fdff01026a0 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdfef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57794/0 (socket says 172.21.15.17:57794) 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdfeffff640 1 -- 172.21.15.17:0/2976855248 learned_addr learned my addr 172.21.15.17:0/2976855248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.931+0000 7fdfeeffd640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 0x7fdff01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 -- 172.21.15.17:0/2976855248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 msgr2=0x7fdff0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 -- 172.21.15.17:0/2976855248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 msgr2=0x7fdff01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 0x7fdff01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 -- 172.21.15.17:0/2976855248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff019fa90 con 0x7fdff0107900 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfef7fe640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfeffff640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8031970 tx=0x7fdfe8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8004040 con 0x7fdff0107900 2024-09-16T00:58:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfe8004690 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff019fd20 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8030c60 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.932+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff01a0200 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.933+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff00fdd90 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.934+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdfe80041e0 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.935+0000 7fdfecff9640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 0x7fdfd80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.936+0000 7fdfef7fe640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 0x7fdfd80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.936+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7fdfe80f03f0 con 0x7fdff0107900 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.936+0000 7fdfef7fe640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 0x7fdfd80a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009fc0 tx=0x7fdfe0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:19.939+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfe80bdc70 con 0x7fdff0107900 2024-09-16T00:58:20.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:20.125+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fdff0062630 con 0x7fdfd80a3270 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi154 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:20.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:20.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='osd.8 ' entity='osd.8' 2024-09-16T00:58:20.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] boot 2024-09-16T00:58:20.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:58:20.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi154 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:20.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:20.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:20.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='osd.8 ' entity='osd.8' 2024-09-16T00:58:20.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] boot 2024-09-16T00:58:20.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:58:20.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-16T00:58:20.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi154 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='osd.8 ' entity='osd.8' 2024-09-16T00:58:20.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: osd.8 [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] boot 2024-09-16T00:58:20.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: osdmap e55: 9 total, 9 up, 9 in 2024-09-16T00:58:20.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:21.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:58:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:58:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:21.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:21.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:22.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:22 smithi017 ceph-mon[31211]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:22.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:22 smithi017 ceph-mon[31211]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:58:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:22 smithi088 ceph-mon[34093]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:22.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:22 smithi088 ceph-mon[34093]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:58:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:22 smithi154 ceph-mon[34759]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:22.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:22 smithi154 ceph-mon[34759]: osdmap e56: 9 total, 9 up, 9 in 2024-09-16T00:58:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:23 smithi088 ceph-mon[34093]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T00:58:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:23 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]: dispatch 2024-09-16T00:58:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:23 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]': finished 2024-09-16T00:58:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:23 smithi088 ceph-mon[34093]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:58:23.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:23 smithi154 ceph-mon[34759]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T00:58:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:23 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]: dispatch 2024-09-16T00:58:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:23 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]': finished 2024-09-16T00:58:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:23 smithi154 ceph-mon[34759]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:58:23.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:23.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:23 smithi017 ceph-mon[31211]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T00:58:23.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:23 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]: dispatch 2024-09-16T00:58:23.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:23 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1230073651' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cdac651-4624-4fac-95de-1cfce92a9be8"}]': finished 2024-09-16T00:58:23.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:23 smithi017 ceph-mon[31211]: osdmap e58: 10 total, 9 up, 10 in 2024-09-16T00:58:23.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:24 smithi088 ceph-mon[34093]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:24 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/766708432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:24 smithi088 ceph-mon[34093]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:58:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:24 smithi154 ceph-mon[34759]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:24 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/766708432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:24 smithi154 ceph-mon[34759]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:58:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:24.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:24 smithi017 ceph-mon[31211]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:24.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:24 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/766708432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:24.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:24 smithi017 ceph-mon[31211]: osdmap e59: 10 total, 9 up, 10 in 2024-09-16T00:58:24.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:26.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:26 smithi088 ceph-mon[34093]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:26.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:26 smithi154 ceph-mon[34759]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:26.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:26 smithi017 ceph-mon[31211]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:28.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:28 smithi017 ceph-mon[31211]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-16T00:58:28.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:28 smithi088 ceph-mon[34093]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-16T00:58:28.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:28 smithi154 ceph-mon[34759]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-16T00:58:30.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:30 smithi088 ceph-mon[34093]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-16T00:58:30.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:30 smithi154 ceph-mon[34759]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-16T00:58:30.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:30 smithi017 ceph-mon[31211]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-16T00:58:32.288 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:32 smithi017 ceph-mon[31211]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:58:32.289 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:58:32.289 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:32.289 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:32 smithi017 ceph-mon[31211]: Deploying daemon osd.9 on smithi017 2024-09-16T00:58:32.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:32 smithi088 ceph-mon[34093]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:58:32.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:58:32.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:32.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:32 smithi088 ceph-mon[34093]: Deploying daemon osd.9 on smithi017 2024-09-16T00:58:32.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:32 smithi154 ceph-mon[34759]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:58:32.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T00:58:32.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:32.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:32 smithi154 ceph-mon[34759]: Deploying daemon osd.9 on smithi017 2024-09-16T00:58:34.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:34 smithi088 ceph-mon[34093]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:58:34.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:34 smithi154 ceph-mon[34759]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:58:34.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:34 smithi017 ceph-mon[31211]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:58:36.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:36 smithi088 ceph-mon[34093]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T00:58:36.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:36 smithi154 ceph-mon[34759]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T00:58:36.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:36 smithi017 ceph-mon[31211]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T00:58:38.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:38 smithi088 ceph-mon[34093]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:58:38.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:38 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:38.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:38 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:38.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:38 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:38.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:38 smithi154 ceph-mon[34759]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:58:38.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:38 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:38.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:38 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:38.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:38 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:38.407 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:38 smithi017 ceph-mon[31211]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:58:38.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:38 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:38.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:38 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:38.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:38 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:40.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:40 smithi017 ceph-mon[31211]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:40.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:40 smithi088 ceph-mon[34093]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:40.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:40 smithi154 ceph-mon[34759]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:41.543 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2024-09-16T00:58:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.541+0000 7fdfecff9640 1 -- 172.21.15.17:0/2976855248 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdff0062630 con 0x7fdfd80a3270 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.543+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 msgr2=0x7fdfd80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.543+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 0x7fdfd80a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009fc0 tx=0x7fdfe0005f90 comp rx=0 tx=0).stop 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.543+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 msgr2=0x7fdff019f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.543+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8031970 tx=0x7fdfe8003ba0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 shutdown_connections 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdfd80a3270 0x7fdfd80a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff0107900 0x7fdff019f420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff0104fd0 0x7fdff01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 --2- 172.21.15.17:0/2976855248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff01026a0 0x7fdff0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:41.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 >> 172.21.15.17:0/2976855248 conn(0x7fdff00fc2a0 msgr2=0x7fdff0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:41.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 shutdown_connections 2024-09-16T00:58:41.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:58:41.544+0000 7fdff5f4a640 1 -- 172.21.15.17:0/2976855248 wait complete. 2024-09-16T00:58:42.177 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.9.service 2024-09-16T00:58:42.179 INFO:tasks.cephadm:Deploying osd.10 on smithi088 with /dev/vg_nvme/lv_1... 2024-09-16T00:58:42.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:58:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:58:42.806 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:42 smithi088 ceph-mon[34093]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:42.806 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:42 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.806 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:42 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.806 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:42 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.806 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:42 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:42 smithi154 ceph-mon[34759]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:42 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:42 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:42 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:42 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:42 smithi017 ceph-mon[31211]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:42.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:42 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:42 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:42 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:42.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:42 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:43.868 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 00:58:43 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T00:58:43.533+0000 7fd023582640 -1 osd.9 0 log_to_monitors true 2024-09-16T00:58:44.669 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:44 smithi017 ceph-mon[31211]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:44.669 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:44 smithi017 ceph-mon[31211]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:58:44.733 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:44 smithi088 ceph-mon[34093]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:44.733 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:44 smithi088 ceph-mon[34093]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:58:44.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:44 smithi154 ceph-mon[34759]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:44.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:44 smithi154 ceph-mon[34759]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T00:58:44.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-16T00:58:45.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_1 2024-09-16T00:58:45.277 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T00:58:45.708 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:45 smithi088 ceph-mon[34093]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:58:45.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:45 smithi088 ceph-mon[34093]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:58:45.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:45 smithi088 ceph-mon[34093]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:58:45.709 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:45 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 -- 172.21.15.88:0/3811675123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 msgr2=0x7f2ac0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/3811675123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0102190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009900 tx=0x7f2ab002a410 comp rx=0 tx=0).stop 2024-09-16T00:58:45.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 -- 172.21.15.88:0/3811675123 shutdown_connections 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/3811675123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 0x7f2ac0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/3811675123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0102190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/3811675123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 -- 172.21.15.88:0/3811675123 >> 172.21.15.88:0/3811675123 conn(0x7f2ac00fc2a0 msgr2=0x7f2ac00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 -- 172.21.15.88:0/3811675123 shutdown_connections 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.792+0000 7f2ac83d6640 1 -- 172.21.15.88:0/3811675123 wait complete. 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 Processor -- start 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 -- start start 2024-09-16T00:58:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 0x7f2ac019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010d770 con 0x7f2ac01026d0 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010d5f0 con 0x7f2ac0101d10 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac83d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010d8f0 con 0x7f2ac0100b10 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36508/0 (socket says 172.21.15.88:36508) 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 -- 172.21.15.88:0/2422298529 learned_addr learned my addr 172.21.15.88:0/2422298529 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac6172640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac6973640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 0x7f2ac019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 -- 172.21.15.88:0/2422298529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 msgr2=0x7f2ac0197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 -- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 msgr2=0x7f2ac019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 0x7f2ac019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac5971640 1 -- 172.21.15.88:0/2422298529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac019fa40 con 0x7f2ac0101d10 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.793+0000 7f2ac6172640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ac5971640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0005940 tx=0x7f2ab00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab003f030 con 0x7f2ac0101d10 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ab00318f0 con 0x7f2ac0101d10 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac019fcd0 con 0x7f2ac0101d10 2024-09-16T00:58:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0035070 con 0x7f2ac0101d10 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.794+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac01a01b0 con 0x7f2ac0101d10 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.795+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac0107f80 con 0x7f2ac0101d10 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.796+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2ab0042030 con 0x7f2ac0101d10 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.796+0000 7f2ab77fe640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 0x7f2aac0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.797+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f2ab00ef410 con 0x7f2ac0101d10 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.797+0000 7f2ac6172640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 0x7f2aac0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.797+0000 7f2ac6172640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 0x7f2aac0a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0101b70 tx=0x7f2abc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.801+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ab00bc400 con 0x7f2ac0101d10 2024-09-16T00:58:45.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:45 smithi017 ceph-mon[31211]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:58:45.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:45 smithi017 ceph-mon[31211]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:58:45.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:45 smithi017 ceph-mon[31211]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:58:45.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:45 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:45 smithi154 ceph-mon[34759]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T00:58:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:45 smithi154 ceph-mon[34759]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T00:58:45.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:45 smithi154 ceph-mon[34759]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-16T00:58:45.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:45 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:45.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:58:45.975+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2ac00626f0 con 0x7f2aac0a3270 2024-09-16T00:58:46.149 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 00:58:45 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T00:58:45.997+0000 7fd01fd19640 -1 osd.9 0 waiting for initial osdmap 2024-09-16T00:58:46.149 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T00:58:46.008+0000 7fd017325640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:58:46.640 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:58:46.640 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.641 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:46 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:46.906 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.906 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.906 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:46 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:58:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:58:46.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096]' entity='osd.9' 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:46.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:46 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:58:47.675 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:47.675 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi017 2024-09-16T00:58:47.676 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-16T00:58:47.676 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:47.676 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] boot 2024-09-16T00:58:47.676 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:58:47.676 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi017 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] boot 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:58:47.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi017 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: osd.9 [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] boot 2024-09-16T00:58:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: osdmap e62: 10 total, 10 up, 10 in 2024-09-16T00:58:47.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: osdmap e63: 10 total, 10 up, 10 in 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/672882083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]': finished 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:58:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:48 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:58:48.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: osdmap e63: 10 total, 10 up, 10 in 2024-09-16T00:58:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/672882083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]': finished 2024-09-16T00:58:48.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:58:48.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:48 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: osdmap e63: 10 total, 10 up, 10 in 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/672882083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]: dispatch 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c69a732f-1e22-4163-9c9d-ed8bac4d6a52"}]': finished 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: osdmap e64: 11 total, 10 up, 11 in 2024-09-16T00:58:48.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:48 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:58:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:49 smithi088 ceph-mon[34093]: from='client.? 172.21.15.88:0/1439553261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:49 smithi154 ceph-mon[34759]: from='client.? 172.21.15.88:0/1439553261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:49.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:49 smithi017 ceph-mon[31211]: from='client.? 172.21.15.88:0/1439553261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:58:50.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:50 smithi088 ceph-mon[34093]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:50 smithi154 ceph-mon[34759]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:50 smithi017 ceph-mon[31211]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:52 smithi088 ceph-mon[34093]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:52.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:52 smithi154 ceph-mon[34759]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:52.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:52 smithi017 ceph-mon[31211]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:54.846 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:54 smithi088 ceph-mon[34093]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:54.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:54 smithi154 ceph-mon[34759]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:54.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:54 smithi017 ceph-mon[31211]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:56.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:56 smithi088 ceph-mon[34093]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:56.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:56 smithi154 ceph-mon[34759]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:56 smithi017 ceph-mon[31211]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:57.753 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:58:57.753 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:58:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T00:58:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:58.751 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:58 smithi088 ceph-mon[34093]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:58.751 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:58:58 smithi088 ceph-mon[34093]: Deploying daemon osd.10 on smithi088 2024-09-16T00:58:58.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:58 smithi154 ceph-mon[34759]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:58.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:58:58 smithi154 ceph-mon[34759]: Deploying daemon osd.10 on smithi088 2024-09-16T00:58:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:58 smithi017 ceph-mon[31211]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:58:58.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:58:58 smithi017 ceph-mon[31211]: Deploying daemon osd.10 on smithi088 2024-09-16T00:59:00.829 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:00 smithi088 ceph-mon[34093]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:00 smithi154 ceph-mon[34759]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:00 smithi017 ceph-mon[31211]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:02.791 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:02 smithi088 ceph-mon[34093]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:02.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:02 smithi154 ceph-mon[34759]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:02 smithi017 ceph-mon[31211]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:03.758 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:03.758 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:03.758 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:04.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:04 smithi088 ceph-mon[34093]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:04.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:04 smithi154 ceph-mon[34759]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:04.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:04 smithi017 ceph-mon[31211]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 10 on host 'smithi088' 2024-09-16T00:59:06.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.395+0000 7f2ab77fe640 1 -- 172.21.15.88:0/2422298529 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2ac00626f0 con 0x7f2aac0a3270 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 msgr2=0x7f2aac0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 0x7f2aac0a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0101b70 tx=0x7f2abc005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 msgr2=0x7f2ac0198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0005940 tx=0x7f2ab00042f0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 shutdown_connections 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2aac0a3270 0x7f2aac0a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ac01026d0 0x7f2ac019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ac0101d10 0x7f2ac0198350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 --2- 172.21.15.88:0/2422298529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac0100b10 0x7f2ac0197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 >> 172.21.15.88:0/2422298529 conn(0x7f2ac00fc2a0 msgr2=0x7f2ac0105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 shutdown_connections 2024-09-16T00:59:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-16T00:59:06.397+0000 7f2ac83d6640 1 -- 172.21.15.88:0/2422298529 wait complete. 2024-09-16T00:59:06.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:06 smithi088 ceph-mon[34093]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:06.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:06.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:06 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:06 smithi154 ceph-mon[34759]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:06 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:06 smithi017 ceph-mon[31211]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:06 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:07.056 DEBUG:teuthology.orchestra.run.smithi088:osd.10> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.10.service 2024-09-16T00:59:07.059 INFO:tasks.cephadm:Deploying osd.11 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-16T00:59:07.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T00:59:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:59:08.392 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:08 smithi088 ceph-mon[34093]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:08.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:08.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:08.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:08 smithi154 ceph-mon[34759]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:08.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:08.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:08.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:08 smithi017 ceph-mon[31211]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:08.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:08.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:09.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:09 smithi088 ceph-mon[34093]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.422 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:09 smithi088 ceph-mon[34093]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.423 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 00:59:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T00:59:09.137+0000 7fdf56003640 -1 osd.10 0 log_to_monitors true 2024-09-16T00:59:09.560 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:09 smithi154 ceph-mon[34759]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.560 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:09 smithi154 ceph-mon[34759]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:09 smithi017 ceph-mon[31211]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:09 smithi017 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T00:59:09.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-16T00:59:09.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-16T00:59:10.178 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:59:10.513 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:10.513 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:59:10.513 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.513 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:59:10.513 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:10.514 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-mon[34093]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.552 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:10.552 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:59:10.552 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.553 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:59:10.553 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:10.553 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:10 smithi154 ceph-mon[34759]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 -- 172.21.15.154:0/2453910787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1084101cb0 msgr2=0x7f1084108540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:10.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 --2- 172.21.15.154:0/2453910787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1084101cb0 0x7f1084108540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f107c009ca0 tx=0x7f107c02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 -- 172.21.15.154:0/2453910787 shutdown_connections 2024-09-16T00:59:10.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 --2- 172.21.15.154:0/2453910787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1084101cb0 0x7f1084108540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 --2- 172.21.15.154:0/2453910787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841012f0 0x7f1084101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 --2- 172.21.15.154:0/2453910787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10841000f0 0x7f10841004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 -- 172.21.15.154:0/2453910787 >> 172.21.15.154:0/2453910787 conn(0x7f10840fb8a0 msgr2=0x7f10840fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 -- 172.21.15.154:0/2453910787 shutdown_connections 2024-09-16T00:59:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.672+0000 7f108999d640 1 -- 172.21.15.154:0/2453910787 wait complete. 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 Processor -- start 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 -- start start 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 0x7f1084197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084101cb0 0x7f108419f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f108410c480 con 0x7f10841000f0 2024-09-16T00:59:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f108410c300 con 0x7f1084101cb0 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.673+0000 7f108999d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f108410c600 con 0x7f10841012f0 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f108899b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 0x7f1084197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39730/0 (socket says 172.21.15.154:39730) 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f108899b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 0x7f1084197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.154:56244/0 (socket says 172.21.15.154:56244) 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f108919c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084101cb0 0x7f108419f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 -- 172.21.15.154:0/2776587554 learned_addr learned my addr 172.21.15.154:0/2776587554 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 -- 172.21.15.154:0/2776587554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084101cb0 msgr2=0x7f108419f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:10.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084101cb0 0x7f108419f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 -- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 msgr2=0x7f1084197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 0x7f1084197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 -- 172.21.15.154:0/2776587554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108419f880 con 0x7f10841012f0 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1083fff640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f107000e9f0 tx=0x7f107000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107000cd80 con 0x7f10841012f0 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10700108e0 con 0x7f10841012f0 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108419fb70 con 0x7f10841012f0 2024-09-16T00:59:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.674+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070018920 con 0x7f10841012f0 2024-09-16T00:59:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.675+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10841a00b0 con 0x7f10841012f0 2024-09-16T00:59:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.676+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10841a0280 con 0x7f10841012f0 2024-09-16T00:59:10.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.677+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1070018ac0 con 0x7f10841012f0 2024-09-16T00:59:10.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.678+0000 7f1081ffb640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 0x7f10740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:10.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.678+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f10700cf440 con 0x7f10841012f0 2024-09-16T00:59:10.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.678+0000 7f108899b640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 0x7f10740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:10.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.679+0000 7f108899b640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 0x7f10740a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1084198b40 tx=0x7f107800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:10.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.682+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f107009c280 con 0x7f10841012f0 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: from='osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: osdmap e65: 11 total, 10 up, 11 in 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:10 smithi017 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-09-16T00:59:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:10.865+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1084109680 con 0x7f10740a3240 2024-09-16T00:59:11.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T00:59:10.763+0000 7fdf51f86640 -1 osd.10 0 waiting for initial osdmap 2024-09-16T00:59:11.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 00:59:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T00:59:10.774+0000 7fdf49da6640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi088 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 4272M 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='osd.10 ' entity='osd.10' 2024-09-16T00:59:11.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:11.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:59:11.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:59:11.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:11 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:59:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi088 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 4272M 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:11.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='osd.10 ' entity='osd.10' 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:59:11.646 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:11 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-09-16T00:59:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi088 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 4272M 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='osd.10 ' entity='osd.10' 2024-09-16T00:59:11.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:11.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:59:11.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:59:11.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:11 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:12.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] boot 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:12.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:12 smithi088 ceph-mon[34093]: osdmap e68: 11 total, 11 up, 11 in 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] boot 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:12.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:12 smithi154 ceph-mon[34759]: osdmap e68: 11 total, 11 up, 11 in 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: osd.10 [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] boot 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: osdmap e67: 11 total, 11 up, 11 in 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T00:59:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:12 smithi017 ceph-mon[31211]: osdmap e68: 11 total, 11 up, 11 in 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/954010452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]': finished 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:14.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:13 smithi017 ceph-mon[31211]: from='client.? 172.21.15.154:0/2975785589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:59:14.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:14.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T00:59:14.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/954010452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]': finished 2024-09-16T00:59:14.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:59:14.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:14.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:13 smithi088 ceph-mon[34093]: from='client.? 172.21.15.154:0/2975785589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:59:14.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:14.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T00:59:14.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/954010452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]: dispatch 2024-09-16T00:59:14.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19cb97fa-bfa5-4cee-8c01-9747633a2d8b"}]': finished 2024-09-16T00:59:14.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: osdmap e70: 12 total, 11 up, 12 in 2024-09-16T00:59:14.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:14.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:13 smithi154 ceph-mon[34759]: from='client.? 172.21.15.154:0/2975785589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:59:15.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:15 smithi088 ceph-mon[34093]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:59:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:15 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:15.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:15 smithi154 ceph-mon[34759]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:59:15.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:15 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:15 smithi017 ceph-mon[31211]: osdmap e71: 12 total, 11 up, 12 in 2024-09-16T00:59:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:15 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:16.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:16 smithi088 ceph-mon[34093]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:16.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:16 smithi154 ceph-mon[34759]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:16.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:16 smithi017 ceph-mon[31211]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:18.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:18 smithi088 ceph-mon[34093]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-16T00:59:18.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:18 smithi154 ceph-mon[34759]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-16T00:59:18.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:18 smithi017 ceph-mon[31211]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-16T00:59:20.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:20 smithi088 ceph-mon[34093]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:59:20.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:20 smithi154 ceph-mon[34759]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:59:20.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:20 smithi017 ceph-mon[31211]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:59:22.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:22 smithi088 ceph-mon[34093]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-16T00:59:22.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:59:22.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:22.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:22 smithi154 ceph-mon[34759]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-16T00:59:22.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:59:22.645 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:22.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:22 smithi017 ceph-mon[31211]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-16T00:59:22.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T00:59:22.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:23.552 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:23 smithi154 ceph-mon[34759]: Deploying daemon osd.11 on smithi154 2024-09-16T00:59:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:23 smithi017 ceph-mon[31211]: Deploying daemon osd.11 on smithi154 2024-09-16T00:59:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:23 smithi088 ceph-mon[34093]: Deploying daemon osd.11 on smithi154 2024-09-16T00:59:24.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:24 smithi154 ceph-mon[34759]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T00:59:24.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:24 smithi017 ceph-mon[31211]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T00:59:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:24 smithi088 ceph-mon[34093]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T00:59:26.560 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:26 smithi154 ceph-mon[34759]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T00:59:26.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:26 smithi017 ceph-mon[31211]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T00:59:26.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:26 smithi088 ceph-mon[34093]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T00:59:28.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:28 smithi154 ceph-mon[34759]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:59:28.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:28 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:28.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:28 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:28.604 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:28 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:28 smithi017 ceph-mon[31211]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:59:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:28 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:28 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:28 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:28.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:28 smithi088 ceph-mon[34093]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T00:59:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:28 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:28 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:28 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:30.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:30 smithi017 ceph-mon[31211]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:30.775 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:30 smithi154 ceph-mon[34759]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:30.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:30 smithi088 ceph-mon[34093]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:31.386 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 11 on host 'smithi154' 2024-09-16T00:59:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.385+0000 7f1081ffb640 1 -- 172.21.15.154:0/2776587554 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1084109680 con 0x7f10740a3240 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 msgr2=0x7f10740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 0x7f10740a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1084198b40 tx=0x7f107800b410 comp rx=0 tx=0).stop 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 msgr2=0x7f10841981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f107000e9f0 tx=0x7f107000eeb0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 shutdown_connections 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f10740a3240 0x7f10740a5700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084101cb0 0x7f108419f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10841012f0 0x7f10841981a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 --2- 172.21.15.154:0/2776587554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10841000f0 0x7f1084197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 >> 172.21.15.154:0/2776587554 conn(0x7f10840fb8a0 msgr2=0x7f1084108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 shutdown_connections 2024-09-16T00:59:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:31.387+0000 7f108999d640 1 -- 172.21.15.154:0/2776587554 wait complete. 2024-09-16T00:59:32.088 DEBUG:teuthology.orchestra.run.smithi154:osd.11> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.11.service 2024-09-16T00:59:32.090 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-16T00:59:32.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:59:32.364 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:32.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:32 smithi017 ceph-mon[31211]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:32.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:32 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:32 smithi154 ceph-mon[34759]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:32.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:32 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:32 smithi088 ceph-mon[34093]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:32 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:32.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 -- 172.21.15.17:0/2042835615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68102e00 msgr2=0x7fdb68103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 --2- 172.21.15.17:0/2042835615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68102e00 0x7fdb68103280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009900 tx=0x7fdb5802a410 comp rx=0 tx=0).stop 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 -- 172.21.15.17:0/2042835615 shutdown_connections 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 --2- 172.21.15.17:0/2042835615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 0x7fdb6810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 --2- 172.21.15.17:0/2042835615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68102e00 0x7fdb68103280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 --2- 172.21.15.17:0/2042835615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68101c00 0x7fdb68102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 -- 172.21.15.17:0/2042835615 >> 172.21.15.17:0/2042835615 conn(0x7fdb680fd390 msgr2=0x7fdb680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 -- 172.21.15.17:0/2042835615 shutdown_connections 2024-09-16T00:59:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.935+0000 7fdb6e112640 1 -- 172.21.15.17:0/2042835615 wait complete. 2024-09-16T00:59:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 Processor -- start 2024-09-16T00:59:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 -- start start 2024-09-16T00:59:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68102e00 0x7fdb680745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 0x7fdb68074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6810d780 con 0x7fdb68101c00 2024-09-16T00:59:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6810d600 con 0x7fdb68102e00 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb6e112640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6810d900 con 0x7fdb681037c0 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45616/0 (socket says 172.21.15.17:45616) 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb677fe640 1 -- 172.21.15.17:0/3285503789 learned_addr learned my addr 172.21.15.17:0/3285503789 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb67fff640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 0x7fdb68074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.936+0000 7fdb66ffd640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68102e00 0x7fdb680745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 -- 172.21.15.17:0/3285503789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 msgr2=0x7fdb68074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 0x7fdb68074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 -- 172.21.15.17:0/3285503789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68102e00 msgr2=0x7fdb680745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68102e00 0x7fdb680745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 -- 172.21.15.17:0/3285503789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb680753e0 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb677fe640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d770 tx=0x7fdb5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50017070 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb50009c30 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003d00 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb681a1f60 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.937+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb681a2350 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.938+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb68108fb0 con 0x7fdb68101c00 2024-09-16T00:59:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.939+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdb50003ea0 con 0x7fdb68101c00 2024-09-16T00:59:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.940+0000 7fdb64ff9640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 0x7fdb540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.940+0000 7fdb66ffd640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 0x7fdb540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.940+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fdb500cefd0 con 0x7fdb68101c00 2024-09-16T00:59:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.941+0000 7fdb66ffd640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 0x7fdb540a5700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb580314e0 tx=0x7fdb58005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:32.944+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb50009de0 con 0x7fdb68101c00 2024-09-16T00:59:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.120+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdb6802d990 con 0x7fdb68101c00 2024-09-16T00:59:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.120+0000 7fdb64ff9640 1 -- 172.21.15.17:0/3285503789 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fdb5009bc80 con 0x7fdb68101c00 2024-09-16T00:59:33.122 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 msgr2=0x7fdb540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 0x7fdb540a5700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb580314e0 tx=0x7fdb58005a20 comp rx=0 tx=0).stop 2024-09-16T00:59:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 msgr2=0x7fdb68075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d770 tx=0x7fdb5000dc30 comp rx=0 tx=0).stop 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 shutdown_connections 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdb540a3240 0x7fdb540a5700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb681037c0 0x7fdb68074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb68102e00 0x7fdb680745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 --2- 172.21.15.17:0/3285503789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb68101c00 0x7fdb68075f90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 >> 172.21.15.17:0/3285503789 conn(0x7fdb680fd390 msgr2=0x7fdb68106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 shutdown_connections 2024-09-16T00:59:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:33.122+0000 7fdb6e112640 1 -- 172.21.15.17:0/3285503789 wait complete. 2024-09-16T00:59:33.636 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3285503789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3285503789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:33.643 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3285503789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:33.950 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726448351,"num_in_osds":12,"osd_in_since":1726448353,"num_remapped_pgs":0} 2024-09-16T00:59:34.393 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 00:59:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T00:59:34.169+0000 7faf7cd9b640 -1 osd.11 0 log_to_monitors true 2024-09-16T00:59:34.642 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:34 smithi154 ceph-mon[34759]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:34.643 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:34 smithi154 ceph-mon[34759]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.643 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:34 smithi154 ceph-mon[34759]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:34 smithi088 ceph-mon[34093]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:34.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:34 smithi088 ceph-mon[34093]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:34 smithi088 ceph-mon[34093]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:34 smithi017 ceph-mon[31211]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:34 smithi017 ceph-mon[31211]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:34 smithi017 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T00:59:34.951 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:59:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:35.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:59:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:59:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 -- 172.21.15.17:0/2463041822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 msgr2=0x7f54f0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 --2- 172.21.15.17:0/2463041822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0100ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009900 tx=0x7f54e002a410 comp rx=0 tx=0).stop 2024-09-16T00:59:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 -- 172.21.15.17:0/2463041822 shutdown_connections 2024-09-16T00:59:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 --2- 172.21.15.17:0/2463041822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0102690 0x7f54f0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 --2- 172.21.15.17:0/2463041822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0101cd0 0x7f54f0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 --2- 172.21.15.17:0/2463041822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0100ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 -- 172.21.15.17:0/2463041822 >> 172.21.15.17:0/2463041822 conn(0x7f54f00fc280 msgr2=0x7f54f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 -- 172.21.15.17:0/2463041822 shutdown_connections 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.726+0000 7f54f48ff640 1 -- 172.21.15.17:0/2463041822 wait complete. 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 Processor -- start 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 -- start start 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0101cd0 0x7f54f0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 0x7f54f019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010c610 con 0x7f54f0100ad0 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010c490 con 0x7f54f0102690 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54f48ff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010c790 con 0x7f54f0101cd0 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45628/0 (socket says 172.21.15.17:45628) 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 -- 172.21.15.17:0/4205889134 learned_addr learned my addr 172.21.15.17:0/4205889134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54edd9b640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0101cd0 0x7f54f0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54eed9d640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 0x7f54f019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 -- 172.21.15.17:0/4205889134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0101cd0 msgr2=0x7f54f0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0101cd0 0x7f54f0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 -- 172.21.15.17:0/4205889134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 msgr2=0x7f54f019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 0x7f54f019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54ee59c640 1 -- 172.21.15.17:0/4205889134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f019fa20 con 0x7f54f0100ad0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.727+0000 7f54eed9d640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 0x7f54f019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54ee59c640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54e00314e0 tx=0x7f54e00042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e003f030 con 0x7f54f0100ad0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54e0003cb0 con 0x7f54f0100ad0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0035070 con 0x7f54f0100ad0 2024-09-16T00:59:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f019fcb0 con 0x7f54f0100ad0 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.728+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01a0140 con 0x7f54f0100ad0 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.729+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f01a0310 con 0x7f54f0100ad0 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.730+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f54e0042030 con 0x7f54f0100ad0 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.731+0000 7f54e77fe640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 0x7f54dc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.731+0000 7f54edd9b640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 0x7f54dc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.731+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7f54e00ef960 con 0x7f54f0100ad0 2024-09-16T00:59:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.731+0000 7f54edd9b640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 0x7f54dc0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f54f0199310 tx=0x7f54d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.735+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54e00bcba0 con 0x7f54f0100ad0 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:59:35.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:35.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:35.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:35.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.911+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f54f01a0ae0 con 0x7f54f0100ad0 2024-09-16T00:59:35.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.911+0000 7f54e77fe640 1 -- 172.21.15.17:0/4205889134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f54e00bc4a0 con 0x7f54f0100ad0 2024-09-16T00:59:35.912 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 msgr2=0x7f54dc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 0x7f54dc0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f54f0199310 tx=0x7f54d800a2d0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 msgr2=0x7f54f0197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54e00314e0 tx=0x7f54e00042e0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 shutdown_connections 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f54dc0a32f0 0x7f54dc0a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54f0102690 0x7f54f019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54f0101cd0 0x7f54f0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 --2- 172.21.15.17:0/4205889134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f0100ad0 0x7f54f0197df0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 >> 172.21.15.17:0/4205889134 conn(0x7f54f00fc280 msgr2=0x7f54f0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:35.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 shutdown_connections 2024-09-16T00:59:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:35.913+0000 7f54f48ff640 1 -- 172.21.15.17:0/4205889134 wait complete. 2024-09-16T00:59:36.154 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T00:59:35.770+0000 7faf78d1e640 -1 osd.11 0 waiting for initial osdmap 2024-09-16T00:59:36.154 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 00:59:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T00:59:35.781+0000 7faf70b3e640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:59:36.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:36.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: Detected new or changed devices on smithi154 2024-09-16T00:59:36.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-16T00:59:36.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:59:36.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T00:59:36.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:36.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='osd.11 ' entity='osd.11' 2024-09-16T00:59:36.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:36 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4205889134' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: Detected new or changed devices on smithi154 2024-09-16T00:59:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-16T00:59:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:59:36.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='osd.11 ' entity='osd.11' 2024-09-16T00:59:36.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:36 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4205889134' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:36.725 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726448351,"num_in_osds":12,"osd_in_since":1726448353,"num_remapped_pgs":0} 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: Detected new or changed devices on smithi154 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:36.894 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:36.895 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:36.895 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:36.895 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:36.895 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='osd.11 ' entity='osd.11' 2024-09-16T00:59:36.895 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:36 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4205889134' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: purged_snaps scrub starts 2024-09-16T00:59:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: purged_snaps scrub ok 2024-09-16T00:59:37.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] boot 2024-09-16T00:59:37.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:59:37.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:37 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: purged_snaps scrub starts 2024-09-16T00:59:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: purged_snaps scrub ok 2024-09-16T00:59:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] boot 2024-09-16T00:59:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:59:37.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:37 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: purged_snaps scrub starts 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: purged_snaps scrub ok 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: osd.11 [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] boot 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: osdmap e74: 12 total, 12 up, 12 in 2024-09-16T00:59:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:37 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T00:59:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 -- 172.21.15.17:0/1621727454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 msgr2=0x7fb854100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 --2- 172.21.15.17:0/1621727454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854100690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb850009900 tx=0x7fb85002a410 comp rx=0 tx=0).stop 2024-09-16T00:59:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 -- 172.21.15.17:0/1621727454 shutdown_connections 2024-09-16T00:59:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 --2- 172.21.15.17:0/1621727454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101e50 0x7fb8541086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 --2- 172.21.15.17:0/1621727454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101490 0x7fb854101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 --2- 172.21.15.17:0/1621727454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854100690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 -- 172.21.15.17:0/1621727454 >> 172.21.15.17:0/1621727454 conn(0x7fb8540fba40 msgr2=0x7fb8540fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 -- 172.21.15.17:0/1621727454 shutdown_connections 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.603+0000 7fb85c766640 1 -- 172.21.15.17:0/1621727454 wait complete. 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 Processor -- start 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 -- start start 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 0x7fb8541984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 0x7fb85419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb85410b5c0 con 0x7fb854100290 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb85410b440 con 0x7fb854101e50 2024-09-16T00:59:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85c766640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb85410b740 con 0x7fb854101490 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85a502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85a502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45652/0 (socket says 172.21.15.17:45652) 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85a502640 1 -- 172.21.15.17:0/4039395883 learned_addr learned my addr 172.21.15.17:0/4039395883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.604+0000 7fb85ad03640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 0x7fb85419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb859d01640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 0x7fb8541984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 -- 172.21.15.17:0/4039395883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 msgr2=0x7fb8541984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 0x7fb8541984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 -- 172.21.15.17:0/4039395883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 msgr2=0x7fb85419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 0x7fb85419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 -- 172.21.15.17:0/4039395883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85419fba0 con 0x7fb854100290 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85ad03640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 0x7fb85419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb859d01640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 0x7fb8541984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85a502640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb850004270 tx=0x7fb850031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85003f030 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85419fe30 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb850003cb0 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850035070 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.605+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8541a02b0 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.606+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8541a04e0 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.607+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb850042030 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.608+0000 7fb84b7fe640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 0x7fb8400a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.608+0000 7fb859d01640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 0x7fb8400a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.608+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb8500eff60 con 0x7fb854100290 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.608+0000 7fb859d01640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 0x7fb8400a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb844006fd0 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.611+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8500bd080 con 0x7fb854100290 2024-09-16T00:59:38.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.789+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb8541a0830 con 0x7fb854100290 2024-09-16T00:59:38.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.790+0000 7fb84b7fe640 1 -- 172.21.15.17:0/4039395883 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fb8500bc980 con 0x7fb854100290 2024-09-16T00:59:38.790 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 msgr2=0x7fb8400a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 0x7fb8400a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb844006fd0 tx=0x7fb844008040 comp rx=0 tx=0).stop 2024-09-16T00:59:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 msgr2=0x7fb854197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb850004270 tx=0x7fb850031a30 comp rx=0 tx=0).stop 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 shutdown_connections 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8400a3270 0x7fb8400a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb854101e50 0x7fb85419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb854101490 0x7fb8541984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 --2- 172.21.15.17:0/4039395883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb854100290 0x7fb854197f70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 >> 172.21.15.17:0/4039395883 conn(0x7fb8540fba40 msgr2=0x7fb854106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 shutdown_connections 2024-09-16T00:59:38.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:38.792+0000 7fb85c766640 1 -- 172.21.15.17:0/4039395883 wait complete. 2024-09-16T00:59:39.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:38 smithi088 ceph-mon[34093]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:39.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:38 smithi088 ceph-mon[34093]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:59:39.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:38 smithi154 ceph-mon[34759]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:39.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:38 smithi154 ceph-mon[34759]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:59:39.158 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:38 smithi017 ceph-mon[31211]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-16T00:59:39.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:38 smithi017 ceph-mon[31211]: osdmap e75: 12 total, 12 up, 12 in 2024-09-16T00:59:39.510 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726448376,"num_in_osds":12,"osd_in_since":1726448353,"num_remapped_pgs":0} 2024-09-16T00:59:39.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:59:39.767 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:40.042 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:39 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4039395883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:40.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:39 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4039395883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:40.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:39 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4039395883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 -- 172.21.15.17:0/4268410725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4101de0 msgr2=0x7f26d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 --2- 172.21.15.17:0/4268410725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4101de0 0x7f26d41021c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009900 tx=0x7f26d002a410 comp rx=0 tx=0).stop 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 -- 172.21.15.17:0/4268410725 shutdown_connections 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 --2- 172.21.15.17:0/4268410725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4106f10 0x7f26d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 --2- 172.21.15.17:0/4268410725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4102790 0x7f26d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 --2- 172.21.15.17:0/4268410725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4101de0 0x7f26d41021c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.269+0000 7f26db2ad640 1 -- 172.21.15.17:0/4268410725 >> 172.21.15.17:0/4268410725 conn(0x7f26d40fd8c0 msgr2=0x7f26d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- 172.21.15.17:0/4268410725 shutdown_connections 2024-09-16T00:59:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- 172.21.15.17:0/4268410725 wait complete. 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 Processor -- start 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- start start 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4101de0 0x7f26d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4102790 0x7f26d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4111ec0 con 0x7f26d4106f10 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4111d40 con 0x7f26d4101de0 2024-09-16T00:59:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.270+0000 7f26db2ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4112040 con 0x7f26d4102790 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45666/0 (socket says 172.21.15.17:45666) 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 -- 172.21.15.17:0/3222133085 learned_addr learned my addr 172.21.15.17:0/3222133085 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d9049640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4101de0 0x7f26d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d8848640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4102790 0x7f26d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 -- 172.21.15.17:0/3222133085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4102790 msgr2=0x7f26d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4102790 0x7f26d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 -- 172.21.15.17:0/3222133085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4101de0 msgr2=0x7f26d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4101de0 0x7f26d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 -- 172.21.15.17:0/3222133085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d41a6a20 con 0x7f26d4106f10 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26d984a640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b970 tx=0x7f26cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc019070 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d41a6d10 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26cc014440 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0075d0 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.271+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d41a7200 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.272+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d4102240 con 0x7f26d4106f10 2024-09-16T00:59:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.274+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f26cc01c070 con 0x7f26d4106f10 2024-09-16T00:59:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.274+0000 7f26ca7fc640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 0x7f26c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.274+0000 7f26d9049640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 0x7f26c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.274+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f26cc0cee70 con 0x7f26d4106f10 2024-09-16T00:59:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.275+0000 7f26d9049640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 0x7f26c00a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26d0031440 tx=0x7f26d0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.277+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26cc09b9e0 con 0x7f26d4106f10 2024-09-16T00:59:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.455+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26d4075a20 con 0x7f26d4106f10 2024-09-16T00:59:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.456+0000 7f26ca7fc640 1 -- 172.21.15.17:0/3222133085 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18394 (secure 0 0 0) 0x7f26d4075a20 con 0x7f26d4106f10 2024-09-16T00:59:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:40.457 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":75,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T00:59:37.775785+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 msgr2=0x7f26c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 0x7f26c00a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26d0031440 tx=0x7f26d0005e80 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 msgr2=0x7f26d4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b970 tx=0x7f26cc00be30 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 shutdown_connections 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26c00a3240 0x7f26c00a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d4106f10 0x7f26d4074f70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d4102790 0x7f26d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 --2- 172.21.15.17:0/3222133085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26d4101de0 0x7f26d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 >> 172.21.15.17:0/3222133085 conn(0x7f26d40fd8c0 msgr2=0x7f26d40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 shutdown_connections 2024-09-16T00:59:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:40.458+0000 7f26db2ad640 1 -- 172.21.15.17:0/3222133085 wait complete. 2024-09-16T00:59:41.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:40 smithi088 ceph-mon[34093]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:41.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:40 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3222133085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:40 smithi154 ceph-mon[34759]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:40 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3222133085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:41.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:40 smithi017 ceph-mon[31211]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:41.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:40 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3222133085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:59:41.304 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:55:49.344475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T00:59:41.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T00:59:41.562 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.040+0000 7f73d2058640 1 -- 172.21.15.17:0/2150025688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 msgr2=0x7f73cc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.040+0000 7f73d2058640 1 --2- 172.21.15.17:0/2150025688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc10eaf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009cd0 tx=0x7f73c402a8e0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 -- 172.21.15.17:0/2150025688 shutdown_connections 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 --2- 172.21.15.17:0/2150025688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc10eaf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 --2- 172.21.15.17:0/2150025688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100d00 0x7f73cc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 --2- 172.21.15.17:0/2150025688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100350 0x7f73cc100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 -- 172.21.15.17:0/2150025688 >> 172.21.15.17:0/2150025688 conn(0x7f73cc077210 msgr2=0x7f73cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 -- 172.21.15.17:0/2150025688 shutdown_connections 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 -- 172.21.15.17:0/2150025688 wait complete. 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 Processor -- start 2024-09-16T00:59:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.041+0000 7f73d2058640 1 -- start start 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100350 0x7f73cc1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 0x7f73cc101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111e50 con 0x7f73cc106f50 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111cd0 con 0x7f73cc100d00 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111fd0 con 0x7f73cc100350 2024-09-16T00:59:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47652/0 (socket says 172.21.15.17:47652) 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 -- 172.21.15.17:0/3096718704 learned_addr learned my addr 172.21.15.17:0/3096718704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cb7fe640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100350 0x7f73cc1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73c3fff640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 0x7f73cc101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 -- 172.21.15.17:0/3096718704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100350 msgr2=0x7f73cc1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100350 0x7f73cc1012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 -- 172.21.15.17:0/3096718704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 msgr2=0x7f73cc101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 0x7f73cc101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 -- 172.21.15.17:0/3096718704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc1a6870 con 0x7f73cc106f50 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73c3fff640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 0x7f73cc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73cbfff640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005cc0 tx=0x7f73c4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4004450 con 0x7f73cc106f50 2024-09-16T00:59:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73c4031c90 con 0x7f73cc106f50 2024-09-16T00:59:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc1a6b00 con 0x7f73cc106f50 2024-09-16T00:59:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.042+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c403b400 con 0x7f73cc106f50 2024-09-16T00:59:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.043+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1a7090 con 0x7f73cc106f50 2024-09-16T00:59:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.044+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73cc100730 con 0x7f73cc106f50 2024-09-16T00:59:42.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.045+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f73c4004680 con 0x7f73cc106f50 2024-09-16T00:59:42.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.045+0000 7f73c97fa640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 0x7f73b80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:42.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.045+0000 7f73cb7fe640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 0x7f73b80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:42.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.045+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f73c402e030 con 0x7f73cc106f50 2024-09-16T00:59:42.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.046+0000 7f73cb7fe640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 0x7f73b80a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73bc005fd0 tx=0x7f73bc00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:42.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.050+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73c4038310 con 0x7f73cc106f50 2024-09-16T00:59:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.223+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73cc10a140 con 0x7f73cc106f50 2024-09-16T00:59:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.223+0000 7f73c97fa640 1 -- 172.21.15.17:0/3096718704 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f73c40098b0 con 0x7f73cc106f50 2024-09-16T00:59:42.224 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-16T00:59:42.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.226+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 msgr2=0x7f73b80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:42.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.226+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 0x7f73b80a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f73bc005fd0 tx=0x7f73bc00b590 comp rx=0 tx=0).stop 2024-09-16T00:59:42.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.226+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 msgr2=0x7f73cc101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.226+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005cc0 tx=0x7f73c4003c20 comp rx=0 tx=0).stop 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 shutdown_connections 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f73b80a32c0 0x7f73b80a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73cc106f50 0x7f73cc101d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73cc100d00 0x7f73cc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 --2- 172.21.15.17:0/3096718704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73cc100350 0x7f73cc1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 >> 172.21.15.17:0/3096718704 conn(0x7f73cc077210 msgr2=0x7f73cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 shutdown_connections 2024-09-16T00:59:42.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:42.227+0000 7f73d2058640 1 -- 172.21.15.17:0/3096718704 wait complete. 2024-09-16T00:59:43.003 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:42 smithi017 ceph-mon[31211]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:43.003 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:42 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3096718704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:59:43.032 INFO:tasks.cephadm:Adding mds.a on smithi017 2024-09-16T00:59:43.032 INFO:tasks.cephadm:Adding mds.d on smithi017 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.g on smithi017 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.j on smithi017 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.b on smithi088 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.e on smithi088 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.h on smithi088 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.k on smithi088 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.c on smithi154 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.f on smithi154 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.i on smithi154 2024-09-16T00:59:43.033 INFO:tasks.cephadm:Adding mds.l on smithi154 2024-09-16T00:59:43.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l' 2024-09-16T00:59:43.062 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:42 smithi154 ceph-mon[34759]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:43.062 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:42 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3096718704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:59:43.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:42 smithi088 ceph-mon[34093]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:43.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:42 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3096718704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:59:43.292 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T00:59:43.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- 172.21.15.154:0/1924079770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 msgr2=0x7f09fc10a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 --2- 172.21.15.154:0/1924079770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc10a070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009ca0 tx=0x7f09f402a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- 172.21.15.154:0/1924079770 shutdown_connections 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 --2- 172.21.15.154:0/1924079770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc10a070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 --2- 172.21.15.154:0/1924079770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 0x7f09fc1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 --2- 172.21.15.154:0/1924079770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- 172.21.15.154:0/1924079770 >> 172.21.15.154:0/1924079770 conn(0x7f09fc0fd3b0 msgr2=0x7f09fc0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- 172.21.15.154:0/1924079770 shutdown_connections 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- 172.21.15.154:0/1924079770 wait complete. 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 Processor -- start 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.776+0000 7f0a026d7640 1 -- start start 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 0x7f09fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10d730 con 0x7f09fc101c20 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10d5b0 con 0x7f09fc102e20 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a026d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10d8b0 con 0x7f09fc1037e0 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57526/0 (socket says 172.21.15.154:57526) 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 -- 172.21.15.154:0/13236004 learned_addr learned my addr 172.21.15.154:0/13236004 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f09fb7fe640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 0x7f09fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f09fbfff640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 -- 172.21.15.154:0/13236004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 msgr2=0x7f09fc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 0x7f09fc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 -- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 msgr2=0x7f09fc075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 -- 172.21.15.154:0/13236004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc0753e0 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f09fbfff640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.777+0000 7f0a00c74640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009dc0 tx=0x7f09f4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.778+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4032ec0 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.778+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc1a1ef0 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.778+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09f40044f0 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.778+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4030d40 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.778+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc1a23a0 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.779+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09fc109070 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.780+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f09f4004040 con 0x7f09fc1037e0 2024-09-16T00:59:43.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.780+0000 7f09f97fa640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 0x7f09e40a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.781+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f09f40f0a60 con 0x7f09fc1037e0 2024-09-16T00:59:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.781+0000 7f09fbfff640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 0x7f09e40a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.781+0000 7f09fbfff640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 0x7f09e40a58a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09fc102c80 tx=0x7f09ec005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.785+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09f40bdc20 con 0x7f09fc1037e0 2024-09-16T00:59:43.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.989+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}) -- 0x7f09fc062730 con 0x7f09e40a33e0 2024-09-16T00:59:43.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.996+0000 7f09f97fa640 1 -- 172.21.15.154:0/13236004 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f09fc062730 con 0x7f09e40a33e0 2024-09-16T00:59:43.997 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mds.all update... 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 msgr2=0x7f09e40a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 0x7f09e40a58a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09fc102c80 tx=0x7f09ec005e70 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 msgr2=0x7f09fc074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009dc0 tx=0x7f09f4003ba0 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 shutdown_connections 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f09e40a33e0 0x7f09e40a58a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc1037e0 0x7f09fc074b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09fc102e20 0x7f09fc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 --2- 172.21.15.154:0/13236004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09fc101c20 0x7f09fc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 >> 172.21.15.154:0/13236004 conn(0x7f09fc0fd3b0 msgr2=0x7f09fc106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 shutdown_connections 2024-09-16T00:59:44.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-16T00:59:43.999+0000 7f0a026d7640 1 -- 172.21.15.154:0/13236004 wait complete. 2024-09-16T00:59:44.654 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.a.service 2024-09-16T00:59:44.656 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.d.service 2024-09-16T00:59:44.699 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.g.service 2024-09-16T00:59:44.742 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.j.service 2024-09-16T00:59:44.785 DEBUG:teuthology.orchestra.run.smithi088:mds.b> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.b.service 2024-09-16T00:59:44.787 DEBUG:teuthology.orchestra.run.smithi088:mds.e> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.e.service 2024-09-16T00:59:44.831 DEBUG:teuthology.orchestra.run.smithi088:mds.h> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.h.service 2024-09-16T00:59:44.873 DEBUG:teuthology.orchestra.run.smithi088:mds.k> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.k.service 2024-09-16T00:59:44.917 DEBUG:teuthology.orchestra.run.smithi154:mds.c> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.c.service 2024-09-16T00:59:44.920 DEBUG:teuthology.orchestra.run.smithi154:mds.f> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.f.service 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:44.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:44 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:44.963 DEBUG:teuthology.orchestra.run.smithi154:mds.i> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.i.service 2024-09-16T00:59:45.007 DEBUG:teuthology.orchestra.run.smithi154:mds.l> sudo journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.l.service 2024-09-16T00:59:45.049 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-16T00:59:45.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:45.057 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:44 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:45.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:44 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:45.302 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:45.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 -- 172.21.15.17:0/2822055086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568410c2f0 msgr2=0x7f568410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 --2- 172.21.15.17:0/2822055086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568410c2f0 0x7f568410e790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f567c009ca0 tx=0x7f567c02a8c0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 -- 172.21.15.17:0/2822055086 shutdown_connections 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 --2- 172.21.15.17:0/2822055086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f568410c2f0 0x7f568410e790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 --2- 172.21.15.17:0/2822055086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56841037a0 0x7f568410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 --2- 172.21.15.17:0/2822055086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 0x7f56841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.806+0000 7f5689d01640 1 -- 172.21.15.17:0/2822055086 >> 172.21.15.17:0/2822055086 conn(0x7f56840fc7d0 msgr2=0x7f56840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.807+0000 7f5689d01640 1 -- 172.21.15.17:0/2822055086 shutdown_connections 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.807+0000 7f5689d01640 1 -- 172.21.15.17:0/2822055086 wait complete. 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.807+0000 7f5689d01640 1 Processor -- start 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.807+0000 7f5689d01640 1 -- start start 2024-09-16T00:59:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 0x7f56841984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 0x7f568419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5684112010 con 0x7f56841037a0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5684111e90 con 0x7f568410c2f0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5689d01640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5684112190 con 0x7f5684102df0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47666/0 (socket says 172.21.15.17:47666) 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5683fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 0x7f568419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 -- 172.21.15.17:0/2571619527 learned_addr learned my addr 172.21.15.17:0/2571619527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f56837fe640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 0x7f56841984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 -- 172.21.15.17:0/2571619527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 msgr2=0x7f56841984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 0x7f56841984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 -- 172.21.15.17:0/2571619527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 msgr2=0x7f568419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 0x7f568419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 -- 172.21.15.17:0/2571619527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568419d4a0 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5683fff640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 0x7f568419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.808+0000 7f5682ffd640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9f0 tx=0x7f567800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.809+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567800ccc0 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.809+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56780108e0 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.809+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568419d790 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.809+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780187e0 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.809+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56841a5070 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.810+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56841031d0 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.811+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5678010a90 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.811+0000 7f5680ff9640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 0x7f566c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.812+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f56780cf690 con 0x7f56841037a0 2024-09-16T00:59:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.812+0000 7f56837fe640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 0x7f566c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.812+0000 7f56837fe640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 0x7f566c0a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5674009bd0 tx=0x7f5674005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:45.816+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f567809c200 con 0x7f56841037a0 2024-09-16T00:59:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:45 smithi154 ceph-mon[34759]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:45 smithi154 ceph-mon[34759]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-16T00:59:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:45 smithi154 ceph-mon[34759]: Deploying daemon mds.l on smithi154 2024-09-16T00:59:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.029+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56841072c0 con 0x7f56841037a0 2024-09-16T00:59:46.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:45 smithi017 ceph-mon[31211]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:46.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:45 smithi017 ceph-mon[31211]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-16T00:59:46.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:45 smithi017 ceph-mon[31211]: Deploying daemon mds.l on smithi154 2024-09-16T00:59:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.030+0000 7f5680ff9640 1 -- 172.21.15.17:0/2571619527 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f56780a0500 con 0x7f56841037a0 2024-09-16T00:59:46.031 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:46.031 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-16T00:52:47:071837+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-16T00:59:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-16T00:59:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 msgr2=0x7f566c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 0x7f566c0a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5674009bd0 tx=0x7f5674005f90 comp rx=0 tx=0).stop 2024-09-16T00:59:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 msgr2=0x7f5684198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9f0 tx=0x7f567800eeb0 comp rx=0 tx=0).stop 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 shutdown_connections 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f566c0a32c0 0x7f566c0a5780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f568410c2f0 0x7f568419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56841037a0 0x7f5684198a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 --2- 172.21.15.17:0/2571619527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5684102df0 0x7f56841984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 >> 172.21.15.17:0/2571619527 conn(0x7f56840fc7d0 msgr2=0x7f56840fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 shutdown_connections 2024-09-16T00:59:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:46.033+0000 7f5689d01640 1 -- 172.21.15.17:0/2571619527 wait complete. 2024-09-16T00:59:46.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:45 smithi088 ceph-mon[34093]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:46.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:45 smithi088 ceph-mon[34093]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-16T00:59:46.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:45 smithi088 ceph-mon[34093]: Deploying daemon mds.l on smithi154 2024-09-16T00:59:46.615 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 systemd[1]: Starting Ceph mds.l for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:59:46.878 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:46 smithi154 ceph-mon[34759]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:46.878 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:46 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2571619527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:46.878 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 podman[64453]: 2024-09-16 00:59:46.517994309 +0000 UTC m=+0.016134547 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:59:46.878 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 podman[64453]: 2024-09-16 00:59:46.623916766 +0000 UTC m=+0.122057001 container create cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-16T00:59:46.878 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 podman[64453]: 2024-09-16 00:59:46.851908561 +0000 UTC m=+0.350048798 container init cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T00:59:46.879 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 podman[64453]: 2024-09-16 00:59:46.854766387 +0000 UTC m=+0.352906628 container start cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-16T00:59:47.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:46 smithi088 ceph-mon[34093]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:47.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:46 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2571619527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:47.153 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 ceph-mds[64472]: -- 172.21.15.154:0/1034295836 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc9c467860 con 0x55fc9c444800 2024-09-16T00:59:47.153 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: starting mds.l at 2024-09-16T00:59:47.153 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 bash[64453]: cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c 2024-09-16T00:59:47.153 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 00:59:46 smithi154 systemd[1]: Started Ceph mds.l for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:59:47.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:46 smithi017 ceph-mon[31211]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:47.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:46 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2571619527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6832/1776584751,v1:172.21.15.154:6833/1776584751] up:boot 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: fsmap 1 up:standby 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:47 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6832/1776584751,v1:172.21.15.154:6833/1776584751] up:boot 2024-09-16T00:59:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: fsmap 1 up:standby 2024-09-16T00:59:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:59:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:48.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:48.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:47 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6832/1776584751,v1:172.21.15.154:6833/1776584751] up:boot 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: fsmap 1 up:standby 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:48.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:48.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:48.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:47 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:48.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:59:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:49.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:48 smithi088 ceph-mon[34093]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:49.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:48 smithi088 ceph-mon[34093]: Deploying daemon mds.k on smithi088 2024-09-16T00:59:49.144 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 systemd[1]: Starting Ceph mds.k for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:59:49.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:48 smithi154 ceph-mon[34759]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:49.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:48 smithi154 ceph-mon[34759]: Deploying daemon mds.k on smithi088 2024-09-16T00:59:49.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:48 smithi017 ceph-mon[31211]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:49.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:48 smithi017 ceph-mon[31211]: Deploying daemon mds.k on smithi088 2024-09-16T00:59:49.498 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 podman[63424]: 2024-09-16 00:59:49.116112069 +0000 UTC m=+0.015950704 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:59:49.498 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 podman[63424]: 2024-09-16 00:59:49.253078355 +0000 UTC m=+0.152934720 container create 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:59:49.498 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 podman[63424]: 2024-09-16 00:59:49.497740177 +0000 UTC m=+0.397578803 container init 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T00:59:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 -- 172.21.15.17:0/582127285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64100a80 msgr2=0x7ffb64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 --2- 172.21.15.17:0/582127285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64100a80 0x7ffb64100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009930 tx=0x7ffb5402a420 comp rx=0 tx=0).stop 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 -- 172.21.15.17:0/582127285 shutdown_connections 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 --2- 172.21.15.17:0/582127285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 0x7ffb6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 --2- 172.21.15.17:0/582127285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64100a80 0x7ffb64100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 --2- 172.21.15.17:0/582127285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64106a80 0x7ffb64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 -- 172.21.15.17:0/582127285 >> 172.21.15.17:0/582127285 conn(0x7ffb640fc7a0 msgr2=0x7ffb640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 -- 172.21.15.17:0/582127285 shutdown_connections 2024-09-16T00:59:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 -- 172.21.15.17:0/582127285 wait complete. 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.598+0000 7ffb6be90640 1 Processor -- start 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 -- start start 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64100a80 0x7ffb64199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 0x7ffb641997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64110d30 con 0x7ffb64106a80 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64110bb0 con 0x7ffb64101420 2024-09-16T00:59:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6be90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64110eb0 con 0x7ffb64100a80 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb69c2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64100a80 0x7ffb64199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47684/0 (socket says 172.21.15.17:47684) 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 -- 172.21.15.17:0/3165667852 learned_addr learned my addr 172.21.15.17:0/3165667852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6942b640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 0x7ffb641997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 -- 172.21.15.17:0/3165667852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64100a80 msgr2=0x7ffb64199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64100a80 0x7ffb64199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 -- 172.21.15.17:0/3165667852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 msgr2=0x7ffb641997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 0x7ffb641997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 -- 172.21.15.17:0/3165667852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb641a4840 con 0x7ffb64106a80 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.599+0000 7ffb6a42d640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00efd0 tx=0x7ffb5c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.600+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c003b70 con 0x7ffb64106a80 2024-09-16T00:59:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.600+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb5c003d10 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.600+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c010980 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.600+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb641a4a10 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.600+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641a4ed0 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.601+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64100ee0 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.602+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffb5c004b40 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.602+0000 7ffb5affd640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 0x7ffb500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.603+0000 7ffb69c2c640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 0x7ffb500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.603+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ffb5c0cfbc0 con 0x7ffb64106a80 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.603+0000 7ffb69c2c640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 0x7ffb500a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.606+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb5c09cd80 con 0x7ffb64106a80 2024-09-16T00:59:49.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.822+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb6406ad80 con 0x7ffb64106a80 2024-09-16T00:59:49.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.823+0000 7ffb5affd640 1 -- 172.21.15.17:0/3165667852 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7ffb6406ad80 con 0x7ffb64106a80 2024-09-16T00:59:49.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:49.824 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"btime":"2024-09-16T00:59:46:883016+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T00:59:49.824 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 msgr2=0x7ffb500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 0x7ffb500a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb6000b390 comp rx=0 tx=0).stop 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 msgr2=0x7ffb641a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00efd0 tx=0x7ffb5c00c6a0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 shutdown_connections 2024-09-16T00:59:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb500a32c0 0x7ffb500a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64106a80 0x7ffb641a4300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb64101420 0x7ffb641997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 --2- 172.21.15.17:0/3165667852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb64100a80 0x7ffb64199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.825+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 >> 172.21.15.17:0/3165667852 conn(0x7ffb640fc7a0 msgr2=0x7ffb640fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.826+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 shutdown_connections 2024-09-16T00:59:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:49.826+0000 7ffb6be90640 1 -- 172.21.15.17:0/3165667852 wait complete. 2024-09-16T00:59:49.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 podman[63424]: 2024-09-16 00:59:49.500674068 +0000 UTC m=+0.400512694 container start 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True) 2024-09-16T00:59:49.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 ceph-mds[63443]: -- 172.21.15.88:0/3795787661 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56144e597860 con 0x56144e575000 2024-09-16T00:59:49.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: starting mds.k at 2024-09-16T00:59:49.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 bash[63424]: 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 2024-09-16T00:59:49.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 00:59:49 smithi088 systemd[1]: Started Ceph mds.k for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:59:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: Deploying daemon mds.j on smithi017 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3165667852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6832/764220258,v1:172.21.15.88:6833/764220258] up:boot 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: fsmap 2 up:standby 2024-09-16T00:59:50.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:50 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:59:50.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:50.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.905 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: Deploying daemon mds.j on smithi017 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3165667852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6832/764220258,v1:172.21.15.88:6833/764220258] up:boot 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: fsmap 2 up:standby 2024-09-16T00:59:50.906 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:50 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: Deploying daemon mds.j on smithi017 2024-09-16T00:59:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3165667852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:51.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6832/764220258,v1:172.21.15.88:6833/764220258] up:boot 2024-09-16T00:59:51.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: fsmap 2 up:standby 2024-09-16T00:59:51.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:50 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T00:59:52.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:59:52.601 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 systemd[1]: Starting Ceph mds.j for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:59:52.868 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:52 smithi017 ceph-mon[31211]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:52.869 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 podman[68212]: 2024-09-16 00:59:52.502848366 +0000 UTC m=+0.016373887 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:59:52.869 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 podman[68212]: 2024-09-16 00:59:52.615536659 +0000 UTC m=+0.129062171 container create 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:59:52.869 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 podman[68212]: 2024-09-16 00:59:52.868630776 +0000 UTC m=+0.382156296 container init 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-16T00:59:52.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:52 smithi154 ceph-mon[34759]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:53.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:52 smithi088 ceph-mon[34093]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:53.187 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 podman[68212]: 2024-09-16 00:59:52.871868293 +0000 UTC m=+0.385393804 container start 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-16T00:59:53.187 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 ceph-mds[68261]: -- 172.21.15.17:0/2956507507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0b8a29860 con 0x55d0b8a07000 2024-09-16T00:59:53.187 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j[68245]: starting mds.j at 2024-09-16T00:59:53.187 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 bash[68212]: 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c 2024-09-16T00:59:53.187 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 00:59:52 smithi017 systemd[1]: Started Ceph mds.j for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 -- 172.21.15.17:0/249822086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240074590 msgr2=0x7fa240074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 --2- 172.21.15.17:0/249822086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240074590 0x7fa240074970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa230009900 tx=0x7fa23002a480 comp rx=0 tx=0).stop 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 -- 172.21.15.17:0/249822086 shutdown_connections 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 --2- 172.21.15.17:0/249822086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240112b90 0x7fa240114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 --2- 172.21.15.17:0/249822086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074eb0 0x7fa240112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 --2- 172.21.15.17:0/249822086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240074590 0x7fa240074970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 -- 172.21.15.17:0/249822086 >> 172.21.15.17:0/249822086 conn(0x7fa2400fd8c0 msgr2=0x7fa2400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 -- 172.21.15.17:0/249822086 shutdown_connections 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.645+0000 7fa244ee4640 1 -- 172.21.15.17:0/249822086 wait complete. 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 Processor -- start 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 -- start start 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074590 0x7fa2401a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240074eb0 0x7fa2401a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa240118500 con 0x7fa240112b90 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa240118380 con 0x7fa240074eb0 2024-09-16T00:59:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa244ee4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa240118680 con 0x7fa240074590 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa23ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.646+0000 7fa23ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38332/0 (socket says 172.21.15.17:38332) 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 -- 172.21.15.17:0/2111013806 learned_addr learned my addr 172.21.15.17:0/2111013806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23dd9b640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240074eb0 0x7fa2401a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23e59c640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074590 0x7fa2401a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 -- 172.21.15.17:0/2111013806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074590 msgr2=0x7fa2401a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074590 0x7fa2401a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 -- 172.21.15.17:0/2111013806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240074eb0 msgr2=0x7fa2401a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240074eb0 0x7fa2401a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 -- 172.21.15.17:0/2111013806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24019f0c0 con 0x7fa240112b90 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa23ed9d640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b9e0 tx=0x7fa23800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238019070 con 0x7fa240112b90 2024-09-16T00:59:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa238014440 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24019f3b0 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380125a0 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.647+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2401ab6a0 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.648+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2400749f0 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.649+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa23801c070 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.650+0000 7fa22f7fe640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 0x7fa2280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.650+0000 7fa23e59c640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 0x7fa2280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.650+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa2380cea10 con 0x7fa240112b90 2024-09-16T00:59:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.651+0000 7fa23e59c640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 0x7fa2280a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.656+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa23809bbd0 con 0x7fa240112b90 2024-09-16T00:59:53.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.870+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa24002d7c0 con 0x7fa240112b90 2024-09-16T00:59:53.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.870+0000 7fa22f7fe640 1 -- 172.21.15.17:0/2111013806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fa23809b4d0 con 0x7fa240112b90 2024-09-16T00:59:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:53.871 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"btime":"2024-09-16T00:59:53:649031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T00:59:53.871 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 msgr2=0x7fa2280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 0x7fa2280a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230031400 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 msgr2=0x7fa24019e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b9e0 tx=0x7fa23800bde0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 shutdown_connections 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2280a3240 0x7fa2280a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa240112b90 0x7fa24019e990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa240074eb0 0x7fa2401a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 --2- 172.21.15.17:0/2111013806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa240074590 0x7fa2401a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:53.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.872+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 >> 172.21.15.17:0/2111013806 conn(0x7fa2400fd8c0 msgr2=0x7fa2400ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:53.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.873+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 shutdown_connections 2024-09-16T00:59:53.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:53.873+0000 7fa244ee4640 1 -- 172.21.15.17:0/2111013806 wait complete. 2024-09-16T00:59:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: Deploying daemon mds.d on smithi017 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6834/2859386479,v1:172.21.15.17:6835/2859386479] up:boot 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: fsmap 3 up:standby 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:59:54.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:54 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2111013806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: Deploying daemon mds.d on smithi017 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6834/2859386479,v1:172.21.15.17:6835/2859386479] up:boot 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: fsmap 3 up:standby 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:59:54.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:54 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2111013806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:54.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: Deploying daemon mds.d on smithi017 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6834/2859386479,v1:172.21.15.17:6835/2859386479] up:boot 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: fsmap 3 up:standby 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T00:59:54.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:54 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2111013806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:56.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:56 smithi017 ceph-mon[31211]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:56.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:56 smithi088 ceph-mon[34093]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:56.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:56 smithi154 ceph-mon[34759]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:56.437 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 systemd[1]: Starting Ceph mds.d for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:59:56.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:59:56.811 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 podman[68625]: 2024-09-16 00:59:56.42382472 +0000 UTC m=+0.016581410 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:59:56.811 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 podman[68625]: 2024-09-16 00:59:56.542364074 +0000 UTC m=+0.135120751 container create 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T00:59:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T00:59:57.179 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 podman[68625]: 2024-09-16 00:59:56.811529318 +0000 UTC m=+0.404285996 container init 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T00:59:57.180 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 podman[68625]: 2024-09-16 00:59:56.814606735 +0000 UTC m=+0.407363417 container start 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T00:59:57.180 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 ceph-mds[68660]: -- 172.21.15.17:0/2391234145 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55794f1a9860 con 0x55794f187000 2024-09-16T00:59:57.180 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d[68640]: starting mds.d at 2024-09-16T00:59:57.180 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 bash[68625]: 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f 2024-09-16T00:59:57.180 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 00:59:56 smithi017 systemd[1]: Started Ceph mds.d for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T00:59:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 -- 172.21.15.17:0/3818881678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540102db0 msgr2=0x7f5540103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 --2- 172.21.15.17:0/3818881678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540102db0 0x7f5540103190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5538009930 tx=0x7f553802a420 comp rx=0 tx=0).stop 2024-09-16T00:59:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 -- 172.21.15.17:0/3818881678 shutdown_connections 2024-09-16T00:59:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 --2- 172.21.15.17:0/3818881678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 --2- 172.21.15.17:0/3818881678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540103760 0x7f5540107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 --2- 172.21.15.17:0/3818881678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540102db0 0x7f5540103190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 -- 172.21.15.17:0/3818881678 >> 172.21.15.17:0/3818881678 conn(0x7f55400fc7d0 msgr2=0x7f55400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 -- 172.21.15.17:0/3818881678 shutdown_connections 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.549+0000 7f5544d47640 1 -- 172.21.15.17:0/3818881678 wait complete. 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 Processor -- start 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 -- start start 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540102db0 0x7f5540198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5540111f60 con 0x7f5540103760 2024-09-16T00:59:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5540111de0 con 0x7f55401082e0 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f5544d47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55401120e0 con 0x7f5540102db0 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38348/0 (socket says 172.21.15.17:38348) 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 -- 172.21.15.17:0/3093797828 learned_addr learned my addr 172.21.15.17:0/3093797828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553e59c640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540102db0 0x7f5540198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 -- 172.21.15.17:0/3093797828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540102db0 msgr2=0x7f5540198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540102db0 0x7f5540198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 -- 172.21.15.17:0/3093797828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 msgr2=0x7f554019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.550+0000 7f553dd9b640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f553dd9b640 1 -- 172.21.15.17:0/3093797828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554019d4d0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f553ed9d640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f553dd9b640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f552800d750 tx=0x7f552800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528017070 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55280054d0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528004cf0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554019d7c0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.551+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55401a50a0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.552+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554006a7d0 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.554+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5528004e90 con 0x7f5540103760 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.555+0000 7f55377fe640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 0x7f552c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.555+0000 7f553e59c640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 0x7f552c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.555+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f55280cf0f0 con 0x7f5540103760 2024-09-16T00:59:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.555+0000 7f553e59c640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 0x7f552c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5538009900 tx=0x7f55380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.558+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f552809bce0 con 0x7f5540103760 2024-09-16T00:59:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.771+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f554010a2c0 con 0x7f5540103760 2024-09-16T00:59:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.772+0000 7f55377fe640 1 -- 172.21.15.17:0/3093797828 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f552809ffe0 con 0x7f5540103760 2024-09-16T00:59:57.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T00:59:57.773 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"btime":"2024-09-16T00:59:57:029664+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T00:59:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2024-09-16T00:59:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 msgr2=0x7f552c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 0x7f552c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5538009900 tx=0x7f55380058d0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 msgr2=0x7f5540198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f552800d750 tx=0x7f552800dc10 comp rx=0 tx=0).stop 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 shutdown_connections 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f552c0a32c0 0x7f552c0a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55401082e0 0x7f554019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5540103760 0x7f5540198a60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 --2- 172.21.15.17:0/3093797828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5540102db0 0x7f5540198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 >> 172.21.15.17:0/3093797828 conn(0x7f55400fc7d0 msgr2=0x7f5540105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 shutdown_connections 2024-09-16T00:59:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T00:59:57.774+0000 7f5544d47640 1 -- 172.21.15.17:0/3093797828 wait complete. 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: Deploying daemon mds.e on smithi088 2024-09-16T00:59:58.154 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6836/2668055103,v1:172.21.15.17:6837/2668055103] up:boot 2024-09-16T00:59:58.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: fsmap 4 up:standby 2024-09-16T00:59:58.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:59:58.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 00:59:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3093797828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:58.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:58.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: Deploying daemon mds.e on smithi088 2024-09-16T00:59:58.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6836/2668055103,v1:172.21.15.17:6837/2668055103] up:boot 2024-09-16T00:59:58.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: fsmap 4 up:standby 2024-09-16T00:59:58.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:59:58.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 00:59:57 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3093797828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:59:58.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: Deploying daemon mds.e on smithi088 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6836/2668055103,v1:172.21.15.17:6837/2668055103] up:boot 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: fsmap 4 up:standby 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T00:59:58.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 00:59:57 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3093797828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:59:59.143 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 systemd[1]: Starting Ceph mds.e for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T00:59:59.494 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 podman[63724]: 2024-09-16 00:59:59.13382826 +0000 UTC m=+0.015534599 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:59:59.494 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 podman[63724]: 2024-09-16 00:59:59.266118054 +0000 UTC m=+0.147824376 container create 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-16T00:59:59.494 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 podman[63724]: 2024-09-16 00:59:59.493686469 +0000 UTC m=+0.375392791 container init 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:59:59.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 podman[63724]: 2024-09-16 00:59:59.496943854 +0000 UTC m=+0.378650177 container start 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T00:59:59.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 ceph-mds[63743]: -- 172.21.15.88:0/504384551 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c4cc1a1860 con 0x55c4cc17f000 2024-09-16T00:59:59.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: starting mds.e at 2024-09-16T00:59:59.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 bash[63724]: 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d 2024-09-16T00:59:59.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 00:59:59 smithi088 systemd[1]: Started Ceph mds.e for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:00.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: Deploying daemon mds.f on smithi154 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:boot 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: fsmap 5 up:standby 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:00:00.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:00 smithi154 ceph-mon[34759]: overall HEALTH_OK 2024-09-16T01:00:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: Deploying daemon mds.f on smithi154 2024-09-16T01:00:00.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:boot 2024-09-16T01:00:00.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: fsmap 5 up:standby 2024-09-16T01:00:00.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:00:00.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:00 smithi017 ceph-mon[31211]: overall HEALTH_OK 2024-09-16T01:00:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: Deploying daemon mds.f on smithi154 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:boot 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: fsmap 5 up:standby 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:00:01.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:00 smithi088 ceph-mon[34093]: overall HEALTH_OK 2024-09-16T01:00:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 -- 172.21.15.17:0/643096229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 msgr2=0x7fb8fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 --2- 172.21.15.17:0/643096229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc10ea90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009ca0 tx=0x7fb8f402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 -- 172.21.15.17:0/643096229 shutdown_connections 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 --2- 172.21.15.17:0/643096229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc10ea90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 --2- 172.21.15.17:0/643096229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc102790 0x7fb8fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 --2- 172.21.15.17:0/643096229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 -- 172.21.15.17:0/643096229 >> 172.21.15.17:0/643096229 conn(0x7fb8fc0fd8c0 msgr2=0x7fb8fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 -- 172.21.15.17:0/643096229 shutdown_connections 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.443+0000 7fb903d5e640 1 -- 172.21.15.17:0/643096229 wait complete. 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 Processor -- start 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 -- start start 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc102790 0x7fb8fc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc111e20 con 0x7fb8fc106f10 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc111ca0 con 0x7fb8fc102790 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb903d5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc111fa0 con 0x7fb8fc101de0 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44990/0 (socket says 172.21.15.17:44990) 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 -- 172.21.15.17:0/3254528596 learned_addr learned my addr 172.21.15.17:0/3254528596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb901afa640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9012f9640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc102790 0x7fb8fc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 -- 172.21.15.17:0/3254528596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 msgr2=0x7fb8fc1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 -- 172.21.15.17:0/3254528596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc102790 msgr2=0x7fb8fc1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc102790 0x7fb8fc1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 -- 172.21.15.17:0/3254528596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc19d250 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb901afa640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.444+0000 7fb9022fb640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009dc0 tx=0x7fb8f4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.445+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4004040 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.445+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8f4004690 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.445+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc19d4e0 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.445+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4030d90 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.445+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1a4e20 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.446+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc1021c0 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.447+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb8f40305c0 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.447+0000 7fb8f2ffd640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 0x7fb8e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.448+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb8f40f0d10 con 0x7fb8fc106f10 2024-09-16T01:00:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.448+0000 7fb901afa640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 0x7fb8e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.448+0000 7fb901afa640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 0x7fb8e80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80058c0 tx=0x7fb8f8005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.452+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8f4039e20 con 0x7fb8fc106f10 2024-09-16T01:00:01.654 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:01 smithi154 systemd[1]: Starting Ceph mds.f for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.663+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8fc10a1b0 con 0x7fb8fc106f10 2024-09-16T01:00:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.663+0000 7fb8f2ffd640 1 -- 172.21.15.17:0/3254528596 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fb8f40bded0 con 0x7fb8fc106f10 2024-09-16T01:00:01.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:01.664 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"btime":"2024-09-16T00:59:59:966484+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-16T01:00:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 msgr2=0x7fb8e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 0x7fb8e80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80058c0 tx=0x7fb8f8005ec0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 msgr2=0x7fb8fc19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009dc0 tx=0x7fb8f4003ba0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 shutdown_connections 2024-09-16T01:00:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb8e80a3240 0x7fb8e80a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8fc106f10 0x7fb8fc19cb70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8fc102790 0x7fb8fc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.665+0000 7fb903d5e640 1 --2- 172.21.15.17:0/3254528596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8fc101de0 0x7fb8fc1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.666+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 >> 172.21.15.17:0/3254528596 conn(0x7fb8fc0fd8c0 msgr2=0x7fb8fc0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.666+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 shutdown_connections 2024-09-16T01:00:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:01.666+0000 7fb903d5e640 1 -- 172.21.15.17:0/3254528596 wait complete. 2024-09-16T01:00:02.025 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:01 smithi154 podman[64757]: 2024-09-16 01:00:01.770642906 +0000 UTC m=+0.105945195 container create 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T01:00:02.025 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:01 smithi154 podman[64757]: 2024-09-16 01:00:01.680613267 +0000 UTC m=+0.015915563 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:02.025 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:01 smithi154 podman[64757]: 2024-09-16 01:00:01.998700347 +0000 UTC m=+0.334002639 container init 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-16T01:00:02.025 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:02 smithi154 podman[64757]: 2024-09-16 01:00:02.001425634 +0000 UTC m=+0.336727920 container start 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:00:02.403 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mds[64776]: -- 172.21.15.154:0/3871269640 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f9907a5860 con 0x55f990783400 2024-09-16T01:00:02.403 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: starting mds.f at 2024-09-16T01:00:02.403 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:02 smithi154 bash[64757]: 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 2024-09-16T01:00:02.403 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:00:02 smithi154 systemd[1]: Started Ceph mds.f for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:02.828 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3254528596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:02.829 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:02 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3254528596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:02.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:02.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:02.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:02 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:03.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3254528596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:02 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:03.861 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:03 smithi154 ceph-mon[34759]: Deploying daemon mds.c on smithi154 2024-09-16T01:00:03.861 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:03 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6834/3320793854,v1:172.21.15.154:6835/3320793854] up:boot 2024-09-16T01:00:03.861 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:03 smithi154 ceph-mon[34759]: fsmap 6 up:standby 2024-09-16T01:00:03.861 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:03 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:00:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:03 smithi017 ceph-mon[31211]: Deploying daemon mds.c on smithi154 2024-09-16T01:00:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:03 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6834/3320793854,v1:172.21.15.154:6835/3320793854] up:boot 2024-09-16T01:00:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:03 smithi017 ceph-mon[31211]: fsmap 6 up:standby 2024-09-16T01:00:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:03 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:00:04.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:03 smithi088 ceph-mon[34093]: Deploying daemon mds.c on smithi154 2024-09-16T01:00:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:03 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6834/3320793854,v1:172.21.15.154:6835/3320793854] up:boot 2024-09-16T01:00:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:03 smithi088 ceph-mon[34093]: fsmap 6 up:standby 2024-09-16T01:00:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:03 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:00:04.153 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 systemd[1]: Starting Ceph mds.c for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:04.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:04.521 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 podman[65057]: 2024-09-16 01:00:04.15658335 +0000 UTC m=+0.016444727 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:04.522 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 podman[65057]: 2024-09-16 01:00:04.277299576 +0000 UTC m=+0.137160942 container create bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T01:00:04.522 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 podman[65057]: 2024-09-16 01:00:04.521869 +0000 UTC m=+0.381730367 container init bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-16T01:00:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:04.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:04 smithi017 ceph-mon[31211]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:04.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:04 smithi154 ceph-mon[34759]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:04.903 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 podman[65057]: 2024-09-16 01:00:04.524854102 +0000 UTC m=+0.384715480 container start bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:00:04.903 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 ceph-mds[65076]: -- 172.21.15.154:0/4018041760 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55584dfcd860 con 0x55584dfab400 2024-09-16T01:00:04.903 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: starting mds.c at 2024-09-16T01:00:04.903 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 bash[65057]: bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 2024-09-16T01:00:04.904 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:00:04 smithi154 systemd[1]: Started Ceph mds.c for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:05.110 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:04 smithi088 ceph-mon[34093]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.327+0000 7f980155c640 1 -- 172.21.15.17:0/510099605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 msgr2=0x7f97fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.327+0000 7f980155c640 1 --2- 172.21.15.17:0/510099605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1029b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009900 tx=0x7f97e402a480 comp rx=0 tx=0).stop 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 -- 172.21.15.17:0/510099605 shutdown_connections 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 --2- 172.21.15.17:0/510099605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc102ef0 0x7f97fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 --2- 172.21.15.17:0/510099605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1029b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 --2- 172.21.15.17:0/510099605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc100e20 0x7f97fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 -- 172.21.15.17:0/510099605 >> 172.21.15.17:0/510099605 conn(0x7f97fc0fc7d0 msgr2=0x7f97fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 -- 172.21.15.17:0/510099605 shutdown_connections 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 -- 172.21.15.17:0/510099605 wait complete. 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 Processor -- start 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.328+0000 7f980155c640 1 -- start start 2024-09-16T01:00:05.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc100e20 0x7f97fc199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc102ef0 0x7f97fc1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc110e00 con 0x7f97fc102570 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc110c80 con 0x7f97fc100e20 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc110f80 con 0x7f97fc102ef0 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45018/0 (socket says 172.21.15.17:45018) 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 -- 172.21.15.17:0/1833848492 learned_addr learned my addr 172.21.15.17:0/1833848492 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97faffd640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc100e20 0x7f97fc199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97fb7fe640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc102ef0 0x7f97fc1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 -- 172.21.15.17:0/1833848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc102ef0 msgr2=0x7f97fc1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc102ef0 0x7f97fc1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 -- 172.21.15.17:0/1833848492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc100e20 msgr2=0x7f97fc199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc100e20 0x7f97fc199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 -- 172.21.15.17:0/1833848492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc1a4830 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f27fc640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97e4006010 tx=0x7f97e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e403f030 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97e4003cb0 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1a4a00 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4035070 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.329+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc1a4e50 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.330+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc101200 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.332+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f97e4042030 con 0x7f97fc102570 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.332+0000 7f97f8ff9640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 0x7f97e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.332+0000 7f97faffd640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 0x7f97e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.332+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f97e40ef8a0 con 0x7f97fc102570 2024-09-16T01:00:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.333+0000 7f97faffd640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 0x7f97e80a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00bbe0 tx=0x7f97ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.337+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97e40bc410 con 0x7f97fc102570 2024-09-16T01:00:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.549+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97fc1090c0 con 0x7f97fc102570 2024-09-16T01:00:05.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.549+0000 7f97f8ff9640 1 -- 172.21.15.17:0/1833848492 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f97e40c0710 con 0x7f97fc102570 2024-09-16T01:00:05.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:05.550 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"btime":"2024-09-16T01:00:04:666112+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-16T01:00:05.550 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 msgr2=0x7f97e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 0x7f97e80a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00bbe0 tx=0x7f97ec00b390 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 msgr2=0x7f97fc1997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97e4006010 tx=0x7f97e40042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 shutdown_connections 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f97e80a3240 0x7f97e80a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97fc102ef0 0x7f97fc1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97fc102570 0x7f97fc1997b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 --2- 172.21.15.17:0/1833848492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97fc100e20 0x7f97fc199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 >> 172.21.15.17:0/1833848492 conn(0x7f97fc0fc7d0 msgr2=0x7f97fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.551+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 shutdown_connections 2024-09-16T01:00:05.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:05.552+0000 7f980155c640 1 -- 172.21.15.17:0/1833848492 wait complete. 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6836/3615564777,v1:172.21.15.154:6837/3615564777] up:boot 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: fsmap 7 up:standby 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:05.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:05.867 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: Deploying daemon mds.h on smithi088 2024-09-16T01:00:05.867 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:05 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1833848492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:06.140 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.140 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.140 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6836/3615564777,v1:172.21.15.154:6837/3615564777] up:boot 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: fsmap 7 up:standby 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: Deploying daemon mds.h on smithi088 2024-09-16T01:00:06.141 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:05 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1833848492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6836/3615564777,v1:172.21.15.154:6837/3615564777] up:boot 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: fsmap 7 up:standby 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:06.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: Deploying daemon mds.h on smithi088 2024-09-16T01:00:06.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:05 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1833848492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:06.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:06 smithi088 ceph-mon[34093]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:06.893 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:06 smithi088 systemd[1]: Starting Ceph mds.h for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:06.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:06 smithi017 ceph-mon[31211]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:07.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:06 smithi154 ceph-mon[34759]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:07.191 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:06 smithi088 podman[64030]: 2024-09-16 01:00:06.820576002 +0000 UTC m=+0.015514029 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:07.192 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:06 smithi088 podman[64030]: 2024-09-16 01:00:06.963874395 +0000 UTC m=+0.158812417 container create 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:00:07.192 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 podman[64030]: 2024-09-16 01:00:07.19161303 +0000 UTC m=+0.386551051 container init 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T01:00:07.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 podman[64030]: 2024-09-16 01:00:07.194700603 +0000 UTC m=+0.389638633 container start 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-16T01:00:07.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 ceph-mds[64049]: -- 172.21.15.88:0/2535157490 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562fc4981860 con 0x562fc495e800 2024-09-16T01:00:07.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: starting mds.h at 2024-09-16T01:00:07.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 bash[64030]: 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 2024-09-16T01:00:07.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:00:07 smithi088 systemd[1]: Started Ceph mds.h for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:08.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:08.486 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:08.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:08.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: Deploying daemon mds.i on smithi154 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:boot 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: fsmap 8 up:standby 2024-09-16T01:00:08.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:08 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: Deploying daemon mds.i on smithi154 2024-09-16T01:00:08.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:boot 2024-09-16T01:00:08.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: fsmap 8 up:standby 2024-09-16T01:00:08.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:08 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:00:08.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:08.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: Deploying daemon mds.i on smithi154 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:boot 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: fsmap 8 up:standby 2024-09-16T01:00:08.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:08 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 -- 172.21.15.17:0/3785000189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c100b30 msgr2=0x7f666c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 --2- 172.21.15.17:0/3785000189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c100b30 0x7f666c100f10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6668009900 tx=0x7f666802a470 comp rx=0 tx=0).stop 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 -- 172.21.15.17:0/3785000189 shutdown_connections 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 --2- 172.21.15.17:0/3785000189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c105f40 0x7f666c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 --2- 172.21.15.17:0/3785000189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c101450 0x7f666c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 --2- 172.21.15.17:0/3785000189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c100b30 0x7f666c100f10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.060+0000 7f6673819640 1 -- 172.21.15.17:0/3785000189 >> 172.21.15.17:0/3785000189 conn(0x7f666c0fc7a0 msgr2=0x7f666c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:09.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- 172.21.15.17:0/3785000189 shutdown_connections 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- 172.21.15.17:0/3785000189 wait complete. 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 Processor -- start 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- start start 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c100b30 0x7f666c1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c105f40 0x7f666c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f666c118420 con 0x7f666c101450 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1182a0 con 0x7f666c100b30 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6673819640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1185a0 con 0x7f666c105f40 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.061+0000 7f6670db4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45032/0 (socket says 172.21.15.17:45032) 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 -- 172.21.15.17:0/60922845 learned_addr learned my addr 172.21.15.17:0/60922845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:09.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6671db6640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c105f40 0x7f666c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f66715b5640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c100b30 0x7f666c1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 -- 172.21.15.17:0/60922845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c105f40 msgr2=0x7f666c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c105f40 0x7f666c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 -- 172.21.15.17:0/60922845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c100b30 msgr2=0x7f666c1a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c100b30 0x7f666c1a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 -- 172.21.15.17:0/60922845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c19ef90 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6670db4640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f665c00d750 tx=0x7f665c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c017070 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f665c005020 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c19f280 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c004c60 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.062+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1ab4d0 con 0x7f666c101450 2024-09-16T01:00:09.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.063+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c06b070 con 0x7f666c101450 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.064+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f665c009a30 con 0x7f666c101450 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.065+0000 7f66627fc640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 0x7f66580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.065+0000 7f66715b5640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 0x7f66580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.065+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f665c0cedf0 con 0x7f666c101450 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.066+0000 7f66715b5640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 0x7f66580a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6668031440 tx=0x7f66680095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:09.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.069+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f665c09bfb0 con 0x7f666c101450 2024-09-16T01:00:09.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.279+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f666c1ab6a0 con 0x7f666c101450 2024-09-16T01:00:09.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.280+0000 7f66627fc640 1 -- 172.21.15.17:0/60922845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f665c0ce090 con 0x7f666c101450 2024-09-16T01:00:09.281 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:09.281 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-16T01:00:07:681631+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-16T01:00:09.281 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 msgr2=0x7f66580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 0x7f66580a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6668031440 tx=0x7f66680095f0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 msgr2=0x7f666c1a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f665c00d750 tx=0x7f665c00dc10 comp rx=0 tx=0).stop 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 shutdown_connections 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66580a3240 0x7f66580a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f666c105f40 0x7f666c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666c101450 0x7f666c1a4bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 --2- 172.21.15.17:0/60922845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f666c100b30 0x7f666c1a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:09.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.282+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 >> 172.21.15.17:0/60922845 conn(0x7f666c0fc7a0 msgr2=0x7f666c10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:09.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.283+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 shutdown_connections 2024-09-16T01:00:09.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:09.283+0000 7f6673819640 1 -- 172.21.15.17:0/60922845 wait complete. 2024-09-16T01:00:09.342 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 systemd[1]: Starting Ceph mds.i for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:09.636 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 podman[65363]: 2024-09-16 01:00:09.278688492 +0000 UTC m=+0.016337998 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:09.636 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 podman[65363]: 2024-09-16 01:00:09.391658544 +0000 UTC m=+0.129308052 container create cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-16T01:00:09.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:09 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/60922845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:09 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/60922845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:09.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:09 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/60922845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:09.903 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 podman[65363]: 2024-09-16 01:00:09.636067237 +0000 UTC m=+0.373716743 container init cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-16T01:00:09.903 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 podman[65363]: 2024-09-16 01:00:09.638916702 +0000 UTC m=+0.376566214 container start cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:00:09.904 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 ceph-mds[65382]: -- 172.21.15.154:0/2803549783 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c13192dc20 con 0x55c13190b000 2024-09-16T01:00:09.904 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: starting mds.i at 2024-09-16T01:00:09.904 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 bash[65363]: cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a 2024-09-16T01:00:09.904 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:00:09 smithi154 systemd[1]: Started Ceph mds.i for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: Deploying daemon mds.g on smithi017 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:boot 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: fsmap 9 up:standby 2024-09-16T01:00:10.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:10 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:00:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: Deploying daemon mds.g on smithi017 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:boot 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: fsmap 9 up:standby 2024-09-16T01:00:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:10 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:00:11.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: Deploying daemon mds.g on smithi017 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:boot 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: fsmap 9 up:standby 2024-09-16T01:00:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:10 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:00:11.937 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:11 smithi017 systemd[1]: Starting Ceph mds.g for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:11.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:12.206 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:11 smithi017 podman[69400]: 2024-09-16 01:00:11.845965963 +0000 UTC m=+0.016532370 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:12.206 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:11 smithi017 podman[69400]: 2024-09-16 01:00:11.944532213 +0000 UTC m=+0.115098610 container create f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T01:00:12.206 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 podman[69400]: 2024-09-16 01:00:12.206049947 +0000 UTC m=+0.376616344 container init f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:00:12.390 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:12.515 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 podman[69400]: 2024-09-16 01:00:12.210165203 +0000 UTC m=+0.380731597 container start f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:00:12.515 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mds[69449]: -- 172.21.15.17:0/3126630078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8989c1860 con 0x55a89899e800 2024-09-16T01:00:12.515 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: starting mds.g at 2024-09-16T01:00:12.515 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 bash[69400]: f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 2024-09-16T01:00:12.515 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:00:12 smithi017 systemd[1]: Started Ceph mds.g for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/4194043023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 msgr2=0x7fd7c0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/4194043023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c0110ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009900 tx=0x7fd7b802a410 comp rx=0 tx=0).stop 2024-09-16T01:00:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/4194043023 shutdown_connections 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/4194043023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c0110ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/4194043023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c01049a0 0x7fd7c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/4194043023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c0103ff0 0x7fd7c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/4194043023 >> 172.21.15.17:0/4194043023 conn(0x7fd7c00ffa90 msgr2=0x7fd7c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/4194043023 shutdown_connections 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.879+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/4194043023 wait complete. 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 Processor -- start 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 -- start start 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c0103ff0 0x7fd7c019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 0x7fd7c019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01140d0 con 0x7fd7c0109120 2024-09-16T01:00:12.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0113f50 con 0x7fd7c01049a0 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c6b9b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0114250 con 0x7fd7c0103ff0 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c5138640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c5138640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57878/0 (socket says 172.21.15.17:57878) 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c5138640 1 -- 172.21.15.17:0/1903932013 learned_addr learned my addr 172.21.15.17:0/1903932013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7bffff640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 0x7fd7c019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.880+0000 7fd7c4937640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c0103ff0 0x7fd7c019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 -- 172.21.15.17:0/1903932013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c0103ff0 msgr2=0x7fd7c019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c0103ff0 0x7fd7c019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 -- 172.21.15.17:0/1903932013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 msgr2=0x7fd7c019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 0x7fd7c019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 -- 172.21.15.17:0/1903932013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c019f5e0 con 0x7fd7c0109120 2024-09-16T01:00:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7bffff640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 0x7fd7c019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c5138640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009a20 tx=0x7fd7b80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b803f030 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7b80044d0 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c019f870 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8035070 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.881+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c01a71b0 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.882+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c01054d0 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.883+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd7b8042030 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.884+0000 7fd7bdffb640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 0x7fd7ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.884+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd7b80f00b0 con 0x7fd7c0109120 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.884+0000 7fd7c4937640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 0x7fd7ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.885+0000 7fd7c4937640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 0x7fd7ac0a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009890 tx=0x7fd7a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:12.887+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7b80bd270 con 0x7fd7c0109120 2024-09-16T01:00:13.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:13.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:13.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:13.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:12 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:13.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.114+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c010c360 con 0x7fd7c0109120 2024-09-16T01:00:13.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.114+0000 7fd7bdffb640 1 -- 172.21.15.17:0/1903932013 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8866 (secure 0 0 0) 0x7fd7b80bcb70 con 0x7fd7c0109120 2024-09-16T01:00:13.116 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:13.116 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"btime":"2024-09-16T01:00:12:789519+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-16T01:00:13.116 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-09-16T01:00:13.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 msgr2=0x7fd7ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 0x7fd7ac0a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009890 tx=0x7fd7a8008040 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 msgr2=0x7fd7c019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009a20 tx=0x7fd7b80042e0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 shutdown_connections 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd7ac0a3240 0x7fd7ac0a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7c0109120 0x7fd7c019ef00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c01049a0 0x7fd7c019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 --2- 172.21.15.17:0/1903932013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7c0103ff0 0x7fd7c019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:13.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 >> 172.21.15.17:0/1903932013 conn(0x7fd7c00ffa90 msgr2=0x7fd7c0100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:13.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 shutdown_connections 2024-09-16T01:00:13.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:13.117+0000 7fd7c6b9b640 1 -- 172.21.15.17:0/1903932013 wait complete. 2024-09-16T01:00:13.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:12 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:13.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:12 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:14.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:13 smithi154 ceph-mon[34759]: Deploying daemon mds.a on smithi017 2024-09-16T01:00:14.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:13 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6838/2587837863,v1:172.21.15.17:6839/2587837863] up:boot 2024-09-16T01:00:14.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:13 smithi154 ceph-mon[34759]: fsmap 10 up:standby 2024-09-16T01:00:14.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:13 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:00:14.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:13 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1903932013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:14.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:13 smithi017 ceph-mon[31211]: Deploying daemon mds.a on smithi017 2024-09-16T01:00:14.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:13 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6838/2587837863,v1:172.21.15.17:6839/2587837863] up:boot 2024-09-16T01:00:14.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:13 smithi017 ceph-mon[31211]: fsmap 10 up:standby 2024-09-16T01:00:14.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:13 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:00:14.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:13 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1903932013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:13 smithi088 ceph-mon[34093]: Deploying daemon mds.a on smithi017 2024-09-16T01:00:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:13 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6838/2587837863,v1:172.21.15.17:6839/2587837863] up:boot 2024-09-16T01:00:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:13 smithi088 ceph-mon[34093]: fsmap 10 up:standby 2024-09-16T01:00:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:13 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:00:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:13 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1903932013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:15.068 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:14 smithi088 ceph-mon[34093]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:15.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:14 smithi017 ceph-mon[31211]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:15.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:14 smithi154 ceph-mon[34759]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:15.437 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 systemd[1]: Starting Ceph mds.a for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:15.750 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 podman[69818]: 2024-09-16 01:00:15.400251908 +0000 UTC m=+0.016309423 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:15.750 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 podman[69818]: 2024-09-16 01:00:15.502533082 +0000 UTC m=+0.118590594 container create a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T01:00:15.750 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 podman[69818]: 2024-09-16 01:00:15.74715523 +0000 UTC m=+0.363212750 container init a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T01:00:15.750 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 podman[69818]: 2024-09-16 01:00:15.75005893 +0000 UTC m=+0.366116446 container start a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-16T01:00:15.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:16.182 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:16.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 ceph-mds[69838]: -- 172.21.15.17:0/4243467243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e55c87860 con 0x562e55c64800 2024-09-16T01:00:16.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: starting mds.a at 2024-09-16T01:00:16.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 bash[69818]: a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 2024-09-16T01:00:16.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:00:15 smithi017 systemd[1]: Started Ceph mds.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 -- 172.21.15.17:0/825391047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 msgr2=0x7f2924101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 --2- 172.21.15.17:0/825391047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f2924101200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f291c009900 tx=0x7f291c02a480 comp rx=0 tx=0).stop 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 -- 172.21.15.17:0/825391047 shutdown_connections 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 --2- 172.21.15.17:0/825391047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102ef0 0x7f292410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 --2- 172.21.15.17:0/825391047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102570 0x7f29241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 --2- 172.21.15.17:0/825391047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f2924101200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 -- 172.21.15.17:0/825391047 >> 172.21.15.17:0/825391047 conn(0x7f29240fc7d0 msgr2=0x7f29240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 -- 172.21.15.17:0/825391047 shutdown_connections 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.693+0000 7f292c661640 1 -- 172.21.15.17:0/825391047 wait complete. 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 Processor -- start 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 -- start start 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102570 0x7f292419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102ef0 0x7f292419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2924110e80 con 0x7f2924100e20 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2924110d00 con 0x7f2924102ef0 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292c661640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2924111000 con 0x7f2924102570 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57910/0 (socket says 172.21.15.17:57910) 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 -- 172.21.15.17:0/2539317017 learned_addr learned my addr 172.21.15.17:0/2539317017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f2929bfc640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102570 0x7f292419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292abfe640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102ef0 0x7f292419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 -- 172.21.15.17:0/2539317017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102570 msgr2=0x7f292419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102570 0x7f292419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 -- 172.21.15.17:0/2539317017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102ef0 msgr2=0x7f292419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102ef0 0x7f292419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 -- 172.21.15.17:0/2539317017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292419f570 con 0x7f2924100e20 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.694+0000 7f292a3fd640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f291c02aa70 tx=0x7f291c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.695+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c03f070 con 0x7f2924100e20 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.695+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292419f800 con 0x7f2924100e20 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.695+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f291c03bb20 con 0x7f2924100e20 2024-09-16T01:00:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.695+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c035030 con 0x7f2924100e20 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.695+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29241a7140 con 0x7f2924100e20 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.696+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29241021b0 con 0x7f2924100e20 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.697+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f291c042070 con 0x7f2924100e20 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.698+0000 7f29237fe640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.698+0000 7f2929bfc640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.698+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f291c0efbb0 con 0x7f2924100e20 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.698+0000 7f2929bfc640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 0x7f290c0a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29240ffd30 tx=0x7f2918005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.702+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f291c0bcd70 con 0x7f2924100e20 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:boot 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: fsmap 11 up:standby 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:16 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:16.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.918+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29241a7310 con 0x7f2924100e20 2024-09-16T01:00:16.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:boot 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: fsmap 11 up:standby 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:16.920 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:16.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:16 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.918+0000 7f29237fe640 1 -- 172.21.15.17:0/2539317017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f291c0bc670 con 0x7f2924100e20 2024-09-16T01:00:16.922 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:16.922 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"btime":"2024-09-16T01:00:15:801526+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 msgr2=0x7f290c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 0x7f290c0a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29240ffd30 tx=0x7f2918005f90 comp rx=0 tx=0).stop 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 msgr2=0x7f292419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f291c02aa70 tx=0x7f291c003c10 comp rx=0 tx=0).stop 2024-09-16T01:00:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 shutdown_connections 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2924102ef0 0x7f292419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2924102570 0x7f292419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 --2- 172.21.15.17:0/2539317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2924100e20 0x7f292419a5c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 >> 172.21.15.17:0/2539317017 conn(0x7f29240fc7d0 msgr2=0x7f2924069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 shutdown_connections 2024-09-16T01:00:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:16.921+0000 7f292c661640 1 -- 172.21.15.17:0/2539317017 wait complete. 2024-09-16T01:00:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:boot 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: fsmap 11 up:standby 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:00:17.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:16 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:17 smithi088 ceph-mon[34093]: Deploying daemon mds.b on smithi088 2024-09-16T01:00:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:17 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2539317017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:18.143 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:17 smithi088 systemd[1]: Starting Ceph mds.b for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:00:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:17 smithi154 ceph-mon[34759]: Deploying daemon mds.b on smithi088 2024-09-16T01:00:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:17 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2539317017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:18.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:17 smithi017 ceph-mon[31211]: Deploying daemon mds.b on smithi088 2024-09-16T01:00:18.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:17 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2539317017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:18.480 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 podman[64345]: 2024-09-16 01:00:18.095216954 +0000 UTC m=+0.015729618 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:00:18.480 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 podman[64345]: 2024-09-16 01:00:18.210707117 +0000 UTC m=+0.131219779 container create 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-16T01:00:18.480 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 podman[64345]: 2024-09-16 01:00:18.47991553 +0000 UTC m=+0.400428184 container init 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:00:18.814 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 podman[64345]: 2024-09-16 01:00:18.482818857 +0000 UTC m=+0.403331514 container start 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-16T01:00:18.814 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mds[64364]: -- 172.21.15.88:0/1711663330 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c44cfdb860 con 0x55c44cfb8800 2024-09-16T01:00:18.814 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: starting mds.b at 2024-09-16T01:00:18.814 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 bash[64345]: 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 2024-09-16T01:00:18.814 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:18 smithi088 systemd[1]: Started Ceph mds.b for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:18 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:18 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:19.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:18 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:19.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:20.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:19 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:boot 2024-09-16T01:00:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:19 smithi088 ceph-mon[34093]: fsmap 12 up:standby 2024-09-16T01:00:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:19 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:00:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:19 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:boot 2024-09-16T01:00:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:19 smithi154 ceph-mon[34759]: fsmap 12 up:standby 2024-09-16T01:00:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:19 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:00:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:20.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:19 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:boot 2024-09-16T01:00:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:19 smithi017 ceph-mon[31211]: fsmap 12 up:standby 2024-09-16T01:00:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:19 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:00:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 -- 172.21.15.17:0/182706851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 msgr2=0x7f26ec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 --2- 172.21.15.17:0/182706851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1067e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009900 tx=0x7f26dc02a410 comp rx=0 tx=0).stop 2024-09-16T01:00:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 -- 172.21.15.17:0/182706851 shutdown_connections 2024-09-16T01:00:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 --2- 172.21.15.17:0/182706851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 0x7f26ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 --2- 172.21.15.17:0/182706851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1067e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 --2- 172.21.15.17:0/182706851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 0x7f26ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 -- 172.21.15.17:0/182706851 >> 172.21.15.17:0/182706851 conn(0x7f26ec0fd8c0 msgr2=0x7f26ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 -- 172.21.15.17:0/182706851 shutdown_connections 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.647+0000 7f26f452c640 1 -- 172.21.15.17:0/182706851 wait complete. 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 Processor -- start 2024-09-16T01:00:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 -- start start 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 0x7f26ec198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 0x7f26ec19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111e20 con 0x7f26ec102790 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111ca0 con 0x7f26ec101de0 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f452c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec111fa0 con 0x7f26ec106f10 2024-09-16T01:00:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60892/0 (socket says 172.21.15.17:60892) 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 -- 172.21.15.17:0/3233861891 learned_addr learned my addr 172.21.15.17:0/3233861891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f2ac9640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 0x7f26ec19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f22c8640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 0x7f26ec198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 -- 172.21.15.17:0/3233861891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 msgr2=0x7f26ec19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 0x7f26ec19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 -- 172.21.15.17:0/3233861891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 msgr2=0x7f26ec198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 0x7f26ec198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.648+0000 7f26f1ac7640 1 -- 172.21.15.17:0/3233861891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec19d330 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26f1ac7640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26dc005940 tx=0x7f26dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc03f030 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26dc003aa0 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec19d5c0 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc035070 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.649+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec1a4f00 con 0x7f26ec102790 2024-09-16T01:00:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.650+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ec1032c0 con 0x7f26ec102790 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.651+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f26dc042030 con 0x7f26ec102790 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.652+0000 7f26e37fe640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 0x7f26d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.652+0000 7f26f22c8640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 0x7f26d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.652+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f26dc0efb30 con 0x7f26ec102790 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.652+0000 7f26f22c8640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 0x7f26d80a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26e800bbe0 tx=0x7f26e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.656+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26dc0bc6a0 con 0x7f26ec102790 2024-09-16T01:00:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.903+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26ec10a150 con 0x7f26ec102790 2024-09-16T01:00:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.904+0000 7f26e37fe640 1 -- 172.21.15.17:0/3233861891 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f26dc0c09a0 con 0x7f26ec102790 2024-09-16T01:00:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:20.906 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"btime":"2024-09-16T01:00:18:812741+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24515,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-16T01:00:20.906 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-09-16T01:00:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 msgr2=0x7f26d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 0x7f26d80a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26e800bbe0 tx=0x7f26e800b390 comp rx=0 tx=0).stop 2024-09-16T01:00:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 msgr2=0x7f26ec1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26dc005940 tx=0x7f26dc004270 comp rx=0 tx=0).stop 2024-09-16T01:00:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 shutdown_connections 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26d80a32c0 0x7f26d80a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ec106f10 0x7f26ec19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26ec102790 0x7f26ec1988c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 --2- 172.21.15.17:0/3233861891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26ec101de0 0x7f26ec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 >> 172.21.15.17:0/3233861891 conn(0x7f26ec0fd8c0 msgr2=0x7f26ec0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 shutdown_connections 2024-09-16T01:00:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:20.907+0000 7f26f452c640 1 -- 172.21.15.17:0/3233861891 wait complete. 2024-09-16T01:00:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:20 smithi088 ceph-mon[34093]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:20 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:20 smithi154 ceph-mon[34759]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:20 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:20 smithi017 ceph-mon[31211]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:20 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:21.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-16T01:00:22.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3233861891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:21 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3233861891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:21 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:22.157 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3233861891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.158 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:21 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:22.484 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 -- 172.21.15.17:0/2743739542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4101420 msgr2=0x7f30d410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 --2- 172.21.15.17:0/2743739542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4101420 0x7f30d410d950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009cd0 tx=0x7f30cc02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 -- 172.21.15.17:0/2743739542 shutdown_connections 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 --2- 172.21.15.17:0/2743739542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4101420 0x7f30d410d950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 --2- 172.21.15.17:0/2743739542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4100a80 0x7f30d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 --2- 172.21.15.17:0/2743739542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4106a80 0x7f30d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 -- 172.21.15.17:0/2743739542 >> 172.21.15.17:0/2743739542 conn(0x7f30d40fc7a0 msgr2=0x7f30d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 -- 172.21.15.17:0/2743739542 shutdown_connections 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.980+0000 7f30d88a5640 1 -- 172.21.15.17:0/2743739542 wait complete. 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.981+0000 7f30d88a5640 1 Processor -- start 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.981+0000 7f30d88a5640 1 -- start start 2024-09-16T01:00:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.981+0000 7f30d88a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.981+0000 7f30d88a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4101420 0x7f30d419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.981+0000 7f30d88a5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4106a80 0x7f30d419ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d88a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110d30 con 0x7f30d4100a80 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d88a5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110bb0 con 0x7f30d4106a80 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d88a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110eb0 con 0x7f30d4101420 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60914/0 (socket says 172.21.15.17:60914) 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 -- 172.21.15.17:0/302692673 learned_addr learned my addr 172.21.15.17:0/302692673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d1d9b640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4101420 0x7f30d419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d2d9d640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4106a80 0x7f30d419ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 -- 172.21.15.17:0/302692673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4101420 msgr2=0x7f30d419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4101420 0x7f30d419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:22.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 -- 172.21.15.17:0/302692673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4106a80 msgr2=0x7f30d419ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4106a80 0x7f30d419ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 -- 172.21.15.17:0/302692673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d419f550 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d259c640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30c400d950 tx=0x7f30c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4017070 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30c4009c30 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419f840 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c400f620 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.982+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41a7120 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.983+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d4100ee0 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.984+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f30c40109a0 con 0x7f30d4100a80 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.985+0000 7f30c37fe640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 0x7f30bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.985+0000 7f30d1d9b640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 0x7f30bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.985+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f30c40cf0e0 con 0x7f30d4100a80 2024-09-16T01:00:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.986+0000 7f30d1d9b640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 0x7f30bc0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005e10 tx=0x7f30c8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:22.988+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30c4009de0 con 0x7f30d4100a80 2024-09-16T01:00:23.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:22 smithi088 ceph-mon[34093]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:23.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:22 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:22 smithi154 ceph-mon[34759]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:22 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.178+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f30d41a72f0 con 0x7f30d4100a80 2024-09-16T01:00:23.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:22 smithi017 ceph-mon[31211]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:23.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.180 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:22 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:23.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.179+0000 7f30c37fe640 1 -- 172.21.15.17:0/302692673 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f30c409c2a0 con 0x7f30d4100a80 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:00:23.181 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 msgr2=0x7f30bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 0x7f30bc0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005e10 tx=0x7f30c8005da0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 msgr2=0x7f30d419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30c400d950 tx=0x7f30c400de10 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 shutdown_connections 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f30bc0a3240 0x7f30bc0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30d4106a80 0x7f30d419ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d4101420 0x7f30d419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 --2- 172.21.15.17:0/302692673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d4100a80 0x7f30d419a5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.182+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 >> 172.21.15.17:0/302692673 conn(0x7f30d40fc7a0 msgr2=0x7f30d410c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.183+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 shutdown_connections 2024-09-16T01:00:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:23.183+0000 7f30d88a5640 1 -- 172.21.15.17:0/302692673 wait complete. 2024-09-16T01:00:23.918 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:00:23.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:00:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:23 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:23 smithi017 ceph-mon[31211]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:23 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/302692673' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:00:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:23 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:23 smithi088 ceph-mon[34093]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:23 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/302692673' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:00:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:23 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:23 smithi154 ceph-mon[34759]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:23 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/302692673' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:00:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- 172.21.15.17:0/1343782591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344102ef0 msgr2=0x7fb34410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1343782591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344102ef0 0x7fb34410da40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009ca0 tx=0x7fb33c02a950 comp rx=0 tx=0).stop 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- 172.21.15.17:0/1343782591 shutdown_connections 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1343782591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344102ef0 0x7fb34410da40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1343782591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102570 0x7fb3441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1343782591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344100e20 0x7fb344101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- 172.21.15.17:0/1343782591 >> 172.21.15.17:0/1343782591 conn(0x7fb3440fc7d0 msgr2=0x7fb3440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- 172.21.15.17:0/1343782591 shutdown_connections 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- 172.21.15.17:0/1343782591 wait complete. 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 Processor -- start 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.675+0000 7fb34ab21640 1 -- start start 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344102570 0x7fb344199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102ef0 0x7fb3441a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb344110e30 con 0x7fb344100e20 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb344110cb0 con 0x7fb344102570 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb344110fb0 con 0x7fb344102ef0 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60944/0 (socket says 172.21.15.17:60944) 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 -- 172.21.15.17:0/1058781315 learned_addr learned my addr 172.21.15.17:0/1058781315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb343fff640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344102570 0x7fb344199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3490be640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102ef0 0x7fb3441a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 -- 172.21.15.17:0/1058781315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102ef0 msgr2=0x7fb3441a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102ef0 0x7fb3441a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 -- 172.21.15.17:0/1058781315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344102570 msgr2=0x7fb344199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344102570 0x7fb344199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 -- 172.21.15.17:0/1058781315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3441a4880 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb3488bd640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb33400d950 tx=0x7fb33400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334017070 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb334009c30 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3441a4a50 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.676+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33400f620 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.677+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3441a4f90 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.678+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb344101200 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.679+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb3340109a0 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.680+0000 7fb341ffb640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 0x7fb32c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.680+0000 7fb343fff640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 0x7fb32c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.680+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb3340cf040 con 0x7fb344100e20 2024-09-16T01:00:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.680+0000 7fb343fff640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 0x7fb32c0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb34406aac0 tx=0x7fb33800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:24.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.684+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb334009de0 con 0x7fb344100e20 2024-09-16T01:00:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:24.858+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb344109090 con 0x7fb344100e20 2024-09-16T01:00:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.341+0000 7fb341ffb640 1 -- 172.21.15.17:0/1058781315 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7fb33409c200 con 0x7fb344100e20 2024-09-16T01:00:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-16T01:00:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 msgr2=0x7fb32c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 0x7fb32c0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb34406aac0 tx=0x7fb33800b390 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 msgr2=0x7fb3441992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb33400d950 tx=0x7fb33400de10 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 shutdown_connections 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb32c0a32c0 0x7fb32c0a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb344102ef0 0x7fb3441a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb344102570 0x7fb344199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 --2- 172.21.15.17:0/1058781315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb344100e20 0x7fb3441992c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.343+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 >> 172.21.15.17:0/1058781315 conn(0x7fb3440fc7d0 msgr2=0x7fb3440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.344+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 shutdown_connections 2024-09-16T01:00:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:25.344+0000 7fb34ab21640 1 -- 172.21.15.17:0/1058781315 wait complete. 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:25 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:25 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:00:25.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:25 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:00:26.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:00:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:26.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:26 smithi088 ceph-mon[34093]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:26.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:26 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:00:26.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:26 smithi088 ceph-mon[34093]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:00:26.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:26 smithi154 ceph-mon[34759]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:26.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:26 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:00:26.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:26 smithi154 ceph-mon[34759]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:00:26.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:26 smithi017 ceph-mon[31211]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:26.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:26 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1058781315' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:00:26.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:26 smithi017 ceph-mon[31211]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 -- 172.21.15.17:0/1384200530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650101de0 msgr2=0x7fd6501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 --2- 172.21.15.17:0/1384200530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650101de0 0x7fd6501021c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd640009900 tx=0x7fd64002a410 comp rx=0 tx=0).stop 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 -- 172.21.15.17:0/1384200530 shutdown_connections 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 --2- 172.21.15.17:0/1384200530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650106f10 0x7fd65010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 --2- 172.21.15.17:0/1384200530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650102790 0x7fd6501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 --2- 172.21.15.17:0/1384200530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650101de0 0x7fd6501021c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 -- 172.21.15.17:0/1384200530 >> 172.21.15.17:0/1384200530 conn(0x7fd6500fd8c0 msgr2=0x7fd6500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 -- 172.21.15.17:0/1384200530 shutdown_connections 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.797+0000 7fd654c39640 1 -- 172.21.15.17:0/1384200530 wait complete. 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 Processor -- start 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 -- start start 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650101de0 0x7fd6501983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 0x7fd65019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd650111e20 con 0x7fd650102790 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd650111ca0 con 0x7fd650106f10 2024-09-16T01:00:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd654c39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd650111fa0 con 0x7fd650101de0 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd64dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd64dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60964/0 (socket says 172.21.15.17:60964) 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd64dd9b640 1 -- 172.21.15.17:0/2005361339 learned_addr learned my addr 172.21.15.17:0/2005361339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.798+0000 7fd64e59c640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650101de0 0x7fd6501983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64ed9d640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 0x7fd65019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 -- 172.21.15.17:0/2005361339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650101de0 msgr2=0x7fd6501983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650101de0 0x7fd6501983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 -- 172.21.15.17:0/2005361339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 msgr2=0x7fd65019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 0x7fd65019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 -- 172.21.15.17:0/2005361339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65019d370 con 0x7fd650102790 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64ed9d640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 0x7fd65019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd64dd9b640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd64400e9f0 tx=0x7fd64400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64400cd80 con 0x7fd650102790 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65019d660 con 0x7fd650102790 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6440108e0 con 0x7fd650102790 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd644018920 con 0x7fd650102790 2024-09-16T01:00:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.799+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6501a4f40 con 0x7fd650102790 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.800+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6501021c0 con 0x7fd650102790 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.802+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd644010a90 con 0x7fd650102790 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.802+0000 7fd63f7fe640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 0x7fd6380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.802+0000 7fd64e59c640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 0x7fd6380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.802+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fd6440cfee0 con 0x7fd650102790 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.803+0000 7fd64e59c640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 0x7fd6380a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd640031440 tx=0x7fd640005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.806+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd64409ce90 con 0x7fd650102790 2024-09-16T01:00:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:26.984+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd65010a120 con 0x7fd650102790 2024-09-16T01:00:27.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.420+0000 7fd63f7fe640 1 -- 172.21.15.17:0/2005361339 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fd64409c790 con 0x7fd650102790 2024-09-16T01:00:27.421 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-16T01:00:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 msgr2=0x7fd6380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 0x7fd6380a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd640031440 tx=0x7fd640005b50 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 msgr2=0x7fd650198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd64400e9f0 tx=0x7fd64400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 shutdown_connections 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd6380a3240 0x7fd6380a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd650106f10 0x7fd65019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd650102790 0x7fd650198900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 --2- 172.21.15.17:0/2005361339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd650101de0 0x7fd6501983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 >> 172.21.15.17:0/2005361339 conn(0x7fd6500fd8c0 msgr2=0x7fd6500fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 shutdown_connections 2024-09-16T01:00:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:27.422+0000 7fd654c39640 1 -- 172.21.15.17:0/2005361339 wait complete. 2024-09-16T01:00:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:27 smithi017 ceph-mon[31211]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:00:27.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:27 smithi088 ceph-mon[34093]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:00:27.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:27 smithi154 ceph-mon[34759]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:00:28.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:00:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:28 smithi017 ceph-mon[31211]: pgmap v274: 33 pgs: 4 active+clean, 3 creating+activating, 11 creating+peering, 15 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:28 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:00:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:28 smithi017 ceph-mon[31211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:00:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:28 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:00:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:28 smithi017 ceph-mon[31211]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 -- 172.21.15.17:0/1718227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94106a90 msgr2=0x7f6e94106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 --2- 172.21.15.17:0/1718227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94106a90 0x7f6e94106e70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009930 tx=0x7f6e8402a420 comp rx=0 tx=0).stop 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 -- 172.21.15.17:0/1718227238 shutdown_connections 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 --2- 172.21.15.17:0/1718227238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94101430 0x7f6e9410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 --2- 172.21.15.17:0/1718227238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e94100a90 0x7f6e94100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 --2- 172.21.15.17:0/1718227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94106a90 0x7f6e94106e70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 -- 172.21.15.17:0/1718227238 >> 172.21.15.17:0/1718227238 conn(0x7f6e940fc7d0 msgr2=0x7f6e940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 -- 172.21.15.17:0/1718227238 shutdown_connections 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.843+0000 7f6e99570640 1 -- 172.21.15.17:0/1718227238 wait complete. 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.844+0000 7f6e99570640 1 Processor -- start 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.844+0000 7f6e99570640 1 -- start start 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e94101430 0x7f6e9410e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 0x7f6e9410ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94111e20 con 0x7f6e94100a90 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94111ca0 con 0x7f6e94106a90 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94111fa0 con 0x7f6e94101430 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60992/0 (socket says 172.21.15.17:60992) 2024-09-16T01:00:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 -- 172.21.15.17:0/943158091 learned_addr learned my addr 172.21.15.17:0/943158091 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e937fe640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 0x7f6e9410ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 -- 172.21.15.17:0/943158091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e94101430 msgr2=0x7f6e9410e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e94101430 0x7f6e9410e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 -- 172.21.15.17:0/943158091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 msgr2=0x7f6e9410ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 0x7f6e9410ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 -- 172.21.15.17:0/943158091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e941a68a0 con 0x7f6e94100a90 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e937fe640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 0x7f6e9410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e92ffd640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005940 tx=0x7f6e840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8403f030 con 0x7f6e94100a90 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e840318a0 con 0x7f6e94100a90 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e941a6b30 con 0x7f6e94100a90 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84035070 con 0x7f6e94100a90 2024-09-16T01:00:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.845+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e941a7010 con 0x7f6e94100a90 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.846+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e94100ef0 con 0x7f6e94100a90 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.848+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6e84042030 con 0x7f6e94100a90 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.849+0000 7f6e7bfff640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 0x7f6e7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.849+0000 7f6e927fc640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 0x7f6e7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.849+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f6e840f0200 con 0x7f6e94100a90 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.849+0000 7f6e927fc640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 0x7f6e7c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6e88005fd0 tx=0x7f6e88005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:28.852+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e840bd0b0 con 0x7f6e94100a90 2024-09-16T01:00:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:28 smithi088 ceph-mon[34093]: pgmap v274: 33 pgs: 4 active+clean, 3 creating+activating, 11 creating+peering, 15 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:28 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:00:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:28 smithi088 ceph-mon[34093]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:00:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:28 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:00:28.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:28 smithi088 ceph-mon[34093]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:00:28.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:28 smithi154 ceph-mon[34759]: pgmap v274: 33 pgs: 4 active+clean, 3 creating+activating, 11 creating+peering, 15 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:28.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:28 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:00:28.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:28 smithi154 ceph-mon[34759]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:00:28.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:28 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2005361339' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:00:28.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:28 smithi154 ceph-mon[34759]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:00:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.071+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6e9402d7c0 con 0x7f6e94100a90 2024-09-16T01:00:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.434+0000 7f6e7bfff640 1 -- 172.21.15.17:0/943158091 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6e840bc9b0 con 0x7f6e94100a90 2024-09-16T01:00:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T01:00:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 msgr2=0x7f6e7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 0x7f6e7c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6e88005fd0 tx=0x7f6e88005c70 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 msgr2=0x7f6e9410e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005940 tx=0x7f6e840042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 shutdown_connections 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e7c0a3240 0x7f6e7c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e94106a90 0x7f6e9410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e94101430 0x7f6e9410e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 --2- 172.21.15.17:0/943158091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e94100a90 0x7f6e9410e3f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 >> 172.21.15.17:0/943158091 conn(0x7f6e940fc7d0 msgr2=0x7f6e940fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 shutdown_connections 2024-09-16T01:00:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:29.438+0000 7f6e99570640 1 -- 172.21.15.17:0/943158091 wait complete. 2024-09-16T01:00:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:29 smithi017 ceph-mon[31211]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:00:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:29 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:00:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:29 smithi017 ceph-mon[31211]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:00:29.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:29 smithi088 ceph-mon[34093]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:00:29.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:29 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:00:29.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:29 smithi088 ceph-mon[34093]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:00:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:29 smithi154 ceph-mon[34759]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:00:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:29 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:00:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:29 smithi154 ceph-mon[34759]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:00:30.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:00:30.419 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:30.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:30 smithi017 ceph-mon[31211]: pgmap v277: 97 pgs: 15 active+clean, 3 creating+activating, 13 creating+peering, 66 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:30.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:30 smithi017 ceph-mon[31211]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:00:30.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:30 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:00:30.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:30 smithi017 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:00:30.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:30 smithi017 ceph-mon[31211]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:00:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:30 smithi088 ceph-mon[34093]: pgmap v277: 97 pgs: 15 active+clean, 3 creating+activating, 13 creating+peering, 66 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:30 smithi088 ceph-mon[34093]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:00:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:30 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:00:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:30 smithi088 ceph-mon[34093]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:00:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:30 smithi088 ceph-mon[34093]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:00:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:30 smithi154 ceph-mon[34759]: pgmap v277: 97 pgs: 15 active+clean, 3 creating+activating, 13 creating+peering, 66 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:00:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:30 smithi154 ceph-mon[34759]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:00:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:30 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/943158091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:00:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:30 smithi154 ceph-mon[34759]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:00:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:30 smithi154 ceph-mon[34759]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:00:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 -- 172.21.15.17:0/641900480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e81008d0 msgr2=0x7fb6e8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 --2- 172.21.15.17:0/641900480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e81008d0 0x7fb6e8100cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009900 tx=0x7fb6e402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 -- 172.21.15.17:0/641900480 shutdown_connections 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 --2- 172.21.15.17:0/641900480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 0x7fb6e8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 --2- 172.21.15.17:0/641900480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e8101280 0x7fb6e810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 --2- 172.21.15.17:0/641900480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e81008d0 0x7fb6e8100cb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.898+0000 7fb6ef534640 1 -- 172.21.15.17:0/641900480 >> 172.21.15.17:0/641900480 conn(0x7fb6e80fc7a0 msgr2=0x7fb6e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- 172.21.15.17:0/641900480 shutdown_connections 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- 172.21.15.17:0/641900480 wait complete. 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 Processor -- start 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- start start 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 0x7fb6e819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 0x7fb6e819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81140a0 con 0x7fb6e8101280 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8113f20 con 0x7fb6e81008d0 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.899+0000 7fb6ef534640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8114220 con 0x7fb6e810e480 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55122/0 (socket says 172.21.15.17:55122) 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 -- 172.21.15.17:0/2592224476 learned_addr learned my addr 172.21.15.17:0/2592224476 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ed2d0640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 0x7fb6e819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 -- 172.21.15.17:0/2592224476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 msgr2=0x7fb6e819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6edad1640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 0x7fb6e819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 0x7fb6e819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 -- 172.21.15.17:0/2592224476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 msgr2=0x7fb6e819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 0x7fb6e819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 -- 172.21.15.17:0/2592224476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e819f570 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ed2d0640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 0x7fb6e819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ecacf640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800d950 tx=0x7fb6d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8017070 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6d8009c30 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e819f860 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800f620 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.900+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e81a7140 con 0x7fb6e8101280 2024-09-16T01:00:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.901+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e8100cb0 con 0x7fb6e8101280 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.903+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb6d80109a0 con 0x7fb6e8101280 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.903+0000 7fb6de7fc640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 0x7fb6d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.903+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb6d80cf440 con 0x7fb6e8101280 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.903+0000 7fb6ed2d0640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 0x7fb6d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.904+0000 7fb6ed2d0640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 0x7fb6d40a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4031440 tx=0x7fb6e40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:30.906+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6d8009de0 con 0x7fb6e8101280 2024-09-16T01:00:31.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.082+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6e802d7c0 con 0x7fb6e8101280 2024-09-16T01:00:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.084+0000 7fb6de7fc640 1 -- 172.21.15.17:0/2592224476 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22205 (secure 0 0 0) 0x7fb6d809c330 con 0x7fb6e8101280 2024-09-16T01:00:31.085 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:31.086 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:00:29.073282+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:00:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 msgr2=0x7fb6d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 0x7fb6d40a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4031440 tx=0x7fb6e40058b0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 msgr2=0x7fb6e819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800d950 tx=0x7fb6d800de10 comp rx=0 tx=0).stop 2024-09-16T01:00:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 shutdown_connections 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb6d40a32c0 0x7fb6d40a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e810e480 0x7fb6e819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6e8101280 0x7fb6e819ab00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 --2- 172.21.15.17:0/2592224476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6e81008d0 0x7fb6e819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 >> 172.21.15.17:0/2592224476 conn(0x7fb6e80fc7a0 msgr2=0x7fb6e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 shutdown_connections 2024-09-16T01:00:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:31.086+0000 7fb6ef534640 1 -- 172.21.15.17:0/2592224476 wait complete. 2024-09-16T01:00:31.714 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:31 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:active 2024-09-16T01:00:31.714 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:31 smithi017 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.714 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:31 smithi017 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.714 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:31 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2592224476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:31.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:00:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:31 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:active 2024-09-16T01:00:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:31 smithi088 ceph-mon[34093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:31 smithi088 ceph-mon[34093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:31 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2592224476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:31 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] up:active 2024-09-16T01:00:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:31 smithi154 ceph-mon[34759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:31 smithi154 ceph-mon[34759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:31 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2592224476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.473+0000 7f04680be640 1 -- 172.21.15.17:0/3560333775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460102d40 msgr2=0x7f0460103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.473+0000 7f04680be640 1 --2- 172.21.15.17:0/3560333775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460102d40 0x7f0460103120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0450009ca0 tx=0x7f045002a950 comp rx=0 tx=0).stop 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 -- 172.21.15.17:0/3560333775 shutdown_connections 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 --2- 172.21.15.17:0/3560333775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 0x7f046010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 --2- 172.21.15.17:0/3560333775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460103660 0x7f046010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 --2- 172.21.15.17:0/3560333775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460102d40 0x7f0460103120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 -- 172.21.15.17:0/3560333775 >> 172.21.15.17:0/3560333775 conn(0x7f04600fc7a0 msgr2=0x7f04600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 -- 172.21.15.17:0/3560333775 shutdown_connections 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 -- 172.21.15.17:0/3560333775 wait complete. 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 Processor -- start 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 -- start start 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.474+0000 7f04680be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 0x7f046019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 0x7f046019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0460111e60 con 0x7f0460103660 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0460111ce0 con 0x7f046010c170 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0460111fe0 con 0x7f0460102d40 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55142/0 (socket says 172.21.15.17:55142) 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 -- 172.21.15.17:0/4061958193 learned_addr learned my addr 172.21.15.17:0/4061958193 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f046665b640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 0x7f046019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465e5a640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 0x7f046019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 -- 172.21.15.17:0/4061958193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 msgr2=0x7f046019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 0x7f046019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 -- 172.21.15.17:0/4061958193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 msgr2=0x7f046019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 0x7f046019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 -- 172.21.15.17:0/4061958193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046019f600 con 0x7f0460103660 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465e5a640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 0x7f046019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f0465659640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f045400b3f0 tx=0x7f045400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454015020 con 0x7f0460103660 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0454011ce0 con 0x7f0460103660 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046019f8f0 con 0x7f0460103660 2024-09-16T01:00:32.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454010d80 con 0x7f0460103660 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.475+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04601a71d0 con 0x7f0460103660 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.476+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460103120 con 0x7f0460103660 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.478+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0454018020 con 0x7f0460103660 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.478+0000 7f045effd640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 0x7f04480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.478+0000 7f0465e5a640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 0x7f04480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.478+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f04540cf020 con 0x7f0460103660 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.479+0000 7f0465e5a640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 0x7f04480a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0450006010 tx=0x7f0450005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.482+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f045401f020 con 0x7f0460103660 2024-09-16T01:00:32.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.660+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f046002d7c0 con 0x7f0460103660 2024-09-16T01:00:32.662 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:32 smithi017 ceph-mon[31211]: pgmap v279: 97 pgs: 73 active+clean, 3 creating+activating, 2 creating+peering, 19 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-16T01:00:32.662 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:32 smithi017 ceph-mon[31211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:00:32.662 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:32 smithi017 ceph-mon[31211]: Cluster is now healthy 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.662+0000 7f045effd640 1 -- 172.21.15.17:0/4061958193 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22205 (secure 0 0 0) 0x7f045409be90 con 0x7f0460103660 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:32.664 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:00:29.073282+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:00:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 msgr2=0x7f04480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 0x7f04480a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0450006010 tx=0x7f0450005f80 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 msgr2=0x7f046019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f045400b3f0 tx=0x7f045400b8b0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 shutdown_connections 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f04480a32c0 0x7f04480a5780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046010c170 0x7f046019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460103660 0x7f046019ab90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 --2- 172.21.15.17:0/4061958193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0460102d40 0x7f046019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 >> 172.21.15.17:0/4061958193 conn(0x7f04600fc7a0 msgr2=0x7f04601010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 shutdown_connections 2024-09-16T01:00:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:32.665+0000 7f04680be640 1 -- 172.21.15.17:0/4061958193 wait complete. 2024-09-16T01:00:32.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:32 smithi088 ceph-mon[34093]: pgmap v279: 97 pgs: 73 active+clean, 3 creating+activating, 2 creating+peering, 19 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-16T01:00:32.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:32 smithi088 ceph-mon[34093]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:00:32.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:32 smithi088 ceph-mon[34093]: Cluster is now healthy 2024-09-16T01:00:32.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:32 smithi154 ceph-mon[34759]: pgmap v279: 97 pgs: 73 active+clean, 3 creating+activating, 2 creating+peering, 19 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-16T01:00:32.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:32 smithi154 ceph-mon[34759]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:00:32.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:32 smithi154 ceph-mon[34759]: Cluster is now healthy 2024-09-16T01:00:33.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:00:33.636 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:33.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4061958193' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:33.826 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4061958193' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:33.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4061958193' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 -- 172.21.15.17:0/3895021838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0102790 msgr2=0x7f59d01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3895021838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0102790 0x7f59d01067e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009900 tx=0x7f59c002a410 comp rx=0 tx=0).stop 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 -- 172.21.15.17:0/3895021838 shutdown_connections 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3895021838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0106f10 0x7f59d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3895021838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0102790 0x7f59d01067e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3895021838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 0x7f59d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 -- 172.21.15.17:0/3895021838 >> 172.21.15.17:0/3895021838 conn(0x7f59d00fd8c0 msgr2=0x7f59d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 -- 172.21.15.17:0/3895021838 shutdown_connections 2024-09-16T01:00:34.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.110+0000 7f59d72cf640 1 -- 172.21.15.17:0/3895021838 wait complete. 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 Processor -- start 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 -- start start 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 0x7f59d01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 0x7f59d0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f59d0111e20 con 0x7f59d0106f10 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f59d0111ca0 con 0x7f59d0102790 2024-09-16T01:00:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d72cf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59d0111fa0 con 0x7f59d0101de0 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55152/0 (socket says 172.21.15.17:55152) 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 -- 172.21.15.17:0/3798888613 learned_addr learned my addr 172.21.15.17:0/3798888613 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d506b640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 0x7f59d01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d486a640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 0x7f59d0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 -- 172.21.15.17:0/3798888613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 msgr2=0x7f59d01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 0x7f59d01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 -- 172.21.15.17:0/3798888613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 msgr2=0x7f59d0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 0x7f59d0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d586c640 1 -- 172.21.15.17:0/3798888613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d019d370 con 0x7f59d0106f10 2024-09-16T01:00:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.111+0000 7f59d486a640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 0x7f59d0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59d586c640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59c800cce0 tx=0x7f59c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c800f450 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d019d660 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f59c800faa0 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8018b70 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.112+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d01a4f40 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.113+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d01021c0 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.114+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f59c8018d10 con 0x7f59d0106f10 2024-09-16T01:00:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.115+0000 7f59c67fc640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 0x7f59bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.115+0000 7f59d506b640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 0x7f59bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.115+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f59c80cfc50 con 0x7f59d0106f10 2024-09-16T01:00:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.115+0000 7f59d506b640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 0x7f59bc0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.118+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59c8014030 con 0x7f59d0106f10 2024-09-16T01:00:34.142 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:00:33.824+0000 7f5db8700640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:00:34.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.331+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f59d010a150 con 0x7f59d0106f10 2024-09-16T01:00:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.449+0000 7f59c67fc640 1 -- 172.21.15.17:0/3798888613 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f59c809cb50 con 0x7f59d0106f10 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 msgr2=0x7f59bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 0x7f59bc0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc00b390 comp rx=0 tx=0).stop 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 msgr2=0x7f59d019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59c800cce0 tx=0x7f59c800a620 comp rx=0 tx=0).stop 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 shutdown_connections 2024-09-16T01:00:34.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f59bc0a3240 0x7f59bc0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59d0106f10 0x7f59d019cc90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59d0102790 0x7f59d0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 --2- 172.21.15.17:0/3798888613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d0101de0 0x7f59d01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 >> 172.21.15.17:0/3798888613 conn(0x7f59d00fd8c0 msgr2=0x7f59d00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 shutdown_connections 2024-09-16T01:00:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:34.452+0000 7f59d72cf640 1 -- 172.21.15.17:0/3798888613 wait complete. 2024-09-16T01:00:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:34 smithi017 ceph-mon[31211]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:00:34.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:34 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:00:34.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:34 smithi088 ceph-mon[34093]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:00:34.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:34 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:00:34.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:34 smithi154 ceph-mon[34759]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:00:34.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:34 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:00:35.143 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-16T01:00:35.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-16T01:00:35.407 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:35.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:35 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:00:35.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:35 smithi017 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/3354464635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 msgr2=0x7ff49c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/3354464635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c10d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff494009930 tx=0x7ff49402a420 comp rx=0 tx=0).stop 2024-09-16T01:00:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/3354464635 shutdown_connections 2024-09-16T01:00:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/3354464635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c10d950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/3354464635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 0x7ff49c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/3354464635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/3354464635 >> 172.21.15.17:0/3354464635 conn(0x7ff49c0fc7a0 msgr2=0x7ff49c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/3354464635 shutdown_connections 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.878+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/3354464635 wait complete. 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 Processor -- start 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 -- start start 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 0x7ff49c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111e50 con 0x7ff49c101420 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111cd0 con 0x7ff49c106a80 2024-09-16T01:00:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.879+0000 7ff4a1ffb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111fd0 con 0x7ff49c100a80 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55178/0 (socket says 172.21.15.17:55178) 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 -- 172.21.15.17:0/20102585 learned_addr learned my addr 172.21.15.17:0/20102585 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49b7fe640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 0x7ff49c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49bfff640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 -- 172.21.15.17:0/20102585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 msgr2=0x7ff49c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 0x7ff49c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 -- 172.21.15.17:0/20102585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 msgr2=0x7ff49c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 -- 172.21.15.17:0/20102585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c19d240 con 0x7ff49c101420 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49bfff640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff49affd640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c920 tx=0x7ff49000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:35.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490007c70 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c19d530 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff490007e10 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490018820 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.880+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c1a4e10 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.881+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49c100ee0 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.882+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff4900189c0 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.883+0000 7ff498ff9640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 0x7ff4840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.883+0000 7ff49b7fe640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 0x7ff4840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.883+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff4900cf8f0 con 0x7ff49c101420 2024-09-16T01:00:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.884+0000 7ff49b7fe640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 0x7ff4840a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005fd0 tx=0x7ff48c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:35.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:35.887+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff490014030 con 0x7ff49c101420 2024-09-16T01:00:35.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:35 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:00:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:35 smithi088 ceph-mon[34093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:35 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3798888613' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:00:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:35 smithi154 ceph-mon[34759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.098+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ff49c109050 con 0x7ff49c101420 2024-09-16T01:00:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.465+0000 7ff498ff9640 1 -- 172.21.15.17:0/20102585 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ff49009c760 con 0x7ff49c101420 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 msgr2=0x7ff4840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 0x7ff4840a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005fd0 tx=0x7ff48c009680 comp rx=0 tx=0).stop 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 msgr2=0x7ff49c1987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c920 tx=0x7ff49000cde0 comp rx=0 tx=0).stop 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 shutdown_connections 2024-09-16T01:00:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff4840a3240 0x7ff4840a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff49c106a80 0x7ff49c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff49c101420 0x7ff49c1987d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 --2- 172.21.15.17:0/20102585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff49c100a80 0x7ff49c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 >> 172.21.15.17:0/20102585 conn(0x7ff49c0fc7a0 msgr2=0x7ff49c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 shutdown_connections 2024-09-16T01:00:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:36.468+0000 7ff4a1ffb640 1 -- 172.21.15.17:0/20102585 wait complete. 2024-09-16T01:00:36.767 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:36 smithi017 ceph-mon[31211]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-16T01:00:36.767 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:36 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T01:00:36.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:36 smithi088 ceph-mon[34093]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-16T01:00:36.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:36 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T01:00:36.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:36 smithi154 ceph-mon[34759]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-16T01:00:36.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:36 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-16T01:00:37.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-16T01:00:37.458 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:37.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:00:37.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T01:00:37.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:00:37.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:37.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-16T01:00:37.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:37 smithi017 ceph-mon[31211]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-16T01:00:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:37 smithi088 ceph-mon[34093]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/20102585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-16T01:00:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:37 smithi154 ceph-mon[34759]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.965+0000 7efe4ebd2640 1 -- 172.21.15.17:0/4197573992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48102d40 msgr2=0x7efe48103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.965+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/4197573992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48102d40 0x7efe48103120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009900 tx=0x7efe3c02a480 comp rx=0 tx=0).stop 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 -- 172.21.15.17:0/4197573992 shutdown_connections 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/4197573992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 0x7efe4810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/4197573992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48103660 0x7efe4810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/4197573992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48102d40 0x7efe48103120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 -- 172.21.15.17:0/4197573992 >> 172.21.15.17:0/4197573992 conn(0x7efe480fc7a0 msgr2=0x7efe480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 -- 172.21.15.17:0/4197573992 shutdown_connections 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 -- 172.21.15.17:0/4197573992 wait complete. 2024-09-16T01:00:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 Processor -- start 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.966+0000 7efe4ebd2640 1 -- start start 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 0x7efe481009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 0x7efe48101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe48111e20 con 0x7efe48103660 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efe48111ca0 con 0x7efe48102d40 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe48111fa0 con 0x7efe4810c170 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55198/0 (socket says 172.21.15.17:55198) 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 -- 172.21.15.17:0/705602992 learned_addr learned my addr 172.21.15.17:0/705602992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4c96e640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 0x7efe481009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 -- 172.21.15.17:0/705602992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 msgr2=0x7efe48101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4d16f640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 0x7efe48101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 0x7efe48101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 -- 172.21.15.17:0/705602992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 msgr2=0x7efe481009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 0x7efe481009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 -- 172.21.15.17:0/705602992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe481a6820 con 0x7efe48103660 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4c96e640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 0x7efe481009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe47fff640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d740 tx=0x7efe3400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34017070 con 0x7efe48103660 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe481a6b10 con 0x7efe48103660 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe3400de50 con 0x7efe48103660 2024-09-16T01:00:37.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.967+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3400f620 con 0x7efe48103660 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.968+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481a7050 con 0x7efe48103660 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.969+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe48103120 con 0x7efe48103660 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.970+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efe34009c30 con 0x7efe48103660 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.971+0000 7efe45ffb640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 0x7efe380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.971+0000 7efe4c96e640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 0x7efe380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.971+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7efe340cf420 con 0x7efe48103660 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.971+0000 7efe4c96e640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 0x7efe380a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe3c031440 tx=0x7efe3c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:37.975+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe3409c290 con 0x7efe48103660 2024-09-16T01:00:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.190+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7efe48107240 con 0x7efe48103660 2024-09-16T01:00:38.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.484+0000 7efe45ffb640 1 -- 172.21.15.17:0/705602992 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7efe3409bb90 con 0x7efe48103660 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.486+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 msgr2=0x7efe380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 0x7efe380a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe3c031440 tx=0x7efe3c005a20 comp rx=0 tx=0).stop 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 msgr2=0x7efe48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d740 tx=0x7efe3400dc00 comp rx=0 tx=0).stop 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 shutdown_connections 2024-09-16T01:00:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7efe380a3240 0x7efe380a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe4810c170 0x7efe48101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe48103660 0x7efe48100ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 --2- 172.21.15.17:0/705602992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe48102d40 0x7efe481009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 >> 172.21.15.17:0/705602992 conn(0x7efe480fc7a0 msgr2=0x7efe480fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 shutdown_connections 2024-09-16T01:00:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:38.487+0000 7efe4ebd2640 1 -- 172.21.15.17:0/705602992 wait complete. 2024-09-16T01:00:38.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-16T01:00:38.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:active 2024-09-16T01:00:38.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:00:38.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-16T01:00:38.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:38 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:active 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-16T01:00:38.827 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-16T01:00:38.828 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] up:active 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-16T01:00:38.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-16T01:00:38.905 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:38 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:00:39.142 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:00:38.825+0000 7f5db8700640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-16T01:00:39.143 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:00:38.825+0000 7f5db8700640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-16T01:00:39.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-16T01:00:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:39.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:00:39.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:active 2024-09-16T01:00:39.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T01:00:39.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-16T01:00:39.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-16T01:00:39.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:39 smithi017 ceph-mon[31211]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:active 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-16T01:00:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:39 smithi088 ceph-mon[34093]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-16T01:00:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/705602992' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:00:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] up:active 2024-09-16T01:00:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-16T01:00:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-16T01:00:39.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-16T01:00:39.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:39 smithi154 ceph-mon[34759]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-16T01:00:39.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 -- 172.21.15.17:0/948868511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 msgr2=0x7f4244100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 --2- 172.21.15.17:0/948868511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f4244100ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4238009cd0 tx=0x7f423802a8f0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 -- 172.21.15.17:0/948868511 shutdown_connections 2024-09-16T01:00:39.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 --2- 172.21.15.17:0/948868511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 --2- 172.21.15.17:0/948868511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f4244100ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 --2- 172.21.15.17:0/948868511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 0x7f4244106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 -- 172.21.15.17:0/948868511 >> 172.21.15.17:0/948868511 conn(0x7f42440fc7a0 msgr2=0x7f42440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 -- 172.21.15.17:0/948868511 shutdown_connections 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.891+0000 7f42491b9640 1 -- 172.21.15.17:0/948868511 wait complete. 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 Processor -- start 2024-09-16T01:00:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 -- start start 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 0x7f424419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4244110d30 con 0x7f4244100a80 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4244110bb0 con 0x7f4244106a80 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f42491b9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4244110eb0 con 0x7f4244101420 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55214/0 (socket says 172.21.15.17:55214) 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f4242d9d640 1 -- 172.21.15.17:0/899416004 learned_addr learned my addr 172.21.15.17:0/899416004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f424359e640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 0x7f424419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.892+0000 7f424259c640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 -- 172.21.15.17:0/899416004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 msgr2=0x7f424419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 -- 172.21.15.17:0/899416004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 msgr2=0x7f424419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 0x7f424419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 -- 172.21.15.17:0/899416004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424419f4a0 con 0x7f4244100a80 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f424259c640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:39.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f4242d9d640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f423400c920 tx=0x7f423400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234007c70 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424419f790 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4234007e10 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234018820 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.893+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a7070 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.894+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4244100ee0 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.895+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f42340189c0 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.896+0000 7f422bfff640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 0x7f422c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.896+0000 7f424259c640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 0x7f422c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.896+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f42340cfb50 con 0x7f4244100a80 2024-09-16T01:00:39.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.896+0000 7f424259c640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 0x7f422c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f424406b7e0 tx=0x7f4238005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:39.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:39.899+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4234014030 con 0x7f4244100a80 2024-09-16T01:00:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.111+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f42441a7330 con 0x7f4244100a80 2024-09-16T01:00:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.501+0000 7f422bfff640 1 -- 172.21.15.17:0/899416004 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f423409ca50 con 0x7f4244100a80 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 msgr2=0x7f422c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 0x7f422c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f424406b7e0 tx=0x7f4238005ef0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 msgr2=0x7f424419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f423400c920 tx=0x7f423400cde0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 shutdown_connections 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f422c0a3240 0x7f422c0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4244106a80 0x7f424419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244101420 0x7f424419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 --2- 172.21.15.17:0/899416004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4244100a80 0x7f424419a4f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 >> 172.21.15.17:0/899416004 conn(0x7f42440fc7a0 msgr2=0x7f424406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 shutdown_connections 2024-09-16T01:00:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:40.503+0000 7f42491b9640 1 -- 172.21.15.17:0/899416004 wait complete. 2024-09-16T01:00:40.877 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:active 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: Cluster is now healthy 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-16T01:00:40.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:40 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:active 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: Cluster is now healthy 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-16T01:00:40.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:40 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:00:40.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 5 op/s 2024-09-16T01:00:40.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] up:active 2024-09-16T01:00:40.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: Cluster is now healthy 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-16T01:00:40.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:40 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:00:41.214 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-16T01:00:41.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-16T01:00:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:41.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:41 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:00:41.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:41 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:active 2024-09-16T01:00:41.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:41 smithi017 ceph-mon[31211]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-16T01:00:41.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:41 smithi017 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:00:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:41 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:00:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:41 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:active 2024-09-16T01:00:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:41 smithi088 ceph-mon[34093]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-16T01:00:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:41 smithi088 ceph-mon[34093]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:00:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:41 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/899416004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:00:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:41 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] up:active 2024-09-16T01:00:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:41 smithi154 ceph-mon[34759]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-16T01:00:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:41 smithi154 ceph-mon[34759]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2130827636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 msgr2=0x7f4ecc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2130827636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc100ee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009930 tx=0x7f4eb402a420 comp rx=0 tx=0).stop 2024-09-16T01:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2130827636 shutdown_connections 2024-09-16T01:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2130827636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc101420 0x7f4ecc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2130827636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc100ee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2130827636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc106a80 0x7f4ecc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2130827636 >> 172.21.15.17:0/2130827636 conn(0x7f4ecc0fc7a0 msgr2=0x7f4ecc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2130827636 shutdown_connections 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.973+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2130827636 wait complete. 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 Processor -- start 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 -- start start 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 0x7f4ecc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 0x7f4ecc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc110d30 con 0x7f4ecc100a80 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc110bb0 con 0x7f4ecc106a80 2024-09-16T01:00:41.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ed0ebe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc110eb0 con 0x7f4ecc101420 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4eca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4eca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44058/0 (socket says 172.21.15.17:44058) 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4eca59c640 1 -- 172.21.15.17:0/2523389970 learned_addr learned my addr 172.21.15.17:0/2523389970 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.974+0000 7f4ecad9d640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 0x7f4ecc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ec3fff640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 0x7f4ecc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 -- 172.21.15.17:0/2523389970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 msgr2=0x7f4ecc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 0x7f4ecc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 -- 172.21.15.17:0/2523389970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 msgr2=0x7f4ecc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 0x7f4ecc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 -- 172.21.15.17:0/2523389970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc19d370 con 0x7f4ecc100a80 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ecad9d640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 0x7f4ecc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ec3fff640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 0x7f4ecc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4eca59c640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00d770 tx=0x7f4ebc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc017070 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc19d660 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ebc0054d0 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc004cf0 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.975+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc1a4f40 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.976+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc100ee0 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.977+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4ebc004e90 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.978+0000 7f4ec37fe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 0x7f4eb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.978+0000 7f4ec3fff640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 0x7f4eb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.978+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4ebc0cf240 con 0x7f4ecc100a80 2024-09-16T01:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.978+0000 7f4ec3fff640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 0x7f4eb80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4000c00 tx=0x7f4eb4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:41.982+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ebc09c0b0 con 0x7f4ecc100a80 2024-09-16T01:00:42.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.181+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ecc062630 con 0x7f4eb80a3240 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.213+0000 7f4ec37fe640 1 -- 172.21.15.17:0/2523389970 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ecc062630 con 0x7f4eb80a3240 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.215+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 msgr2=0x7f4eb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.215+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 0x7f4eb80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4000c00 tx=0x7f4eb4031400 comp rx=0 tx=0).stop 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.215+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 msgr2=0x7f4ecc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.215+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00d770 tx=0x7f4ebc00dc30 comp rx=0 tx=0).stop 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 shutdown_connections 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4eb80a3240 0x7f4eb80a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ecc106a80 0x7f4ecc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ecc101420 0x7f4ecc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 --2- 172.21.15.17:0/2523389970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ecc100a80 0x7f4ecc1983c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 >> 172.21.15.17:0/2523389970 conn(0x7f4ecc0fc7a0 msgr2=0x7f4ecc06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 shutdown_connections 2024-09-16T01:00:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:42.216+0000 7f4ed0ebe640 1 -- 172.21.15.17:0/2523389970 wait complete. 2024-09-16T01:00:42.543 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:00:42.186+0000 7ffa4f13e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:00:42.543 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:00:42.186+0000 7ffa4f13e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:00:42.543 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:00:42.186+0000 7ffa4f13e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:00:42.543 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:00:42.186+0000 7ffa4f13e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:00:42.543 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:00:42.186+0000 7ffa4f13e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:00:42.871 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:42 smithi017 ceph-mon[31211]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 5.0 KiB/s wr, 15 op/s 2024-09-16T01:00:42.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:42 smithi088 ceph-mon[34093]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 5.0 KiB/s wr, 15 op/s 2024-09-16T01:00:42.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:42 smithi154 ceph-mon[34759]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 5.0 KiB/s wr, 15 op/s 2024-09-16T01:00:42.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-16T01:00:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:43.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:43 smithi017 ceph-mon[31211]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 -- 172.21.15.17:0/2583868357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84101420 msgr2=0x7f5f8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/2583868357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84101420 0x7f5f8410d950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009cd0 tx=0x7f5f7c02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 -- 172.21.15.17:0/2583868357 shutdown_connections 2024-09-16T01:00:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/2583868357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84101420 0x7f5f8410d950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/2583868357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/2583868357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84106a80 0x7f5f84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 -- 172.21.15.17:0/2583868357 >> 172.21.15.17:0/2583868357 conn(0x7f5f840fc7a0 msgr2=0x7f5f840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 -- 172.21.15.17:0/2583868357 shutdown_connections 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.654+0000 7f5f88dbc640 1 -- 172.21.15.17:0/2583868357 wait complete. 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 Processor -- start 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 -- start start 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84101420 0x7f5f84199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110dd0 con 0x7f5f84106a80 2024-09-16T01:00:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110c50 con 0x7f5f84100a80 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f88dbc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84110f50 con 0x7f5f84101420 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44088/0 (socket says 172.21.15.17:44088) 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 -- 172.21.15.17:0/1813513255 learned_addr learned my addr 172.21.15.17:0/1813513255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f79d9b640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84101420 0x7f5f84199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f8259c640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 -- 172.21.15.17:0/1813513255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84101420 msgr2=0x7f5f84199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84101420 0x7f5f84199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 -- 172.21.15.17:0/1813513255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 msgr2=0x7f5f84199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.655+0000 7f5f82d9d640 1 -- 172.21.15.17:0/1813513255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f841a48e0 con 0x7f5f84106a80 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f8259c640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f82d9d640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c005cc0 tx=0x7f5f7c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004240 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f841a4ab0 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f7c0305a0 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0466c0 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.656+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f841a4fe0 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.657+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f84100f60 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.658+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f7c030ac0 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.659+0000 7f5f7bfff640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 0x7f5f700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.659+0000 7f5f8259c640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 0x7f5f700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.659+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5f7c02e030 con 0x7f5f84106a80 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.659+0000 7f5f8259c640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 0x7f5f700a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009930 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.663+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f7c0f7080 con 0x7f5f84106a80 2024-09-16T01:00:43.826 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:43 smithi088 ceph-mon[34093]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:43.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.864+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5f84109080 con 0x7f5f700a32d0 2024-09-16T01:00:43.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.891+0000 7f5f7bfff640 1 -- 172.21.15.17:0/1813513255 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f74009140 con 0x7f5f700a32d0 2024-09-16T01:00:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 msgr2=0x7f5f700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 0x7f5f700a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009930 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2024-09-16T01:00:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 msgr2=0x7f5f841a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c005cc0 tx=0x7f5f7c003ba0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 shutdown_connections 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5f700a32d0 0x7f5f700a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f84106a80 0x7f5f841a43a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f84101420 0x7f5f84199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 --2- 172.21.15.17:0/1813513255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f84100a80 0x7f5f84199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 >> 172.21.15.17:0/1813513255 conn(0x7f5f840fc7a0 msgr2=0x7f5f840fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 shutdown_connections 2024-09-16T01:00:43.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:43.893+0000 7f5f88dbc640 1 -- 172.21.15.17:0/1813513255 wait complete. 2024-09-16T01:00:43.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:43 smithi154 ceph-mon[34759]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:44.142 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:00:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:00:43.825+0000 7f5db8700640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-16T01:00:44.584 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:44 smithi017 ceph-mon[31211]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-09-16T01:00:44.584 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:44 smithi017 ceph-mon[31211]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:00:44.584 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:44 smithi017 ceph-mon[31211]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:44.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-16T01:00:44.805 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:44 smithi154 ceph-mon[34759]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-09-16T01:00:44.805 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:44 smithi154 ceph-mon[34759]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:00:44.805 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:44 smithi154 ceph-mon[34759]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:44.874 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:44.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:44 smithi088 ceph-mon[34093]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-09-16T01:00:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:44 smithi088 ceph-mon[34093]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:00:44.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:44 smithi088 ceph-mon[34093]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:45.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.382+0000 7f70ee329640 1 -- 172.21.15.17:0/3507002521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8102d40 msgr2=0x7f70e8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.382+0000 7f70ee329640 1 --2- 172.21.15.17:0/3507002521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8102d40 0x7f70e8103120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009900 tx=0x7f70d802a480 comp rx=0 tx=0).stop 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 -- 172.21.15.17:0/3507002521 shutdown_connections 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 --2- 172.21.15.17:0/3507002521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e810c170 0x7f70e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 --2- 172.21.15.17:0/3507002521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e8103660 0x7f70e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 --2- 172.21.15.17:0/3507002521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8102d40 0x7f70e8103120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 -- 172.21.15.17:0/3507002521 >> 172.21.15.17:0/3507002521 conn(0x7f70e80fc7a0 msgr2=0x7f70e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 -- 172.21.15.17:0/3507002521 shutdown_connections 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 -- 172.21.15.17:0/3507002521 wait complete. 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 Processor -- start 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.383+0000 7f70ee329640 1 -- start start 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e8102d40 0x7f70e81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:45.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e810c170 0x7f70e8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:45.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111e20 con 0x7f70e8103660 2024-09-16T01:00:45.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111ca0 con 0x7f70e8102d40 2024-09-16T01:00:45.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111fa0 con 0x7f70e810c170 2024-09-16T01:00:45.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:45.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44106/0 (socket says 172.21.15.17:44106) 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 -- 172.21.15.17:0/3188839173 learned_addr learned my addr 172.21.15.17:0/3188839173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e7fff640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e8102d40 0x7f70e81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ec8c6640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e810c170 0x7f70e8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 -- 172.21.15.17:0/3188839173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e810c170 msgr2=0x7f70e8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e810c170 0x7f70e8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 -- 172.21.15.17:0/3188839173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e8102d40 msgr2=0x7f70e81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e8102d40 0x7f70e81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 -- 172.21.15.17:0/3188839173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81a6840 con 0x7f70e8103660 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e77fe640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00e9f0 tx=0x7f70dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00ccc0 con 0x7f70e8103660 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70dc0108e0 con 0x7f70e8103660 2024-09-16T01:00:45.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81a6b30 con 0x7f70e8103660 2024-09-16T01:00:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.384+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0187c0 con 0x7f70e8103660 2024-09-16T01:00:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.385+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81a7070 con 0x7f70e8103660 2024-09-16T01:00:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.386+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8103120 con 0x7f70e8103660 2024-09-16T01:00:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.387+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f70dc010430 con 0x7f70e8103660 2024-09-16T01:00:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.387+0000 7f70e57fa640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 0x7f70d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.388+0000 7f70e7fff640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 0x7f70d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.388+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f70dc0cfc00 con 0x7f70e8103660 2024-09-16T01:00:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.388+0000 7f70e7fff640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 0x7f70d00a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70d8031440 tx=0x7f70d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.392+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70dc0d5020 con 0x7f70e8103660 2024-09-16T01:00:45.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.596+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f70e8062630 con 0x7f70d00a32d0 2024-09-16T01:00:45.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.601+0000 7f70e57fa640 1 -- 172.21.15.17:0/3188839173 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f70e8062630 con 0x7f70d00a32d0 2024-09-16T01:00:45.602 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_0/cfb26b32-7fd5-4b46-b0d9-a047bdbfd2e6 2024-09-16T01:00:45.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.602+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 msgr2=0x7f70d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.602+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 0x7f70d00a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70d8031440 tx=0x7f70d8005b50 comp rx=0 tx=0).stop 2024-09-16T01:00:45.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.602+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 msgr2=0x7f70e8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.602+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00e9f0 tx=0x7f70dc00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 shutdown_connections 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f70d00a32d0 0x7f70d00a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e810c170 0x7f70e8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70e8103660 0x7f70e8100ee0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 --2- 172.21.15.17:0/3188839173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70e8102d40 0x7f70e81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 >> 172.21.15.17:0/3188839173 conn(0x7f70e80fc7a0 msgr2=0x7f70e80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 shutdown_connections 2024-09-16T01:00:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:45.603+0000 7f70ee329640 1 -- 172.21.15.17:0/3188839173 wait complete. 2024-09-16T01:00:46.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-16T01:00:46.683 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:46.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:46 smithi017 ceph-mon[31211]: pgmap v286: 97 pgs: 97 active+clean; 585 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-16T01:00:46.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:46 smithi017 ceph-mon[31211]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:46.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:46 smithi088 ceph-mon[34093]: pgmap v286: 97 pgs: 97 active+clean; 585 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-16T01:00:46.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:46 smithi088 ceph-mon[34093]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:46.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:46 smithi154 ceph-mon[34759]: pgmap v286: 97 pgs: 97 active+clean; 585 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-16T01:00:46.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:46 smithi154 ceph-mon[34759]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:47.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 -- 172.21.15.17:0/3891742262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674106a80 msgr2=0x7ff674106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:47.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/3891742262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674106a80 0x7ff674106e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff670009930 tx=0x7ff67002a420 comp rx=0 tx=0).stop 2024-09-16T01:00:47.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 -- 172.21.15.17:0/3891742262 shutdown_connections 2024-09-16T01:00:47.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/3891742262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 0x7ff67410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/3891742262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674100a80 0x7ff674100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/3891742262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674106a80 0x7ff674106e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 -- 172.21.15.17:0/3891742262 >> 172.21.15.17:0/3891742262 conn(0x7ff6740fc7a0 msgr2=0x7ff6740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 -- 172.21.15.17:0/3891742262 shutdown_connections 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.157+0000 7ff67b7a1640 1 -- 172.21.15.17:0/3891742262 wait complete. 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 Processor -- start 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 -- start start 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 0x7ff6741988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674106a80 0x7ff67419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff674111e10 con 0x7ff674100a80 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff674111c90 con 0x7ff674106a80 2024-09-16T01:00:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67b7a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff674111f90 con 0x7ff674101420 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67953d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67953d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44126/0 (socket says 172.21.15.17:44126) 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff67953d640 1 -- 172.21.15.17:0/1527448328 learned_addr learned my addr 172.21.15.17:0/1527448328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff678d3c640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 0x7ff6741988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.158+0000 7ff679d3e640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674106a80 0x7ff67419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 -- 172.21.15.17:0/1527448328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 msgr2=0x7ff6741988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 0x7ff6741988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 -- 172.21.15.17:0/1527448328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674106a80 msgr2=0x7ff67419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674106a80 0x7ff67419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 -- 172.21.15.17:0/1527448328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67419d320 con 0x7ff674100a80 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67953d640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff670004770 tx=0x7ff6700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67003f070 con 0x7ff674100a80 2024-09-16T01:00:47.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff67003b460 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670035070 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67419d5b0 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.159+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6741a4ef0 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.160+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6741021c0 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.161+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff67003b610 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.162+0000 7ff66a7fc640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 0x7ff6600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.162+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff6700efbd0 con 0x7ff674100a80 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.162+0000 7ff678d3c640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 0x7ff6600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.162+0000 7ff678d3c640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 0x7ff6600a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6740fee70 tx=0x7ff66400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.166+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6700bc2f0 con 0x7ff674100a80 2024-09-16T01:00:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.368+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff674109060 con 0x7ff6600a32d0 2024-09-16T01:00:47.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.392+0000 7ff66a7fc640 1 -- 172.21.15.17:0/1527448328 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff664010be0 con 0x7ff6600a32d0 2024-09-16T01:00:47.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 msgr2=0x7ff6600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 0x7ff6600a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6740fee70 tx=0x7ff66400b390 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 msgr2=0x7ff674198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff670004770 tx=0x7ff6700042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 shutdown_connections 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6600a32d0 0x7ff6600a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff674106a80 0x7ff67419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff674101420 0x7ff6741988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 --2- 172.21.15.17:0/1527448328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff674100a80 0x7ff674198370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 >> 172.21.15.17:0/1527448328 conn(0x7ff6740fc7a0 msgr2=0x7ff6740fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 shutdown_connections 2024-09-16T01:00:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:47.394+0000 7ff67b7a1640 1 -- 172.21.15.17:0/1527448328 wait complete. 2024-09-16T01:00:48.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-16T01:00:48.348 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:48.757 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:48 smithi017 ceph-mon[31211]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-16T01:00:48.757 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:48 smithi017 ceph-mon[31211]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.842+0000 7fa286d30640 1 -- 172.21.15.17:0/3579108053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280102d90 msgr2=0x7fa280103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.842+0000 7fa286d30640 1 --2- 172.21.15.17:0/3579108053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280102d90 0x7fa280103170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa274009930 tx=0x7fa27402a420 comp rx=0 tx=0).stop 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- 172.21.15.17:0/3579108053 shutdown_connections 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- 172.21.15.17:0/3579108053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 0x7fa28010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- 172.21.15.17:0/3579108053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280103740 0x7fa280107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- 172.21.15.17:0/3579108053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280102d90 0x7fa280103170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- 172.21.15.17:0/3579108053 >> 172.21.15.17:0/3579108053 conn(0x7fa2800fc7d0 msgr2=0x7fa2800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- 172.21.15.17:0/3579108053 shutdown_connections 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- 172.21.15.17:0/3579108053 wait complete. 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 Processor -- start 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- start start 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 0x7fa280198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 0x7fa28019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa280112000 con 0x7fa280103740 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa280111e80 con 0x7fa280102d90 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.843+0000 7fa286d30640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa280112180 con 0x7fa280108290 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44140/0 (socket says 172.21.15.17:44140) 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 -- 172.21.15.17:0/576955428 learned_addr learned my addr 172.21.15.17:0/576955428 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa284acc640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 0x7fa280198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 -- 172.21.15.17:0/576955428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 msgr2=0x7fa28019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa2852cd640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 0x7fa28019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 0x7fa28019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 -- 172.21.15.17:0/576955428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 msgr2=0x7fa280198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 0x7fa280198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 -- 172.21.15.17:0/576955428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28019d5b0 con 0x7fa280103740 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa284acc640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 0x7fa280198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27ffff640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00b450 tx=0x7fa26c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c015020 con 0x7fa280103740 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa26c011d40 con 0x7fa280103740 2024-09-16T01:00:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00f340 con 0x7fa280103740 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.844+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28019d8a0 con 0x7fa280103740 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.845+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a5180 con 0x7fa280103740 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.845+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2801031f0 con 0x7fa280103740 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.847+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa26c018020 con 0x7fa280103740 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.847+0000 7fa27dffb640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 0x7fa2700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.847+0000 7fa284acc640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 0x7fa2700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.847+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa26c0cf2b0 con 0x7fa280103740 2024-09-16T01:00:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.848+0000 7fa284acc640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 0x7fa2700a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa274031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:48.851+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa26c01f020 con 0x7fa280103740 2024-09-16T01:00:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:48 smithi088 ceph-mon[34093]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-16T01:00:48.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:48 smithi088 ceph-mon[34093]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:48.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:48 smithi154 ceph-mon[34759]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-16T01:00:48.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:48 smithi154 ceph-mon[34759]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:49.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.059+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa28010a2d0 con 0x7fa2700a3350 2024-09-16T01:00:49.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.064+0000 7fa27dffb640 1 -- 172.21.15.17:0/576955428 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa28010a2d0 con 0x7fa2700a3350 2024-09-16T01:00:49.065 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_1/2b658de5-2a11-4ffb-a221-98e3f4d9694c 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 msgr2=0x7fa2700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 0x7fa2700a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa274031400 comp rx=0 tx=0).stop 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 msgr2=0x7fa280198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00b450 tx=0x7fa26c00b910 comp rx=0 tx=0).stop 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 shutdown_connections 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fa2700a3350 0x7fa2700a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa280108290 0x7fa28019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa280103740 0x7fa280198b40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 --2- 172.21.15.17:0/576955428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa280102d90 0x7fa280198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 >> 172.21.15.17:0/576955428 conn(0x7fa2800fc7d0 msgr2=0x7fa280105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.066+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 shutdown_connections 2024-09-16T01:00:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:49.067+0000 7fa286d30640 1 -- 172.21.15.17:0/576955428 wait complete. 2024-09-16T01:00:49.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:00:50.099 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 -- 172.21.15.17:0/571323053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 msgr2=0x7f9594106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 --2- 172.21.15.17:0/571323053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594106840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9588009930 tx=0x7f958802a420 comp rx=0 tx=0).stop 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 -- 172.21.15.17:0/571323053 shutdown_connections 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 --2- 172.21.15.17:0/571323053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594106f50 0x7f959410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 --2- 172.21.15.17:0/571323053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594106840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 --2- 172.21.15.17:0/571323053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594100350 0x7f9594100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 -- 172.21.15.17:0/571323053 >> 172.21.15.17:0/571323053 conn(0x7f9594077210 msgr2=0x7f95940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 -- 172.21.15.17:0/571323053 shutdown_connections 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.540+0000 7f9599857640 1 -- 172.21.15.17:0/571323053 wait complete. 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 Processor -- start 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 -- start start 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594100350 0x7f95941012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594106f50 0x7f9594101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9594111e90 con 0x7f9594100d00 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9594111d10 con 0x7f9594106f50 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9599857640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9594112010 con 0x7f9594100350 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f95927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f95927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37070/0 (socket says 172.21.15.17:37070) 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f95927fc640 1 -- 172.21.15.17:0/2063818833 learned_addr learned my addr 172.21.15.17:0/2063818833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f95937fe640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594106f50 0x7f9594101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.541+0000 7f9592ffd640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594100350 0x7f95941012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 -- 172.21.15.17:0/2063818833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594100350 msgr2=0x7f95941012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594100350 0x7f95941012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 -- 172.21.15.17:0/2063818833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594106f50 msgr2=0x7f9594101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594106f50 0x7f9594101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 -- 172.21.15.17:0/2063818833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95941a6930 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f95927fc640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9588031440 tx=0x7f9588004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958803f030 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95941a6bc0 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9588003aa0 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588035070 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.542+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95941a70a0 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.543+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9594100730 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.545+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9588042030 con 0x7f9594100d00 2024-09-16T01:00:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.546+0000 7f9598855640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 0x7f957c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:50.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.546+0000 7f9592ffd640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 0x7f957c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:50.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.546+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f95880f0440 con 0x7f9594100d00 2024-09-16T01:00:50.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.546+0000 7f9592ffd640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 0x7f957c0a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f9584009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:50.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.549+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95880bca60 con 0x7f9594100d00 2024-09-16T01:00:50.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.759+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f959410a120 con 0x7f9594100d00 2024-09-16T01:00:50.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.760+0000 7f9598855640 1 -- 172.21.15.17:0/2063818833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7f95880c0d60 con 0x7f9594100d00 2024-09-16T01:00:50.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:50.762 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:00:50.762 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 msgr2=0x7f957c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 0x7f957c0a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f9584009760 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 msgr2=0x7f9594101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9588031440 tx=0x7f9588004270 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 shutdown_connections 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f957c0a32d0 0x7f957c0a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9594106f50 0x7f9594101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9594100d00 0x7f9594101810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 --2- 172.21.15.17:0/2063818833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9594100350 0x7f95941012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 >> 172.21.15.17:0/2063818833 conn(0x7f9594077210 msgr2=0x7f9594105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 shutdown_connections 2024-09-16T01:00:50.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:50.762+0000 7f9599857640 1 -- 172.21.15.17:0/2063818833 wait complete. 2024-09-16T01:00:50.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:50 smithi088 ceph-mon[34093]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-16T01:00:50.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:50 smithi088 ceph-mon[34093]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:50 smithi154 ceph-mon[34759]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-16T01:00:50.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:50 smithi154 ceph-mon[34759]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:50 smithi017 ceph-mon[31211]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-16T01:00:50.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:50 smithi017 ceph-mon[31211]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:00:51.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:00:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:51 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2063818833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:51.718 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:51.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:51 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2063818833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:51 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2063818833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:00:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/3783809029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec106f10 msgr2=0x7f7bec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/3783809029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec106f10 0x7f7bec10ea90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009900 tx=0x7f7be402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/3783809029 shutdown_connections 2024-09-16T01:00:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/3783809029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec106f10 0x7f7bec10ea90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/3783809029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec102790 0x7f7bec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/3783809029 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec101de0 0x7f7bec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/3783809029 >> 172.21.15.17:0/3783809029 conn(0x7f7bec0fd8c0 msgr2=0x7f7bec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/3783809029 shutdown_connections 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.174+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/3783809029 wait complete. 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 Processor -- start 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 -- start start 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec101de0 0x7f7bec198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec106f10 0x7f7bec19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec111e20 con 0x7f7bec102790 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec111ca0 con 0x7f7bec106f10 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf2ac7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec111fa0 con 0x7f7bec101de0 2024-09-16T01:00:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37088/0 (socket says 172.21.15.17:37088) 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bebfff640 1 -- 172.21.15.17:0/891448135 learned_addr learned my addr 172.21.15.17:0/891448135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf0863640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec101de0 0x7f7bec198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bf1064640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec106f10 0x7f7bec19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bebfff640 1 -- 172.21.15.17:0/891448135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec101de0 msgr2=0x7f7bec198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.175+0000 7f7bebfff640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec101de0 0x7f7bec198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bebfff640 1 -- 172.21.15.17:0/891448135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec106f10 msgr2=0x7f7bec19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bebfff640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec106f10 0x7f7bec19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bebfff640 1 -- 172.21.15.17:0/891448135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec19d1f0 con 0x7f7bec102790 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bebfff640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00cce0 tx=0x7f7bdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00f650 con 0x7f7bec102790 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7bdc00fca0 con 0x7f7bec102790 2024-09-16T01:00:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec19d4e0 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc018b90 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.176+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1a4dc0 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.177+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec1021c0 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.178+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7bdc00f7f0 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.179+0000 7f7be9ffb640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 0x7f7bd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.179+0000 7f7bf0863640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 0x7f7bd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.179+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7bdc0cfdc0 con 0x7f7bec102790 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.180+0000 7f7bf0863640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 0x7f7bd80a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005fd0 tx=0x7f7bd400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.183+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bdc014030 con 0x7f7bec102790 2024-09-16T01:00:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.363+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bec02d7c0 con 0x7f7bec102790 2024-09-16T01:00:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.365+0000 7f7be9ffb640 1 -- 172.21.15.17:0/891448135 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22205 (secure 0 0 0) 0x7f7bdc09cb30 con 0x7f7bec102790 2024-09-16T01:00:52.367 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:52.367 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:00:29.073282+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:00:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 msgr2=0x7f7bd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 0x7f7bd80a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005fd0 tx=0x7f7bd400b590 comp rx=0 tx=0).stop 2024-09-16T01:00:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 msgr2=0x7f7bec198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00cce0 tx=0x7f7bdc00a620 comp rx=0 tx=0).stop 2024-09-16T01:00:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 shutdown_connections 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7bd80a32d0 0x7f7bd80a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7bec106f10 0x7f7bec19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bec102790 0x7f7bec198780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 --2- 172.21.15.17:0/891448135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec101de0 0x7f7bec198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 >> 172.21.15.17:0/891448135 conn(0x7f7bec0fd8c0 msgr2=0x7f7bec0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 shutdown_connections 2024-09-16T01:00:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:52.368+0000 7f7bf2ac7640 1 -- 172.21.15.17:0/891448135 wait complete. 2024-09-16T01:00:52.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:52 smithi017 ceph-mon[31211]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-16T01:00:52.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:52 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/891448135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:52.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:52 smithi088 ceph-mon[34093]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-16T01:00:52.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:52 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/891448135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:52.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:52 smithi154 ceph-mon[34759]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-16T01:00:52.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:52 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/891448135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:00:53.080 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:00:53.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:00:53.337 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- 172.21.15.17:0/1484082640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20102570 msgr2=0x7fdf201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1484082640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20102570 0x7fdf201029b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009900 tx=0x7fdf1402a480 comp rx=0 tx=0).stop 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- 172.21.15.17:0/1484082640 shutdown_connections 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1484082640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 0x7fdf2010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1484082640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20102570 0x7fdf201029b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1484082640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20100e20 0x7fdf20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- 172.21.15.17:0/1484082640 >> 172.21.15.17:0/1484082640 conn(0x7fdf200fc7d0 msgr2=0x7fdf200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- 172.21.15.17:0/1484082640 shutdown_connections 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- 172.21.15.17:0/1484082640 wait complete. 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 Processor -- start 2024-09-16T01:00:53.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.801+0000 7fdf2656e640 1 -- start start 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20102570 0x7fdf2010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 0x7fdf2010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20111fd0 con 0x7fdf20100e20 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20111e50 con 0x7fdf20102570 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf2656e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20112150 con 0x7fdf20102ef0 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37108/0 (socket says 172.21.15.17:37108) 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 -- 172.21.15.17:0/1156175821 learned_addr learned my addr 172.21.15.17:0/1156175821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf24b0b640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 0x7fdf2010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1f7fe640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20102570 0x7fdf2010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 -- 172.21.15.17:0/1156175821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 msgr2=0x7fdf2010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 0x7fdf2010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 -- 172.21.15.17:0/1156175821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20102570 msgr2=0x7fdf2010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20102570 0x7fdf2010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.802+0000 7fdf1ffff640 1 -- 172.21.15.17:0/1156175821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201a6990 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf1ffff640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b4a0 tx=0x7fdf1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10014070 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201a6c80 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf10010ac0 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10017c30 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.803+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a71c0 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.804+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf20101200 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.805+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdf10017070 con 0x7fdf20100e20 2024-09-16T01:00:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.806+0000 7fdf1d7fa640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 0x7fdf080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:53.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.806+0000 7fdf1f7fe640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 0x7fdf080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:53.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.806+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fdf100ceea0 con 0x7fdf20100e20 2024-09-16T01:00:53.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.806+0000 7fdf1f7fe640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 0x7fdf080a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf2010ff60 tx=0x7fdf14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:53.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.810+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf1009bd20 con 0x7fdf20100e20 2024-09-16T01:00:53.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.982+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf20062630 con 0x7fdf080a32d0 2024-09-16T01:00:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.989+0000 7fdf1d7fa640 1 -- 172.21.15.17:0/1156175821 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258871 (secure 0 0 0) 0x7fdf20062630 con 0x7fdf080a32d0 2024-09-16T01:00:53.993 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.993+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 msgr2=0x7fdf080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.993+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 0x7fdf080a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf2010ff60 tx=0x7fdf14005a20 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.993+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 msgr2=0x7fdf2010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b4a0 tx=0x7fdf1000b960 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 shutdown_connections 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdf080a32d0 0x7fdf080a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20102ef0 0x7fdf2010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20102570 0x7fdf2010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 --2- 172.21.15.17:0/1156175821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf20100e20 0x7fdf2010e4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 >> 172.21.15.17:0/1156175821 conn(0x7fdf200fc7d0 msgr2=0x7fdf200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 shutdown_connections 2024-09-16T01:00:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:53.994+0000 7fdf2656e640 1 -- 172.21.15.17:0/1156175821 wait complete. 2024-09-16T01:00:54.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:54 smithi017 ceph-mon[31211]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2024-09-16T01:00:54.726 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-16T01:00:52.920009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645398,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":287,"num_read_kb":258,"num_write":417,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376652,"kb_used_data":10764,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565172,"statfs":{"total":1151940427776,"available":1151554736128,"internally_reserved":0,"allocated":11022336,"data_stored":6929226,"data_compressed":108792,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47854,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":73,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002954"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451354+0000","last_change":"2024-09-16T01:00:28.449298+0000","last_active":"2024-09-16T01:00:29.451354+0000","last_peered":"2024-09-16T01:00:29.451354+0000","last_clean":"2024-09-16T01:00:29.451354+0000","last_became_active":"2024-09-16T01:00:28.448925+0000","last_became_peered":"2024-09-16T01:00:28.448925+0000","last_unstale":"2024-09-16T01:00:29.451354+0000","last_undegraded":"2024-09-16T01:00:29.451354+0000","last_fullsized":"2024-09-16T01:00:29.451354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:54.432714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447088+0000","last_change":"2024-09-16T01:00:28.440068+0000","last_active":"2024-09-16T01:00:29.447088+0000","last_peered":"2024-09-16T01:00:29.447088+0000","last_clean":"2024-09-16T01:00:29.447088+0000","last_became_active":"2024-09-16T01:00:28.439730+0000","last_became_peered":"2024-09-16T01:00:28.439730+0000","last_unstale":"2024-09-16T01:00:29.447088+0000","last_undegraded":"2024-09-16T01:00:29.447088+0000","last_fullsized":"2024-09-16T01:00:29.447088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.021941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447237+0000","last_change":"2024-09-16T01:00:28.451754+0000","last_active":"2024-09-16T01:00:29.447237+0000","last_peered":"2024-09-16T01:00:29.447237+0000","last_clean":"2024-09-16T01:00:29.447237+0000","last_became_active":"2024-09-16T01:00:28.451418+0000","last_became_peered":"2024-09-16T01:00:28.451418+0000","last_unstale":"2024-09-16T01:00:29.447237+0000","last_undegraded":"2024-09-16T01:00:29.447237+0000","last_fullsized":"2024-09-16T01:00:29.447237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:10.383137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446778+0000","last_change":"2024-09-16T01:00:28.451256+0000","last_active":"2024-09-16T01:00:29.446778+0000","last_peered":"2024-09-16T01:00:29.446778+0000","last_clean":"2024-09-16T01:00:29.446778+0000","last_became_active":"2024-09-16T01:00:28.450929+0000","last_became_peered":"2024-09-16T01:00:28.450929+0000","last_unstale":"2024-09-16T01:00:29.446778+0000","last_undegraded":"2024-09-16T01:00:29.446778+0000","last_fullsized":"2024-09-16T01:00:29.446778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446924+0000","last_change":"2024-09-16T01:00:28.436789+0000","last_active":"2024-09-16T01:00:29.446924+0000","last_peered":"2024-09-16T01:00:29.446924+0000","last_clean":"2024-09-16T01:00:29.446924+0000","last_became_active":"2024-09-16T01:00:28.436386+0000","last_became_peered":"2024-09-16T01:00:28.436386+0000","last_unstale":"2024-09-16T01:00:29.446924+0000","last_undegraded":"2024-09-16T01:00:29.446924+0000","last_fullsized":"2024-09-16T01:00:29.446924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:07.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446537+0000","last_change":"2024-09-16T01:00:28.449819+0000","last_active":"2024-09-16T01:00:29.446537+0000","last_peered":"2024-09-16T01:00:29.446537+0000","last_clean":"2024-09-16T01:00:29.446537+0000","last_became_active":"2024-09-16T01:00:28.449474+0000","last_became_peered":"2024-09-16T01:00:28.449474+0000","last_unstale":"2024-09-16T01:00:29.446537+0000","last_undegraded":"2024-09-16T01:00:29.446537+0000","last_fullsized":"2024-09-16T01:00:29.446537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:21.879279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447035+0000","last_change":"2024-09-16T01:00:28.442449+0000","last_active":"2024-09-16T01:00:29.447035+0000","last_peered":"2024-09-16T01:00:29.447035+0000","last_clean":"2024-09-16T01:00:29.447035+0000","last_became_active":"2024-09-16T01:00:28.442087+0000","last_became_peered":"2024-09-16T01:00:28.442087+0000","last_unstale":"2024-09-16T01:00:29.447035+0000","last_undegraded":"2024-09-16T01:00:29.447035+0000","last_fullsized":"2024-09-16T01:00:29.447035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:01.996570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430109+0000","last_change":"2024-09-16T01:00:28.443923+0000","last_active":"2024-09-16T01:00:29.430109+0000","last_peered":"2024-09-16T01:00:29.430109+0000","last_clean":"2024-09-16T01:00:29.430109+0000","last_became_active":"2024-09-16T01:00:28.443598+0000","last_became_peered":"2024-09-16T01:00:28.443598+0000","last_unstale":"2024-09-16T01:00:29.430109+0000","last_undegraded":"2024-09-16T01:00:29.430109+0000","last_fullsized":"2024-09-16T01:00:29.430109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:55.479224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431754+0000","last_change":"2024-09-16T01:00:28.451668+0000","last_active":"2024-09-16T01:00:29.431754+0000","last_peered":"2024-09-16T01:00:29.431754+0000","last_clean":"2024-09-16T01:00:29.431754+0000","last_became_active":"2024-09-16T01:00:28.451360+0000","last_became_peered":"2024-09-16T01:00:28.451360+0000","last_unstale":"2024-09-16T01:00:29.431754+0000","last_undegraded":"2024-09-16T01:00:29.431754+0000","last_fullsized":"2024-09-16T01:00:29.431754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:32.969507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446207+0000","last_change":"2024-09-16T01:00:28.450791+0000","last_active":"2024-09-16T01:00:29.446207+0000","last_peered":"2024-09-16T01:00:29.446207+0000","last_clean":"2024-09-16T01:00:29.446207+0000","last_became_active":"2024-09-16T01:00:28.450408+0000","last_became_peered":"2024-09-16T01:00:28.450408+0000","last_unstale":"2024-09-16T01:00:29.446207+0000","last_undegraded":"2024-09-16T01:00:29.446207+0000","last_fullsized":"2024-09-16T01:00:29.446207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:31.301796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446779+0000","last_change":"2024-09-16T01:00:28.446736+0000","last_active":"2024-09-16T01:00:29.446779+0000","last_peered":"2024-09-16T01:00:29.446779+0000","last_clean":"2024-09-16T01:00:29.446779+0000","last_became_active":"2024-09-16T01:00:28.446201+0000","last_became_peered":"2024-09-16T01:00:28.446201+0000","last_unstale":"2024-09-16T01:00:29.446779+0000","last_undegraded":"2024-09-16T01:00:29.446779+0000","last_fullsized":"2024-09-16T01:00:29.446779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:50.274171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.452266+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.451927+0000","last_became_peered":"2024-09-16T01:00:28.451927+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:10.361046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446281+0000","last_change":"2024-09-16T01:00:28.440957+0000","last_active":"2024-09-16T01:00:29.446281+0000","last_peered":"2024-09-16T01:00:29.446281+0000","last_clean":"2024-09-16T01:00:29.446281+0000","last_became_active":"2024-09-16T01:00:28.440653+0000","last_became_peered":"2024-09-16T01:00:28.440653+0000","last_unstale":"2024-09-16T01:00:29.446281+0000","last_undegraded":"2024-09-16T01:00:29.446281+0000","last_fullsized":"2024-09-16T01:00:29.446281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:15.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446856+0000","last_change":"2024-09-16T01:00:28.443914+0000","last_active":"2024-09-16T01:00:29.446856+0000","last_peered":"2024-09-16T01:00:29.446856+0000","last_clean":"2024-09-16T01:00:29.446856+0000","last_became_active":"2024-09-16T01:00:28.443600+0000","last_became_peered":"2024-09-16T01:00:28.443600+0000","last_unstale":"2024-09-16T01:00:29.446856+0000","last_undegraded":"2024-09-16T01:00:29.446856+0000","last_fullsized":"2024-09-16T01:00:29.446856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:35.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446638+0000","last_change":"2024-09-16T01:00:28.449970+0000","last_active":"2024-09-16T01:00:29.446638+0000","last_peered":"2024-09-16T01:00:29.446638+0000","last_clean":"2024-09-16T01:00:29.446638+0000","last_became_active":"2024-09-16T01:00:28.449464+0000","last_became_peered":"2024-09-16T01:00:28.449464+0000","last_unstale":"2024-09-16T01:00:29.446638+0000","last_undegraded":"2024-09-16T01:00:29.446638+0000","last_fullsized":"2024-09-16T01:00:29.446638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:01.537338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431182+0000","last_change":"2024-09-16T01:00:28.445004+0000","last_active":"2024-09-16T01:00:29.431182+0000","last_peered":"2024-09-16T01:00:29.431182+0000","last_clean":"2024-09-16T01:00:29.431182+0000","last_became_active":"2024-09-16T01:00:28.444503+0000","last_became_peered":"2024-09-16T01:00:28.444503+0000","last_unstale":"2024-09-16T01:00:29.431182+0000","last_undegraded":"2024-09-16T01:00:29.431182+0000","last_fullsized":"2024-09-16T01:00:29.431182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:05.330992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451229+0000","last_change":"2024-09-16T01:00:28.451975+0000","last_active":"2024-09-16T01:00:29.451229+0000","last_peered":"2024-09-16T01:00:29.451229+0000","last_clean":"2024-09-16T01:00:29.451229+0000","last_became_active":"2024-09-16T01:00:28.451582+0000","last_became_peered":"2024-09-16T01:00:28.451582+0000","last_unstale":"2024-09-16T01:00:29.451229+0000","last_undegraded":"2024-09-16T01:00:29.451229+0000","last_fullsized":"2024-09-16T01:00:29.451229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.032697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446326+0000","last_change":"2024-09-16T01:00:28.439491+0000","last_active":"2024-09-16T01:00:29.446326+0000","last_peered":"2024-09-16T01:00:29.446326+0000","last_clean":"2024-09-16T01:00:29.446326+0000","last_became_active":"2024-09-16T01:00:28.439130+0000","last_became_peered":"2024-09-16T01:00:28.439130+0000","last_unstale":"2024-09-16T01:00:29.446326+0000","last_undegraded":"2024-09-16T01:00:29.446326+0000","last_fullsized":"2024-09-16T01:00:29.446326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:33.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446504+0000","last_change":"2024-09-16T01:00:28.448537+0000","last_active":"2024-09-16T01:00:29.446504+0000","last_peered":"2024-09-16T01:00:29.446504+0000","last_clean":"2024-09-16T01:00:29.446504+0000","last_became_active":"2024-09-16T01:00:28.448146+0000","last_became_peered":"2024-09-16T01:00:28.448146+0000","last_unstale":"2024-09-16T01:00:29.446504+0000","last_undegraded":"2024-09-16T01:00:29.446504+0000","last_fullsized":"2024-09-16T01:00:29.446504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:58.466156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450747+0000","last_change":"2024-09-16T01:00:28.452877+0000","last_active":"2024-09-16T01:00:29.450747+0000","last_peered":"2024-09-16T01:00:29.450747+0000","last_clean":"2024-09-16T01:00:29.450747+0000","last_became_active":"2024-09-16T01:00:28.452542+0000","last_became_peered":"2024-09-16T01:00:28.452542+0000","last_unstale":"2024-09-16T01:00:29.450747+0000","last_undegraded":"2024-09-16T01:00:29.450747+0000","last_fullsized":"2024-09-16T01:00:29.450747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:56.337456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446432+0000","last_change":"2024-09-16T01:00:28.442157+0000","last_active":"2024-09-16T01:00:29.446432+0000","last_peered":"2024-09-16T01:00:29.446432+0000","last_clean":"2024-09-16T01:00:29.446432+0000","last_became_active":"2024-09-16T01:00:28.441852+0000","last_became_peered":"2024-09-16T01:00:28.441852+0000","last_unstale":"2024-09-16T01:00:29.446432+0000","last_undegraded":"2024-09-16T01:00:29.446432+0000","last_fullsized":"2024-09-16T01:00:29.446432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:36.503203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431210+0000","last_change":"2024-09-16T01:00:28.443734+0000","last_active":"2024-09-16T01:00:29.431210+0000","last_peered":"2024-09-16T01:00:29.431210+0000","last_clean":"2024-09-16T01:00:29.431210+0000","last_became_active":"2024-09-16T01:00:28.443287+0000","last_became_peered":"2024-09-16T01:00:28.443287+0000","last_unstale":"2024-09-16T01:00:29.431210+0000","last_undegraded":"2024-09-16T01:00:29.431210+0000","last_fullsized":"2024-09-16T01:00:29.431210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:12.920159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430171+0000","last_change":"2024-09-16T01:00:28.448425+0000","last_active":"2024-09-16T01:00:29.430171+0000","last_peered":"2024-09-16T01:00:29.430171+0000","last_clean":"2024-09-16T01:00:29.430171+0000","last_became_active":"2024-09-16T01:00:28.448109+0000","last_became_peered":"2024-09-16T01:00:28.448109+0000","last_unstale":"2024-09-16T01:00:29.430171+0000","last_undegraded":"2024-09-16T01:00:29.430171+0000","last_fullsized":"2024-09-16T01:00:29.430171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:22.671812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434004+0000","last_change":"2024-09-16T01:00:28.446417+0000","last_active":"2024-09-16T01:00:29.434004+0000","last_peered":"2024-09-16T01:00:29.434004+0000","last_clean":"2024-09-16T01:00:29.434004+0000","last_became_active":"2024-09-16T01:00:28.445919+0000","last_became_peered":"2024-09-16T01:00:28.445919+0000","last_unstale":"2024-09-16T01:00:29.434004+0000","last_undegraded":"2024-09-16T01:00:29.434004+0000","last_fullsized":"2024-09-16T01:00:29.434004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:11.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430471+0000","last_change":"2024-09-16T01:00:28.451072+0000","last_active":"2024-09-16T01:00:29.430471+0000","last_peered":"2024-09-16T01:00:29.430471+0000","last_clean":"2024-09-16T01:00:29.430471+0000","last_became_active":"2024-09-16T01:00:28.450760+0000","last_became_peered":"2024-09-16T01:00:28.450760+0000","last_unstale":"2024-09-16T01:00:29.430471+0000","last_undegraded":"2024-09-16T01:00:29.430471+0000","last_fullsized":"2024-09-16T01:00:29.430471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:24.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446272+0000","last_change":"2024-09-16T01:00:28.445776+0000","last_active":"2024-09-16T01:00:29.446272+0000","last_peered":"2024-09-16T01:00:29.446272+0000","last_clean":"2024-09-16T01:00:29.446272+0000","last_became_active":"2024-09-16T01:00:28.445456+0000","last_became_peered":"2024-09-16T01:00:28.445456+0000","last_unstale":"2024-09-16T01:00:29.446272+0000","last_undegraded":"2024-09-16T01:00:29.446272+0000","last_fullsized":"2024-09-16T01:00:29.446272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451378+0000","last_change":"2024-09-16T01:00:28.447437+0000","last_active":"2024-09-16T01:00:29.451378+0000","last_peered":"2024-09-16T01:00:29.451378+0000","last_clean":"2024-09-16T01:00:29.451378+0000","last_became_active":"2024-09-16T01:00:28.447108+0000","last_became_peered":"2024-09-16T01:00:28.447108+0000","last_unstale":"2024-09-16T01:00:29.451378+0000","last_undegraded":"2024-09-16T01:00:29.451378+0000","last_fullsized":"2024-09-16T01:00:29.451378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:12.484102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445726+0000","last_change":"2024-09-16T01:00:28.452750+0000","last_active":"2024-09-16T01:00:29.445726+0000","last_peered":"2024-09-16T01:00:29.445726+0000","last_clean":"2024-09-16T01:00:29.445726+0000","last_became_active":"2024-09-16T01:00:28.452382+0000","last_became_peered":"2024-09-16T01:00:28.452382+0000","last_unstale":"2024-09-16T01:00:29.445726+0000","last_undegraded":"2024-09-16T01:00:29.445726+0000","last_fullsized":"2024-09-16T01:00:29.445726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.127201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447646+0000","last_change":"2024-09-16T01:00:28.450220+0000","last_active":"2024-09-16T01:00:29.447646+0000","last_peered":"2024-09-16T01:00:29.447646+0000","last_clean":"2024-09-16T01:00:29.447646+0000","last_became_active":"2024-09-16T01:00:28.449824+0000","last_became_peered":"2024-09-16T01:00:28.449824+0000","last_unstale":"2024-09-16T01:00:29.447646+0000","last_undegraded":"2024-09-16T01:00:29.447646+0000","last_fullsized":"2024-09-16T01:00:29.447646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:08.428729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446478+0000","last_change":"2024-09-16T01:00:28.447282+0000","last_active":"2024-09-16T01:00:29.446478+0000","last_peered":"2024-09-16T01:00:29.446478+0000","last_clean":"2024-09-16T01:00:29.446478+0000","last_became_active":"2024-09-16T01:00:28.446839+0000","last_became_peered":"2024-09-16T01:00:28.446839+0000","last_unstale":"2024-09-16T01:00:29.446478+0000","last_undegraded":"2024-09-16T01:00:29.446478+0000","last_fullsized":"2024-09-16T01:00:29.446478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:33.594170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445915+0000","last_change":"2024-09-16T01:00:28.454019+0000","last_active":"2024-09-16T01:00:29.445915+0000","last_peered":"2024-09-16T01:00:29.445915+0000","last_clean":"2024-09-16T01:00:29.445915+0000","last_became_active":"2024-09-16T01:00:28.453706+0000","last_became_peered":"2024-09-16T01:00:28.453706+0000","last_unstale":"2024-09-16T01:00:29.445915+0000","last_undegraded":"2024-09-16T01:00:29.445915+0000","last_fullsized":"2024-09-16T01:00:29.445915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:09.704344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450704+0000","last_change":"2024-09-16T01:00:28.449323+0000","last_active":"2024-09-16T01:00:29.450704+0000","last_peered":"2024-09-16T01:00:29.450704+0000","last_clean":"2024-09-16T01:00:29.450704+0000","last_became_active":"2024-09-16T01:00:28.448536+0000","last_became_peered":"2024-09-16T01:00:28.448536+0000","last_unstale":"2024-09-16T01:00:29.450704+0000","last_undegraded":"2024-09-16T01:00:29.450704+0000","last_fullsized":"2024-09-16T01:00:29.450704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:11.145663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446668+0000","last_change":"2024-09-16T01:00:28.440882+0000","last_active":"2024-09-16T01:00:29.446668+0000","last_peered":"2024-09-16T01:00:29.446668+0000","last_clean":"2024-09-16T01:00:29.446668+0000","last_became_active":"2024-09-16T01:00:28.440496+0000","last_became_peered":"2024-09-16T01:00:28.440496+0000","last_unstale":"2024-09-16T01:00:29.446668+0000","last_undegraded":"2024-09-16T01:00:29.446668+0000","last_fullsized":"2024-09-16T01:00:29.446668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:16.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.531745+0000","last_change":"2024-09-16T01:00:26.357785+0000","last_active":"2024-09-16T01:00:49.531745+0000","last_peered":"2024-09-16T01:00:49.531745+0000","last_clean":"2024-09-16T01:00:49.531745+0000","last_became_active":"2024-09-16T01:00:26.357450+0000","last_became_peered":"2024-09-16T01:00:26.357450+0000","last_unstale":"2024-09-16T01:00:49.531745+0000","last_undegraded":"2024-09-16T01:00:49.531745+0000","last_fullsized":"2024-09-16T01:00:49.531745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.778996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433774+0000","last_change":"2024-09-16T01:00:28.454416+0000","last_active":"2024-09-16T01:00:29.433774+0000","last_peered":"2024-09-16T01:00:29.433774+0000","last_clean":"2024-09-16T01:00:29.433774+0000","last_became_active":"2024-09-16T01:00:28.454117+0000","last_became_peered":"2024-09-16T01:00:28.454117+0000","last_unstale":"2024-09-16T01:00:29.433774+0000","last_undegraded":"2024-09-16T01:00:29.433774+0000","last_fullsized":"2024-09-16T01:00:29.433774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:32.487601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.503539+0000","last_change":"2024-09-16T01:00:26.359828+0000","last_active":"2024-09-16T01:00:38.503539+0000","last_peered":"2024-09-16T01:00:38.503539+0000","last_clean":"2024-09-16T01:00:38.503539+0000","last_became_active":"2024-09-16T01:00:26.359520+0000","last_became_peered":"2024-09-16T01:00:26.359520+0000","last_unstale":"2024-09-16T01:00:38.503539+0000","last_undegraded":"2024-09-16T01:00:38.503539+0000","last_fullsized":"2024-09-16T01:00:38.503539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:14.477791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.493792+0000","last_change":"2024-09-16T01:00:26.353227+0000","last_active":"2024-09-16T01:00:37.493792+0000","last_peered":"2024-09-16T01:00:37.493792+0000","last_clean":"2024-09-16T01:00:37.493792+0000","last_became_active":"2024-09-16T01:00:26.352869+0000","last_became_peered":"2024-09-16T01:00:26.352869+0000","last_unstale":"2024-09-16T01:00:37.493792+0000","last_undegraded":"2024-09-16T01:00:37.493792+0000","last_fullsized":"2024-09-16T01:00:37.493792+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:48.035596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430142+0000","last_change":"2024-09-16T01:00:28.444766+0000","last_active":"2024-09-16T01:00:29.430142+0000","last_peered":"2024-09-16T01:00:29.430142+0000","last_clean":"2024-09-16T01:00:29.430142+0000","last_became_active":"2024-09-16T01:00:28.444450+0000","last_became_peered":"2024-09-16T01:00:28.444450+0000","last_unstale":"2024-09-16T01:00:29.430142+0000","last_undegraded":"2024-09-16T01:00:29.430142+0000","last_fullsized":"2024-09-16T01:00:29.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:07.610462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510477+0000","last_change":"2024-09-16T01:00:26.357087+0000","last_active":"2024-09-16T01:00:39.510477+0000","last_peered":"2024-09-16T01:00:39.510477+0000","last_clean":"2024-09-16T01:00:39.510477+0000","last_became_active":"2024-09-16T01:00:26.356758+0000","last_became_peered":"2024-09-16T01:00:26.356758+0000","last_unstale":"2024-09-16T01:00:39.510477+0000","last_undegraded":"2024-09-16T01:00:39.510477+0000","last_fullsized":"2024-09-16T01:00:39.510477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:55.525693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445379+0000","last_change":"2024-09-16T01:00:28.438715+0000","last_active":"2024-09-16T01:00:29.445379+0000","last_peered":"2024-09-16T01:00:29.445379+0000","last_clean":"2024-09-16T01:00:29.445379+0000","last_became_active":"2024-09-16T01:00:28.438380+0000","last_became_peered":"2024-09-16T01:00:28.438380+0000","last_unstale":"2024-09-16T01:00:29.445379+0000","last_undegraded":"2024-09-16T01:00:29.445379+0000","last_fullsized":"2024-09-16T01:00:29.445379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:34.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.532327+0000","last_change":"2024-09-16T01:00:26.359263+0000","last_active":"2024-09-16T01:00:50.532327+0000","last_peered":"2024-09-16T01:00:50.532327+0000","last_clean":"2024-09-16T01:00:50.532327+0000","last_became_active":"2024-09-16T01:00:26.358936+0000","last_became_peered":"2024-09-16T01:00:26.358936+0000","last_unstale":"2024-09-16T01:00:50.532327+0000","last_undegraded":"2024-09-16T01:00:50.532327+0000","last_fullsized":"2024-09-16T01:00:50.532327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:31.125243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431558+0000","last_change":"2024-09-16T01:00:28.445330+0000","last_active":"2024-09-16T01:00:29.431558+0000","last_peered":"2024-09-16T01:00:29.431558+0000","last_clean":"2024-09-16T01:00:29.431558+0000","last_became_active":"2024-09-16T01:00:28.444913+0000","last_became_peered":"2024-09-16T01:00:28.444913+0000","last_unstale":"2024-09-16T01:00:29.431558+0000","last_undegraded":"2024-09-16T01:00:29.431558+0000","last_fullsized":"2024-09-16T01:00:29.431558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:16.583722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509989+0000","last_change":"2024-09-16T01:00:26.356972+0000","last_active":"2024-09-16T01:00:39.509989+0000","last_peered":"2024-09-16T01:00:39.509989+0000","last_clean":"2024-09-16T01:00:39.509989+0000","last_became_active":"2024-09-16T01:00:26.356525+0000","last_became_peered":"2024-09-16T01:00:26.356525+0000","last_unstale":"2024-09-16T01:00:39.509989+0000","last_undegraded":"2024-09-16T01:00:39.509989+0000","last_fullsized":"2024-09-16T01:00:39.509989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:42.908179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447323+0000","last_change":"2024-09-16T01:00:28.449732+0000","last_active":"2024-09-16T01:00:29.447323+0000","last_peered":"2024-09-16T01:00:29.447323+0000","last_clean":"2024-09-16T01:00:29.447323+0000","last_became_active":"2024-09-16T01:00:28.449325+0000","last_became_peered":"2024-09-16T01:00:28.449325+0000","last_unstale":"2024-09-16T01:00:29.447323+0000","last_undegraded":"2024-09-16T01:00:29.447323+0000","last_fullsized":"2024-09-16T01:00:29.447323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:55.370952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502667+0000","last_change":"2024-09-16T01:00:26.746513+0000","last_active":"2024-09-16T01:00:38.502667+0000","last_peered":"2024-09-16T01:00:38.502667+0000","last_clean":"2024-09-16T01:00:38.502667+0000","last_became_active":"2024-09-16T01:00:26.746114+0000","last_became_peered":"2024-09-16T01:00:26.746114+0000","last_unstale":"2024-09-16T01:00:38.502667+0000","last_undegraded":"2024-09-16T01:00:38.502667+0000","last_fullsized":"2024-09-16T01:00:38.502667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431274+0000","last_change":"2024-09-16T01:00:28.452854+0000","last_active":"2024-09-16T01:00:29.431274+0000","last_peered":"2024-09-16T01:00:29.431274+0000","last_clean":"2024-09-16T01:00:29.431274+0000","last_became_active":"2024-09-16T01:00:28.452548+0000","last_became_peered":"2024-09-16T01:00:28.452548+0000","last_unstale":"2024-09-16T01:00:29.431274+0000","last_undegraded":"2024-09-16T01:00:29.431274+0000","last_fullsized":"2024-09-16T01:00:29.431274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:12.527860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.535208+0000","last_change":"2024-09-16T01:00:26.361221+0000","last_active":"2024-09-16T01:00:50.535208+0000","last_peered":"2024-09-16T01:00:50.535208+0000","last_clean":"2024-09-16T01:00:50.535208+0000","last_became_active":"2024-09-16T01:00:26.360785+0000","last_became_peered":"2024-09-16T01:00:26.360785+0000","last_unstale":"2024-09-16T01:00:50.535208+0000","last_undegraded":"2024-09-16T01:00:50.535208+0000","last_fullsized":"2024-09-16T01:00:50.535208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:07.145342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447395+0000","last_change":"2024-09-16T01:00:28.443905+0000","last_active":"2024-09-16T01:00:29.447395+0000","last_peered":"2024-09-16T01:00:29.447395+0000","last_clean":"2024-09-16T01:00:29.447395+0000","last_became_active":"2024-09-16T01:00:28.442808+0000","last_became_peered":"2024-09-16T01:00:28.442808+0000","last_unstale":"2024-09-16T01:00:29.447395+0000","last_undegraded":"2024-09-16T01:00:29.447395+0000","last_fullsized":"2024-09-16T01:00:29.447395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.513028+0000","last_change":"2024-09-16T01:00:26.358696+0000","last_active":"2024-09-16T01:00:40.513028+0000","last_peered":"2024-09-16T01:00:40.513028+0000","last_clean":"2024-09-16T01:00:40.513028+0000","last_became_active":"2024-09-16T01:00:26.358306+0000","last_became_peered":"2024-09-16T01:00:26.358306+0000","last_unstale":"2024-09-16T01:00:40.513028+0000","last_undegraded":"2024-09-16T01:00:40.513028+0000","last_fullsized":"2024-09-16T01:00:40.513028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:34.811501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445791+0000","last_change":"2024-09-16T01:00:28.439511+0000","last_active":"2024-09-16T01:00:29.445791+0000","last_peered":"2024-09-16T01:00:29.445791+0000","last_clean":"2024-09-16T01:00:29.445791+0000","last_became_active":"2024-09-16T01:00:28.439204+0000","last_became_peered":"2024-09-16T01:00:28.439204+0000","last_unstale":"2024-09-16T01:00:29.445791+0000","last_undegraded":"2024-09-16T01:00:29.445791+0000","last_fullsized":"2024-09-16T01:00:29.445791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:00.331186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510658+0000","last_change":"2024-09-16T01:00:26.357142+0000","last_active":"2024-09-16T01:00:39.510658+0000","last_peered":"2024-09-16T01:00:39.510658+0000","last_clean":"2024-09-16T01:00:39.510658+0000","last_became_active":"2024-09-16T01:00:26.356738+0000","last_became_peered":"2024-09-16T01:00:26.356738+0000","last_unstale":"2024-09-16T01:00:39.510658+0000","last_undegraded":"2024-09-16T01:00:39.510658+0000","last_fullsized":"2024-09-16T01:00:39.510658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:41.895356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446568+0000","last_change":"2024-09-16T01:00:28.449767+0000","last_active":"2024-09-16T01:00:29.446568+0000","last_peered":"2024-09-16T01:00:29.446568+0000","last_clean":"2024-09-16T01:00:29.446568+0000","last_became_active":"2024-09-16T01:00:28.449454+0000","last_became_peered":"2024-09-16T01:00:28.449454+0000","last_unstale":"2024-09-16T01:00:29.446568+0000","last_undegraded":"2024-09-16T01:00:29.446568+0000","last_fullsized":"2024-09-16T01:00:29.446568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:44.395194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:48.530619+0000","last_change":"2024-09-16T01:00:26.358441+0000","last_active":"2024-09-16T01:00:48.530619+0000","last_peered":"2024-09-16T01:00:48.530619+0000","last_clean":"2024-09-16T01:00:48.530619+0000","last_became_active":"2024-09-16T01:00:26.358110+0000","last_became_peered":"2024-09-16T01:00:26.358110+0000","last_unstale":"2024-09-16T01:00:48.530619+0000","last_undegraded":"2024-09-16T01:00:48.530619+0000","last_fullsized":"2024-09-16T01:00:48.530619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446963+0000","last_change":"2024-09-16T01:00:28.447408+0000","last_active":"2024-09-16T01:00:29.446963+0000","last_peered":"2024-09-16T01:00:29.446963+0000","last_clean":"2024-09-16T01:00:29.446963+0000","last_became_active":"2024-09-16T01:00:28.447089+0000","last_became_peered":"2024-09-16T01:00:28.447089+0000","last_unstale":"2024-09-16T01:00:29.446963+0000","last_undegraded":"2024-09-16T01:00:29.446963+0000","last_fullsized":"2024-09-16T01:00:29.446963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:40.081429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508119+0000","last_change":"2024-09-16T01:00:26.745619+0000","last_active":"2024-09-16T01:00:39.508119+0000","last_peered":"2024-09-16T01:00:39.508119+0000","last_clean":"2024-09-16T01:00:39.508119+0000","last_became_active":"2024-09-16T01:00:26.745265+0000","last_became_peered":"2024-09-16T01:00:26.745265+0000","last_unstale":"2024-09-16T01:00:39.508119+0000","last_undegraded":"2024-09-16T01:00:39.508119+0000","last_fullsized":"2024-09-16T01:00:39.508119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:54.254160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434189+0000","last_change":"2024-09-16T01:00:28.456065+0000","last_active":"2024-09-16T01:00:29.434189+0000","last_peered":"2024-09-16T01:00:29.434189+0000","last_clean":"2024-09-16T01:00:29.434189+0000","last_became_active":"2024-09-16T01:00:28.455692+0000","last_became_peered":"2024-09-16T01:00:28.455692+0000","last_unstale":"2024-09-16T01:00:29.434189+0000","last_undegraded":"2024-09-16T01:00:29.434189+0000","last_fullsized":"2024-09-16T01:00:29.434189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.489340+0000","last_change":"2024-09-16T01:00:26.354191+0000","last_active":"2024-09-16T01:00:39.489340+0000","last_peered":"2024-09-16T01:00:39.489340+0000","last_clean":"2024-09-16T01:00:39.489340+0000","last_became_active":"2024-09-16T01:00:26.353753+0000","last_became_peered":"2024-09-16T01:00:26.353753+0000","last_unstale":"2024-09-16T01:00:39.489340+0000","last_undegraded":"2024-09-16T01:00:39.489340+0000","last_fullsized":"2024-09-16T01:00:39.489340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:16.098449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451025+0000","last_change":"2024-09-16T01:00:28.451056+0000","last_active":"2024-09-16T01:00:29.451025+0000","last_peered":"2024-09-16T01:00:29.451025+0000","last_clean":"2024-09-16T01:00:29.451025+0000","last_became_active":"2024-09-16T01:00:28.449801+0000","last_became_peered":"2024-09-16T01:00:28.449801+0000","last_unstale":"2024-09-16T01:00:29.451025+0000","last_undegraded":"2024-09-16T01:00:29.451025+0000","last_fullsized":"2024-09-16T01:00:29.451025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:06.207854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508582+0000","last_change":"2024-09-16T01:00:26.355975+0000","last_active":"2024-09-16T01:00:39.508582+0000","last_peered":"2024-09-16T01:00:39.508582+0000","last_clean":"2024-09-16T01:00:39.508582+0000","last_became_active":"2024-09-16T01:00:26.355629+0000","last_became_peered":"2024-09-16T01:00:26.355629+0000","last_unstale":"2024-09-16T01:00:39.508582+0000","last_undegraded":"2024-09-16T01:00:39.508582+0000","last_fullsized":"2024-09-16T01:00:39.508582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:06.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446815+0000","last_change":"2024-09-16T01:00:28.444387+0000","last_active":"2024-09-16T01:00:29.446815+0000","last_peered":"2024-09-16T01:00:29.446815+0000","last_clean":"2024-09-16T01:00:29.446815+0000","last_became_active":"2024-09-16T01:00:28.444076+0000","last_became_peered":"2024-09-16T01:00:28.444076+0000","last_unstale":"2024-09-16T01:00:29.446815+0000","last_undegraded":"2024-09-16T01:00:29.446815+0000","last_fullsized":"2024-09-16T01:00:29.446815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:50.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508980+0000","last_change":"2024-09-16T01:00:26.357038+0000","last_active":"2024-09-16T01:00:39.508980+0000","last_peered":"2024-09-16T01:00:39.508980+0000","last_clean":"2024-09-16T01:00:39.508980+0000","last_became_active":"2024-09-16T01:00:26.356599+0000","last_became_peered":"2024-09-16T01:00:26.356599+0000","last_unstale":"2024-09-16T01:00:39.508980+0000","last_undegraded":"2024-09-16T01:00:39.508980+0000","last_fullsized":"2024-09-16T01:00:39.508980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.288180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.833185+0000","last_change":"2024-09-16T01:00:28.443408+0000","last_active":"2024-09-16T01:00:31.833185+0000","last_peered":"2024-09-16T01:00:31.833185+0000","last_clean":"2024-09-16T01:00:31.833185+0000","last_became_active":"2024-09-16T01:00:28.443016+0000","last_became_peered":"2024-09-16T01:00:28.443016+0000","last_unstale":"2024-09-16T01:00:31.833185+0000","last_undegraded":"2024-09-16T01:00:31.833185+0000","last_fullsized":"2024-09-16T01:00:31.833185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:29.801811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:48.530224+0000","last_change":"2024-09-16T01:00:27.056514+0000","last_active":"2024-09-16T01:00:48.530224+0000","last_peered":"2024-09-16T01:00:48.530224+0000","last_clean":"2024-09-16T01:00:48.530224+0000","last_became_active":"2024-09-16T01:00:27.056137+0000","last_became_peered":"2024-09-16T01:00:27.056137+0000","last_unstale":"2024-09-16T01:00:48.530224+0000","last_undegraded":"2024-09-16T01:00:48.530224+0000","last_fullsized":"2024-09-16T01:00:48.530224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:07.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446792+0000","last_change":"2024-09-16T01:00:28.445866+0000","last_active":"2024-09-16T01:00:29.446792+0000","last_peered":"2024-09-16T01:00:29.446792+0000","last_clean":"2024-09-16T01:00:29.446792+0000","last_became_active":"2024-09-16T01:00:28.445454+0000","last_became_peered":"2024-09-16T01:00:28.445454+0000","last_unstale":"2024-09-16T01:00:29.446792+0000","last_undegraded":"2024-09-16T01:00:29.446792+0000","last_fullsized":"2024-09-16T01:00:29.446792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:44.340565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446297+0000","last_change":"2024-09-16T00:59:14.381567+0000","last_active":"2024-09-16T01:00:29.446297+0000","last_peered":"2024-09-16T01:00:29.446297+0000","last_clean":"2024-09-16T01:00:29.446297+0000","last_became_active":"2024-09-16T00:59:14.381088+0000","last_became_peered":"2024-09-16T00:59:14.381088+0000","last_unstale":"2024-09-16T01:00:29.446297+0000","last_undegraded":"2024-09-16T01:00:29.446297+0000","last_fullsized":"2024-09-16T01:00:29.446297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_clean_scrub_stamp":"2024-09-16T00:55:49.599122+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:14.170832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.512169+0000","last_change":"2024-09-16T01:00:26.357699+0000","last_active":"2024-09-16T01:00:40.512169+0000","last_peered":"2024-09-16T01:00:40.512169+0000","last_clean":"2024-09-16T01:00:40.512169+0000","last_became_active":"2024-09-16T01:00:26.357186+0000","last_became_peered":"2024-09-16T01:00:26.357186+0000","last_unstale":"2024-09-16T01:00:40.512169+0000","last_undegraded":"2024-09-16T01:00:40.512169+0000","last_fullsized":"2024-09-16T01:00:40.512169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:48.026723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430360+0000","last_change":"2024-09-16T01:00:28.446677+0000","last_active":"2024-09-16T01:00:29.430360+0000","last_peered":"2024-09-16T01:00:29.430360+0000","last_clean":"2024-09-16T01:00:29.430360+0000","last_became_active":"2024-09-16T01:00:28.446337+0000","last_became_peered":"2024-09-16T01:00:28.446337+0000","last_unstale":"2024-09-16T01:00:29.430360+0000","last_undegraded":"2024-09-16T01:00:29.430360+0000","last_fullsized":"2024-09-16T01:00:29.430360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:45.890312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.491499+0000","last_change":"2024-09-16T01:00:26.360153+0000","last_active":"2024-09-16T01:00:37.491499+0000","last_peered":"2024-09-16T01:00:37.491499+0000","last_clean":"2024-09-16T01:00:37.491499+0000","last_became_active":"2024-09-16T01:00:26.359828+0000","last_became_peered":"2024-09-16T01:00:26.359828+0000","last_unstale":"2024-09-16T01:00:37.491499+0000","last_undegraded":"2024-09-16T01:00:37.491499+0000","last_fullsized":"2024-09-16T01:00:37.491499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:27.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445683+0000","last_change":"2024-09-16T01:00:28.446587+0000","last_active":"2024-09-16T01:00:29.445683+0000","last_peered":"2024-09-16T01:00:29.445683+0000","last_clean":"2024-09-16T01:00:29.445683+0000","last_became_active":"2024-09-16T01:00:28.446221+0000","last_became_peered":"2024-09-16T01:00:28.446221+0000","last_unstale":"2024-09-16T01:00:29.445683+0000","last_undegraded":"2024-09-16T01:00:29.445683+0000","last_fullsized":"2024-09-16T01:00:29.445683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:07.027765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.531466+0000","last_change":"2024-09-16T01:00:26.745384+0000","last_active":"2024-09-16T01:00:49.531466+0000","last_peered":"2024-09-16T01:00:49.531466+0000","last_clean":"2024-09-16T01:00:49.531466+0000","last_became_active":"2024-09-16T01:00:26.745056+0000","last_became_peered":"2024-09-16T01:00:26.745056+0000","last_unstale":"2024-09-16T01:00:49.531466+0000","last_undegraded":"2024-09-16T01:00:49.531466+0000","last_fullsized":"2024-09-16T01:00:49.531466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:18.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433772+0000","last_change":"2024-09-16T01:00:28.454156+0000","last_active":"2024-09-16T01:00:29.433772+0000","last_peered":"2024-09-16T01:00:29.433772+0000","last_clean":"2024-09-16T01:00:29.433772+0000","last_became_active":"2024-09-16T01:00:28.453798+0000","last_became_peered":"2024-09-16T01:00:28.453798+0000","last_unstale":"2024-09-16T01:00:29.433772+0000","last_undegraded":"2024-09-16T01:00:29.433772+0000","last_fullsized":"2024-09-16T01:00:29.433772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.617433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.530359+0000","last_change":"2024-09-16T01:00:26.356232+0000","last_active":"2024-09-16T01:00:50.530359+0000","last_peered":"2024-09-16T01:00:50.530359+0000","last_clean":"2024-09-16T01:00:50.530359+0000","last_became_active":"2024-09-16T01:00:26.355874+0000","last_became_peered":"2024-09-16T01:00:26.355874+0000","last_unstale":"2024-09-16T01:00:50.530359+0000","last_undegraded":"2024-09-16T01:00:50.530359+0000","last_fullsized":"2024-09-16T01:00:50.530359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:53.426341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447525+0000","last_change":"2024-09-16T01:00:28.453279+0000","last_active":"2024-09-16T01:00:29.447525+0000","last_peered":"2024-09-16T01:00:29.447525+0000","last_clean":"2024-09-16T01:00:29.447525+0000","last_became_active":"2024-09-16T01:00:28.452808+0000","last_became_peered":"2024-09-16T01:00:28.452808+0000","last_unstale":"2024-09-16T01:00:29.447525+0000","last_undegraded":"2024-09-16T01:00:29.447525+0000","last_fullsized":"2024-09-16T01:00:29.447525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:06.096145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446100+0000","last_change":"2024-09-16T01:00:26.745692+0000","last_active":"2024-09-16T01:00:29.446100+0000","last_peered":"2024-09-16T01:00:29.446100+0000","last_clean":"2024-09-16T01:00:29.446100+0000","last_became_active":"2024-09-16T01:00:26.745325+0000","last_became_peered":"2024-09-16T01:00:26.745325+0000","last_unstale":"2024-09-16T01:00:29.446100+0000","last_undegraded":"2024-09-16T01:00:29.446100+0000","last_fullsized":"2024-09-16T01:00:29.446100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:19.061145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.358735+0000","last_change":"2024-09-16T01:00:28.452501+0000","last_active":"2024-09-16T01:00:31.358735+0000","last_peered":"2024-09-16T01:00:31.358735+0000","last_clean":"2024-09-16T01:00:31.358735+0000","last_became_active":"2024-09-16T01:00:28.451938+0000","last_became_peered":"2024-09-16T01:00:28.451938+0000","last_unstale":"2024-09-16T01:00:31.358735+0000","last_undegraded":"2024-09-16T01:00:31.358735+0000","last_fullsized":"2024-09-16T01:00:31.358735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:12.762849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510447+0000","last_change":"2024-09-16T01:00:26.746438+0000","last_active":"2024-09-16T01:00:39.510447+0000","last_peered":"2024-09-16T01:00:39.510447+0000","last_clean":"2024-09-16T01:00:39.510447+0000","last_became_active":"2024-09-16T01:00:26.746067+0000","last_became_peered":"2024-09-16T01:00:26.746067+0000","last_unstale":"2024-09-16T01:00:39.510447+0000","last_undegraded":"2024-09-16T01:00:39.510447+0000","last_fullsized":"2024-09-16T01:00:39.510447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:10.792354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445879+0000","last_change":"2024-09-16T01:00:28.446067+0000","last_active":"2024-09-16T01:00:29.445879+0000","last_peered":"2024-09-16T01:00:29.445879+0000","last_clean":"2024-09-16T01:00:29.445879+0000","last_became_active":"2024-09-16T01:00:28.445669+0000","last_became_peered":"2024-09-16T01:00:28.445669+0000","last_unstale":"2024-09-16T01:00:29.445879+0000","last_undegraded":"2024-09-16T01:00:29.445879+0000","last_fullsized":"2024-09-16T01:00:29.445879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:30.172271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.445144+0000","last_change":"2024-09-16T01:00:26.351033+0000","last_active":"2024-09-16T01:00:49.445144+0000","last_peered":"2024-09-16T01:00:49.445144+0000","last_clean":"2024-09-16T01:00:49.445144+0000","last_became_active":"2024-09-16T01:00:26.350670+0000","last_became_peered":"2024-09-16T01:00:26.350670+0000","last_unstale":"2024-09-16T01:00:49.445144+0000","last_undegraded":"2024-09-16T01:00:49.445144+0000","last_fullsized":"2024-09-16T01:00:49.445144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:23.634635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430572+0000","last_change":"2024-09-16T01:00:28.445229+0000","last_active":"2024-09-16T01:00:29.430572+0000","last_peered":"2024-09-16T01:00:29.430572+0000","last_clean":"2024-09-16T01:00:29.430572+0000","last_became_active":"2024-09-16T01:00:28.444794+0000","last_became_peered":"2024-09-16T01:00:28.444794+0000","last_unstale":"2024-09-16T01:00:29.430572+0000","last_undegraded":"2024-09-16T01:00:29.430572+0000","last_fullsized":"2024-09-16T01:00:29.430572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:05:34.117777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509104+0000","last_change":"2024-09-16T01:00:27.056718+0000","last_active":"2024-09-16T01:00:39.509104+0000","last_peered":"2024-09-16T01:00:39.509104+0000","last_clean":"2024-09-16T01:00:39.509104+0000","last_became_active":"2024-09-16T01:00:27.056331+0000","last_became_peered":"2024-09-16T01:00:27.056331+0000","last_unstale":"2024-09-16T01:00:39.509104+0000","last_undegraded":"2024-09-16T01:00:39.509104+0000","last_fullsized":"2024-09-16T01:00:39.509104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:47.094865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.453630+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.453272+0000","last_became_peered":"2024-09-16T01:00:28.453272+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:44.722743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484007+0000","last_change":"2024-09-16T01:00:26.745355+0000","last_active":"2024-09-16T01:00:36.484007+0000","last_peered":"2024-09-16T01:00:36.484007+0000","last_clean":"2024-09-16T01:00:36.484007+0000","last_became_active":"2024-09-16T01:00:26.745042+0000","last_became_peered":"2024-09-16T01:00:26.745042+0000","last_unstale":"2024-09-16T01:00:36.484007+0000","last_undegraded":"2024-09-16T01:00:36.484007+0000","last_fullsized":"2024-09-16T01:00:36.484007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:29.934482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446606+0000","last_change":"2024-09-16T01:00:28.441231+0000","last_active":"2024-09-16T01:00:29.446606+0000","last_peered":"2024-09-16T01:00:29.446606+0000","last_clean":"2024-09-16T01:00:29.446606+0000","last_became_active":"2024-09-16T01:00:28.440849+0000","last_became_peered":"2024-09-16T01:00:28.440849+0000","last_unstale":"2024-09-16T01:00:29.446606+0000","last_undegraded":"2024-09-16T01:00:29.446606+0000","last_fullsized":"2024-09-16T01:00:29.446606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:09.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508071+0000","last_change":"2024-09-16T01:00:26.357171+0000","last_active":"2024-09-16T01:00:39.508071+0000","last_peered":"2024-09-16T01:00:39.508071+0000","last_clean":"2024-09-16T01:00:39.508071+0000","last_became_active":"2024-09-16T01:00:26.356843+0000","last_became_peered":"2024-09-16T01:00:26.356843+0000","last_unstale":"2024-09-16T01:00:39.508071+0000","last_undegraded":"2024-09-16T01:00:39.508071+0000","last_fullsized":"2024-09-16T01:00:39.508071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:38.576314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450981+0000","last_change":"2024-09-16T01:00:28.450917+0000","last_active":"2024-09-16T01:00:29.450981+0000","last_peered":"2024-09-16T01:00:29.450981+0000","last_clean":"2024-09-16T01:00:29.450981+0000","last_became_active":"2024-09-16T01:00:28.448978+0000","last_became_peered":"2024-09-16T01:00:28.448978+0000","last_unstale":"2024-09-16T01:00:29.450981+0000","last_undegraded":"2024-09-16T01:00:29.450981+0000","last_fullsized":"2024-09-16T01:00:29.450981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:30.270617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502175+0000","last_change":"2024-09-16T01:00:26.360356+0000","last_active":"2024-09-16T01:00:38.502175+0000","last_peered":"2024-09-16T01:00:38.502175+0000","last_clean":"2024-09-16T01:00:38.502175+0000","last_became_active":"2024-09-16T01:00:26.359647+0000","last_became_peered":"2024-09-16T01:00:26.359647+0000","last_unstale":"2024-09-16T01:00:38.502175+0000","last_undegraded":"2024-09-16T01:00:38.502175+0000","last_fullsized":"2024-09-16T01:00:38.502175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:47.857659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430392+0000","last_change":"2024-09-16T01:00:28.444726+0000","last_active":"2024-09-16T01:00:29.430392+0000","last_peered":"2024-09-16T01:00:29.430392+0000","last_clean":"2024-09-16T01:00:29.430392+0000","last_became_active":"2024-09-16T01:00:28.444418+0000","last_became_peered":"2024-09-16T01:00:28.444418+0000","last_unstale":"2024-09-16T01:00:29.430392+0000","last_undegraded":"2024-09-16T01:00:29.430392+0000","last_fullsized":"2024-09-16T01:00:29.430392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484905+0000","last_change":"2024-09-16T01:00:26.357369+0000","last_active":"2024-09-16T01:00:36.484905+0000","last_peered":"2024-09-16T01:00:36.484905+0000","last_clean":"2024-09-16T01:00:36.484905+0000","last_became_active":"2024-09-16T01:00:26.356253+0000","last_became_peered":"2024-09-16T01:00:26.356253+0000","last_unstale":"2024-09-16T01:00:36.484905+0000","last_undegraded":"2024-09-16T01:00:36.484905+0000","last_fullsized":"2024-09-16T01:00:36.484905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:03.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446325+0000","last_change":"2024-09-16T01:00:28.446488+0000","last_active":"2024-09-16T01:00:29.446325+0000","last_peered":"2024-09-16T01:00:29.446325+0000","last_clean":"2024-09-16T01:00:29.446325+0000","last_became_active":"2024-09-16T01:00:28.446004+0000","last_became_peered":"2024-09-16T01:00:28.446004+0000","last_unstale":"2024-09-16T01:00:29.446325+0000","last_undegraded":"2024-09-16T01:00:29.446325+0000","last_fullsized":"2024-09-16T01:00:29.446325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.923219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434044+0000","last_change":"2024-09-16T01:00:28.455484+0000","last_active":"2024-09-16T01:00:29.434044+0000","last_peered":"2024-09-16T01:00:29.434044+0000","last_clean":"2024-09-16T01:00:29.434044+0000","last_became_active":"2024-09-16T01:00:28.455142+0000","last_became_peered":"2024-09-16T01:00:28.455142+0000","last_unstale":"2024-09-16T01:00:29.434044+0000","last_undegraded":"2024-09-16T01:00:29.434044+0000","last_fullsized":"2024-09-16T01:00:29.434044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:50:19.274265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509963+0000","last_change":"2024-09-16T01:00:26.354531+0000","last_active":"2024-09-16T01:00:39.509963+0000","last_peered":"2024-09-16T01:00:39.509963+0000","last_clean":"2024-09-16T01:00:39.509963+0000","last_became_active":"2024-09-16T01:00:26.354207+0000","last_became_peered":"2024-09-16T01:00:26.354207+0000","last_unstale":"2024-09-16T01:00:39.509963+0000","last_undegraded":"2024-09-16T01:00:39.509963+0000","last_fullsized":"2024-09-16T01:00:39.509963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:20.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431256+0000","last_change":"2024-09-16T01:00:28.439318+0000","last_active":"2024-09-16T01:00:29.431256+0000","last_peered":"2024-09-16T01:00:29.431256+0000","last_clean":"2024-09-16T01:00:29.431256+0000","last_became_active":"2024-09-16T01:00:28.437874+0000","last_became_peered":"2024-09-16T01:00:28.437874+0000","last_unstale":"2024-09-16T01:00:29.431256+0000","last_undegraded":"2024-09-16T01:00:29.431256+0000","last_fullsized":"2024-09-16T01:00:29.431256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:59.207551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.505737+0000","last_change":"2024-09-16T01:00:26.355952+0000","last_active":"2024-09-16T01:00:40.505737+0000","last_peered":"2024-09-16T01:00:40.505737+0000","last_clean":"2024-09-16T01:00:40.505737+0000","last_became_active":"2024-09-16T01:00:26.355600+0000","last_became_peered":"2024-09-16T01:00:26.355600+0000","last_unstale":"2024-09-16T01:00:40.505737+0000","last_undegraded":"2024-09-16T01:00:40.505737+0000","last_fullsized":"2024-09-16T01:00:40.505737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:29.294004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447285+0000","last_change":"2024-09-16T01:00:28.440130+0000","last_active":"2024-09-16T01:00:29.447285+0000","last_peered":"2024-09-16T01:00:29.447285+0000","last_clean":"2024-09-16T01:00:29.447285+0000","last_became_active":"2024-09-16T01:00:28.439805+0000","last_became_peered":"2024-09-16T01:00:28.439805+0000","last_unstale":"2024-09-16T01:00:29.447285+0000","last_undegraded":"2024-09-16T01:00:29.447285+0000","last_fullsized":"2024-09-16T01:00:29.447285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:38.977930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.841915+0000","last_change":"2024-09-16T01:00:26.745139+0000","last_active":"2024-09-16T01:00:29.841915+0000","last_peered":"2024-09-16T01:00:29.841915+0000","last_clean":"2024-09-16T01:00:29.841915+0000","last_became_active":"2024-09-16T01:00:26.744796+0000","last_became_peered":"2024-09-16T01:00:26.744796+0000","last_unstale":"2024-09-16T01:00:29.841915+0000","last_undegraded":"2024-09-16T01:00:29.841915+0000","last_fullsized":"2024-09-16T01:00:29.841915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:29.368451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430479+0000","last_change":"2024-09-16T01:00:28.449380+0000","last_active":"2024-09-16T01:00:29.430479+0000","last_peered":"2024-09-16T01:00:29.430479+0000","last_clean":"2024-09-16T01:00:29.430479+0000","last_became_active":"2024-09-16T01:00:28.448826+0000","last_became_peered":"2024-09-16T01:00:28.448826+0000","last_unstale":"2024-09-16T01:00:29.430479+0000","last_undegraded":"2024-09-16T01:00:29.430479+0000","last_fullsized":"2024-09-16T01:00:29.430479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:19.987506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:51.531094+0000","last_change":"2024-09-16T01:00:26.354148+0000","last_active":"2024-09-16T01:00:51.531094+0000","last_peered":"2024-09-16T01:00:51.531094+0000","last_clean":"2024-09-16T01:00:51.531094+0000","last_became_active":"2024-09-16T01:00:26.353477+0000","last_became_peered":"2024-09-16T01:00:26.353477+0000","last_unstale":"2024-09-16T01:00:51.531094+0000","last_undegraded":"2024-09-16T01:00:51.531094+0000","last_fullsized":"2024-09-16T01:00:51.531094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:44.715792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54796,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":151,"num_read_kb":139,"num_write":234,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":164388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215943,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":417671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":1055502,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":417586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":1010892,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1009784,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":416750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":465646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":465033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":418657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34623,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:00:54.730 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:00:54.887 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:54 smithi088 ceph-mon[34093]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2024-09-16T01:00:54.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:54 smithi154 ceph-mon[34759]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 17 op/s 2024-09-16T01:00:54.991 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 -- 172.21.15.17:0/2833324810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 msgr2=0x7f84f81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 --2- 172.21.15.17:0/2833324810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81021c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009900 tx=0x7f84f402a410 comp rx=0 tx=0).stop 2024-09-16T01:00:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 -- 172.21.15.17:0/2833324810 shutdown_connections 2024-09-16T01:00:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 --2- 172.21.15.17:0/2833324810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8106f10 0x7f84f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 --2- 172.21.15.17:0/2833324810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8102790 0x7f84f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 --2- 172.21.15.17:0/2833324810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81021c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.444+0000 7f84ffa51640 1 -- 172.21.15.17:0/2833324810 >> 172.21.15.17:0/2833324810 conn(0x7f84f80fd8c0 msgr2=0x7f84f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- 172.21.15.17:0/2833324810 shutdown_connections 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- 172.21.15.17:0/2833324810 wait complete. 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 Processor -- start 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- start start 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 0x7f84f81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8106f10 0x7f84f819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8111e40 con 0x7f84f8101de0 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8111cc0 con 0x7f84f8106f10 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84ffa51640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8111fc0 con 0x7f84f8102790 2024-09-16T01:00:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84fd7ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.445+0000 7f84fd7ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37120/0 (socket says 172.21.15.17:37120) 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 -- 172.21.15.17:0/335647351 learned_addr learned my addr 172.21.15.17:0/335647351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fdfee640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8106f10 0x7f84f819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fcfec640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 0x7f84f81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 -- 172.21.15.17:0/335647351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 msgr2=0x7f84f81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 0x7f84f81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 -- 172.21.15.17:0/335647351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8106f10 msgr2=0x7f84f819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8106f10 0x7f84f819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 -- 172.21.15.17:0/335647351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f819d460 con 0x7f84f8101de0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fcfec640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 0x7f84f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84fd7ed640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84f4005940 tx=0x7f84f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f403f030 con 0x7f84f8101de0 2024-09-16T01:00:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84f4003cb0 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f819d6f0 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4035070 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.446+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f81a5030 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.447+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f81032c0 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.448+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f84f4042030 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.449+0000 7f84ea7fc640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 0x7f84e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.449+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f84f40f0320 con 0x7f84f8101de0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.449+0000 7f84fcfec640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 0x7f84e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.450+0000 7f84fcfec640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 0x7f84e40a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84f80fdd00 tx=0x7f84ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.452+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84f40bd090 con 0x7f84f8101de0 2024-09-16T01:00:55.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.627+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84f810a160 con 0x7f84e40a32d0 2024-09-16T01:00:55.629 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:55 smithi017 ceph-mon[31211]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.633+0000 7f84ea7fc640 1 -- 172.21.15.17:0/335647351 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258868 (secure 0 0 0) 0x7f84ec010b10 con 0x7f84e40a32d0 2024-09-16T01:00:55.637 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:55.638 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 msgr2=0x7f84e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 0x7f84e40a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84f80fdd00 tx=0x7f84ec005f90 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 msgr2=0x7f84f81984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84f4005940 tx=0x7f84f40042f0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 shutdown_connections 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f84e40a32d0 0x7f84e40a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84f8106f10 0x7f84f819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f8102790 0x7f84f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 --2- 172.21.15.17:0/335647351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84f8101de0 0x7f84f81984b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.637+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 >> 172.21.15.17:0/335647351 conn(0x7f84f80fd8c0 msgr2=0x7f84f80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:55.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.638+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 shutdown_connections 2024-09-16T01:00:55.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:55.638+0000 7f84ffa51640 1 -- 172.21.15.17:0/335647351 wait complete. 2024-09-16T01:00:55.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:55 smithi088 ceph-mon[34093]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:55.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:55 smithi154 ceph-mon[34759]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:56.489 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-16T01:00:54.920456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645398,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":292,"num_read_kb":258,"num_write":417,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376668,"kb_used_data":10780,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565156,"statfs":{"total":1151940427776,"available":1151554719744,"internally_reserved":0,"allocated":11038720,"data_stored":6945530,"data_compressed":108792,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46996,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":120,"num_write":31,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002718"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451354+0000","last_change":"2024-09-16T01:00:28.449298+0000","last_active":"2024-09-16T01:00:29.451354+0000","last_peered":"2024-09-16T01:00:29.451354+0000","last_clean":"2024-09-16T01:00:29.451354+0000","last_became_active":"2024-09-16T01:00:28.448925+0000","last_became_peered":"2024-09-16T01:00:28.448925+0000","last_unstale":"2024-09-16T01:00:29.451354+0000","last_undegraded":"2024-09-16T01:00:29.451354+0000","last_fullsized":"2024-09-16T01:00:29.451354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:54.432714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447088+0000","last_change":"2024-09-16T01:00:28.440068+0000","last_active":"2024-09-16T01:00:29.447088+0000","last_peered":"2024-09-16T01:00:29.447088+0000","last_clean":"2024-09-16T01:00:29.447088+0000","last_became_active":"2024-09-16T01:00:28.439730+0000","last_became_peered":"2024-09-16T01:00:28.439730+0000","last_unstale":"2024-09-16T01:00:29.447088+0000","last_undegraded":"2024-09-16T01:00:29.447088+0000","last_fullsized":"2024-09-16T01:00:29.447088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.021941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447237+0000","last_change":"2024-09-16T01:00:28.451754+0000","last_active":"2024-09-16T01:00:29.447237+0000","last_peered":"2024-09-16T01:00:29.447237+0000","last_clean":"2024-09-16T01:00:29.447237+0000","last_became_active":"2024-09-16T01:00:28.451418+0000","last_became_peered":"2024-09-16T01:00:28.451418+0000","last_unstale":"2024-09-16T01:00:29.447237+0000","last_undegraded":"2024-09-16T01:00:29.447237+0000","last_fullsized":"2024-09-16T01:00:29.447237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:10.383137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446778+0000","last_change":"2024-09-16T01:00:28.451256+0000","last_active":"2024-09-16T01:00:29.446778+0000","last_peered":"2024-09-16T01:00:29.446778+0000","last_clean":"2024-09-16T01:00:29.446778+0000","last_became_active":"2024-09-16T01:00:28.450929+0000","last_became_peered":"2024-09-16T01:00:28.450929+0000","last_unstale":"2024-09-16T01:00:29.446778+0000","last_undegraded":"2024-09-16T01:00:29.446778+0000","last_fullsized":"2024-09-16T01:00:29.446778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446924+0000","last_change":"2024-09-16T01:00:28.436789+0000","last_active":"2024-09-16T01:00:29.446924+0000","last_peered":"2024-09-16T01:00:29.446924+0000","last_clean":"2024-09-16T01:00:29.446924+0000","last_became_active":"2024-09-16T01:00:28.436386+0000","last_became_peered":"2024-09-16T01:00:28.436386+0000","last_unstale":"2024-09-16T01:00:29.446924+0000","last_undegraded":"2024-09-16T01:00:29.446924+0000","last_fullsized":"2024-09-16T01:00:29.446924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:07.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446537+0000","last_change":"2024-09-16T01:00:28.449819+0000","last_active":"2024-09-16T01:00:29.446537+0000","last_peered":"2024-09-16T01:00:29.446537+0000","last_clean":"2024-09-16T01:00:29.446537+0000","last_became_active":"2024-09-16T01:00:28.449474+0000","last_became_peered":"2024-09-16T01:00:28.449474+0000","last_unstale":"2024-09-16T01:00:29.446537+0000","last_undegraded":"2024-09-16T01:00:29.446537+0000","last_fullsized":"2024-09-16T01:00:29.446537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:21.879279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447035+0000","last_change":"2024-09-16T01:00:28.442449+0000","last_active":"2024-09-16T01:00:29.447035+0000","last_peered":"2024-09-16T01:00:29.447035+0000","last_clean":"2024-09-16T01:00:29.447035+0000","last_became_active":"2024-09-16T01:00:28.442087+0000","last_became_peered":"2024-09-16T01:00:28.442087+0000","last_unstale":"2024-09-16T01:00:29.447035+0000","last_undegraded":"2024-09-16T01:00:29.447035+0000","last_fullsized":"2024-09-16T01:00:29.447035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:01.996570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430109+0000","last_change":"2024-09-16T01:00:28.443923+0000","last_active":"2024-09-16T01:00:29.430109+0000","last_peered":"2024-09-16T01:00:29.430109+0000","last_clean":"2024-09-16T01:00:29.430109+0000","last_became_active":"2024-09-16T01:00:28.443598+0000","last_became_peered":"2024-09-16T01:00:28.443598+0000","last_unstale":"2024-09-16T01:00:29.430109+0000","last_undegraded":"2024-09-16T01:00:29.430109+0000","last_fullsized":"2024-09-16T01:00:29.430109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:55.479224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431754+0000","last_change":"2024-09-16T01:00:28.451668+0000","last_active":"2024-09-16T01:00:29.431754+0000","last_peered":"2024-09-16T01:00:29.431754+0000","last_clean":"2024-09-16T01:00:29.431754+0000","last_became_active":"2024-09-16T01:00:28.451360+0000","last_became_peered":"2024-09-16T01:00:28.451360+0000","last_unstale":"2024-09-16T01:00:29.431754+0000","last_undegraded":"2024-09-16T01:00:29.431754+0000","last_fullsized":"2024-09-16T01:00:29.431754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:32.969507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446207+0000","last_change":"2024-09-16T01:00:28.450791+0000","last_active":"2024-09-16T01:00:29.446207+0000","last_peered":"2024-09-16T01:00:29.446207+0000","last_clean":"2024-09-16T01:00:29.446207+0000","last_became_active":"2024-09-16T01:00:28.450408+0000","last_became_peered":"2024-09-16T01:00:28.450408+0000","last_unstale":"2024-09-16T01:00:29.446207+0000","last_undegraded":"2024-09-16T01:00:29.446207+0000","last_fullsized":"2024-09-16T01:00:29.446207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:31.301796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446779+0000","last_change":"2024-09-16T01:00:28.446736+0000","last_active":"2024-09-16T01:00:29.446779+0000","last_peered":"2024-09-16T01:00:29.446779+0000","last_clean":"2024-09-16T01:00:29.446779+0000","last_became_active":"2024-09-16T01:00:28.446201+0000","last_became_peered":"2024-09-16T01:00:28.446201+0000","last_unstale":"2024-09-16T01:00:29.446779+0000","last_undegraded":"2024-09-16T01:00:29.446779+0000","last_fullsized":"2024-09-16T01:00:29.446779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:50.274171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.452266+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.451927+0000","last_became_peered":"2024-09-16T01:00:28.451927+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:10.361046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446281+0000","last_change":"2024-09-16T01:00:28.440957+0000","last_active":"2024-09-16T01:00:29.446281+0000","last_peered":"2024-09-16T01:00:29.446281+0000","last_clean":"2024-09-16T01:00:29.446281+0000","last_became_active":"2024-09-16T01:00:28.440653+0000","last_became_peered":"2024-09-16T01:00:28.440653+0000","last_unstale":"2024-09-16T01:00:29.446281+0000","last_undegraded":"2024-09-16T01:00:29.446281+0000","last_fullsized":"2024-09-16T01:00:29.446281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:15.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446856+0000","last_change":"2024-09-16T01:00:28.443914+0000","last_active":"2024-09-16T01:00:29.446856+0000","last_peered":"2024-09-16T01:00:29.446856+0000","last_clean":"2024-09-16T01:00:29.446856+0000","last_became_active":"2024-09-16T01:00:28.443600+0000","last_became_peered":"2024-09-16T01:00:28.443600+0000","last_unstale":"2024-09-16T01:00:29.446856+0000","last_undegraded":"2024-09-16T01:00:29.446856+0000","last_fullsized":"2024-09-16T01:00:29.446856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:35.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446638+0000","last_change":"2024-09-16T01:00:28.449970+0000","last_active":"2024-09-16T01:00:29.446638+0000","last_peered":"2024-09-16T01:00:29.446638+0000","last_clean":"2024-09-16T01:00:29.446638+0000","last_became_active":"2024-09-16T01:00:28.449464+0000","last_became_peered":"2024-09-16T01:00:28.449464+0000","last_unstale":"2024-09-16T01:00:29.446638+0000","last_undegraded":"2024-09-16T01:00:29.446638+0000","last_fullsized":"2024-09-16T01:00:29.446638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:01.537338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431182+0000","last_change":"2024-09-16T01:00:28.445004+0000","last_active":"2024-09-16T01:00:29.431182+0000","last_peered":"2024-09-16T01:00:29.431182+0000","last_clean":"2024-09-16T01:00:29.431182+0000","last_became_active":"2024-09-16T01:00:28.444503+0000","last_became_peered":"2024-09-16T01:00:28.444503+0000","last_unstale":"2024-09-16T01:00:29.431182+0000","last_undegraded":"2024-09-16T01:00:29.431182+0000","last_fullsized":"2024-09-16T01:00:29.431182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:05.330992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451229+0000","last_change":"2024-09-16T01:00:28.451975+0000","last_active":"2024-09-16T01:00:29.451229+0000","last_peered":"2024-09-16T01:00:29.451229+0000","last_clean":"2024-09-16T01:00:29.451229+0000","last_became_active":"2024-09-16T01:00:28.451582+0000","last_became_peered":"2024-09-16T01:00:28.451582+0000","last_unstale":"2024-09-16T01:00:29.451229+0000","last_undegraded":"2024-09-16T01:00:29.451229+0000","last_fullsized":"2024-09-16T01:00:29.451229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.032697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446326+0000","last_change":"2024-09-16T01:00:28.439491+0000","last_active":"2024-09-16T01:00:29.446326+0000","last_peered":"2024-09-16T01:00:29.446326+0000","last_clean":"2024-09-16T01:00:29.446326+0000","last_became_active":"2024-09-16T01:00:28.439130+0000","last_became_peered":"2024-09-16T01:00:28.439130+0000","last_unstale":"2024-09-16T01:00:29.446326+0000","last_undegraded":"2024-09-16T01:00:29.446326+0000","last_fullsized":"2024-09-16T01:00:29.446326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:33.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446504+0000","last_change":"2024-09-16T01:00:28.448537+0000","last_active":"2024-09-16T01:00:29.446504+0000","last_peered":"2024-09-16T01:00:29.446504+0000","last_clean":"2024-09-16T01:00:29.446504+0000","last_became_active":"2024-09-16T01:00:28.448146+0000","last_became_peered":"2024-09-16T01:00:28.448146+0000","last_unstale":"2024-09-16T01:00:29.446504+0000","last_undegraded":"2024-09-16T01:00:29.446504+0000","last_fullsized":"2024-09-16T01:00:29.446504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:58.466156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450747+0000","last_change":"2024-09-16T01:00:28.452877+0000","last_active":"2024-09-16T01:00:29.450747+0000","last_peered":"2024-09-16T01:00:29.450747+0000","last_clean":"2024-09-16T01:00:29.450747+0000","last_became_active":"2024-09-16T01:00:28.452542+0000","last_became_peered":"2024-09-16T01:00:28.452542+0000","last_unstale":"2024-09-16T01:00:29.450747+0000","last_undegraded":"2024-09-16T01:00:29.450747+0000","last_fullsized":"2024-09-16T01:00:29.450747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:56.337456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446432+0000","last_change":"2024-09-16T01:00:28.442157+0000","last_active":"2024-09-16T01:00:29.446432+0000","last_peered":"2024-09-16T01:00:29.446432+0000","last_clean":"2024-09-16T01:00:29.446432+0000","last_became_active":"2024-09-16T01:00:28.441852+0000","last_became_peered":"2024-09-16T01:00:28.441852+0000","last_unstale":"2024-09-16T01:00:29.446432+0000","last_undegraded":"2024-09-16T01:00:29.446432+0000","last_fullsized":"2024-09-16T01:00:29.446432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:36.503203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431210+0000","last_change":"2024-09-16T01:00:28.443734+0000","last_active":"2024-09-16T01:00:29.431210+0000","last_peered":"2024-09-16T01:00:29.431210+0000","last_clean":"2024-09-16T01:00:29.431210+0000","last_became_active":"2024-09-16T01:00:28.443287+0000","last_became_peered":"2024-09-16T01:00:28.443287+0000","last_unstale":"2024-09-16T01:00:29.431210+0000","last_undegraded":"2024-09-16T01:00:29.431210+0000","last_fullsized":"2024-09-16T01:00:29.431210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:12.920159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430171+0000","last_change":"2024-09-16T01:00:28.448425+0000","last_active":"2024-09-16T01:00:29.430171+0000","last_peered":"2024-09-16T01:00:29.430171+0000","last_clean":"2024-09-16T01:00:29.430171+0000","last_became_active":"2024-09-16T01:00:28.448109+0000","last_became_peered":"2024-09-16T01:00:28.448109+0000","last_unstale":"2024-09-16T01:00:29.430171+0000","last_undegraded":"2024-09-16T01:00:29.430171+0000","last_fullsized":"2024-09-16T01:00:29.430171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:22.671812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434004+0000","last_change":"2024-09-16T01:00:28.446417+0000","last_active":"2024-09-16T01:00:29.434004+0000","last_peered":"2024-09-16T01:00:29.434004+0000","last_clean":"2024-09-16T01:00:29.434004+0000","last_became_active":"2024-09-16T01:00:28.445919+0000","last_became_peered":"2024-09-16T01:00:28.445919+0000","last_unstale":"2024-09-16T01:00:29.434004+0000","last_undegraded":"2024-09-16T01:00:29.434004+0000","last_fullsized":"2024-09-16T01:00:29.434004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:11.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430471+0000","last_change":"2024-09-16T01:00:28.451072+0000","last_active":"2024-09-16T01:00:29.430471+0000","last_peered":"2024-09-16T01:00:29.430471+0000","last_clean":"2024-09-16T01:00:29.430471+0000","last_became_active":"2024-09-16T01:00:28.450760+0000","last_became_peered":"2024-09-16T01:00:28.450760+0000","last_unstale":"2024-09-16T01:00:29.430471+0000","last_undegraded":"2024-09-16T01:00:29.430471+0000","last_fullsized":"2024-09-16T01:00:29.430471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:24.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446272+0000","last_change":"2024-09-16T01:00:28.445776+0000","last_active":"2024-09-16T01:00:29.446272+0000","last_peered":"2024-09-16T01:00:29.446272+0000","last_clean":"2024-09-16T01:00:29.446272+0000","last_became_active":"2024-09-16T01:00:28.445456+0000","last_became_peered":"2024-09-16T01:00:28.445456+0000","last_unstale":"2024-09-16T01:00:29.446272+0000","last_undegraded":"2024-09-16T01:00:29.446272+0000","last_fullsized":"2024-09-16T01:00:29.446272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451378+0000","last_change":"2024-09-16T01:00:28.447437+0000","last_active":"2024-09-16T01:00:29.451378+0000","last_peered":"2024-09-16T01:00:29.451378+0000","last_clean":"2024-09-16T01:00:29.451378+0000","last_became_active":"2024-09-16T01:00:28.447108+0000","last_became_peered":"2024-09-16T01:00:28.447108+0000","last_unstale":"2024-09-16T01:00:29.451378+0000","last_undegraded":"2024-09-16T01:00:29.451378+0000","last_fullsized":"2024-09-16T01:00:29.451378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:12.484102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445726+0000","last_change":"2024-09-16T01:00:28.452750+0000","last_active":"2024-09-16T01:00:29.445726+0000","last_peered":"2024-09-16T01:00:29.445726+0000","last_clean":"2024-09-16T01:00:29.445726+0000","last_became_active":"2024-09-16T01:00:28.452382+0000","last_became_peered":"2024-09-16T01:00:28.452382+0000","last_unstale":"2024-09-16T01:00:29.445726+0000","last_undegraded":"2024-09-16T01:00:29.445726+0000","last_fullsized":"2024-09-16T01:00:29.445726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.127201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447646+0000","last_change":"2024-09-16T01:00:28.450220+0000","last_active":"2024-09-16T01:00:29.447646+0000","last_peered":"2024-09-16T01:00:29.447646+0000","last_clean":"2024-09-16T01:00:29.447646+0000","last_became_active":"2024-09-16T01:00:28.449824+0000","last_became_peered":"2024-09-16T01:00:28.449824+0000","last_unstale":"2024-09-16T01:00:29.447646+0000","last_undegraded":"2024-09-16T01:00:29.447646+0000","last_fullsized":"2024-09-16T01:00:29.447646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:08.428729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446478+0000","last_change":"2024-09-16T01:00:28.447282+0000","last_active":"2024-09-16T01:00:29.446478+0000","last_peered":"2024-09-16T01:00:29.446478+0000","last_clean":"2024-09-16T01:00:29.446478+0000","last_became_active":"2024-09-16T01:00:28.446839+0000","last_became_peered":"2024-09-16T01:00:28.446839+0000","last_unstale":"2024-09-16T01:00:29.446478+0000","last_undegraded":"2024-09-16T01:00:29.446478+0000","last_fullsized":"2024-09-16T01:00:29.446478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:33.594170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445915+0000","last_change":"2024-09-16T01:00:28.454019+0000","last_active":"2024-09-16T01:00:29.445915+0000","last_peered":"2024-09-16T01:00:29.445915+0000","last_clean":"2024-09-16T01:00:29.445915+0000","last_became_active":"2024-09-16T01:00:28.453706+0000","last_became_peered":"2024-09-16T01:00:28.453706+0000","last_unstale":"2024-09-16T01:00:29.445915+0000","last_undegraded":"2024-09-16T01:00:29.445915+0000","last_fullsized":"2024-09-16T01:00:29.445915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:09.704344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450704+0000","last_change":"2024-09-16T01:00:28.449323+0000","last_active":"2024-09-16T01:00:29.450704+0000","last_peered":"2024-09-16T01:00:29.450704+0000","last_clean":"2024-09-16T01:00:29.450704+0000","last_became_active":"2024-09-16T01:00:28.448536+0000","last_became_peered":"2024-09-16T01:00:28.448536+0000","last_unstale":"2024-09-16T01:00:29.450704+0000","last_undegraded":"2024-09-16T01:00:29.450704+0000","last_fullsized":"2024-09-16T01:00:29.450704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:11.145663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446668+0000","last_change":"2024-09-16T01:00:28.440882+0000","last_active":"2024-09-16T01:00:29.446668+0000","last_peered":"2024-09-16T01:00:29.446668+0000","last_clean":"2024-09-16T01:00:29.446668+0000","last_became_active":"2024-09-16T01:00:28.440496+0000","last_became_peered":"2024-09-16T01:00:28.440496+0000","last_unstale":"2024-09-16T01:00:29.446668+0000","last_undegraded":"2024-09-16T01:00:29.446668+0000","last_fullsized":"2024-09-16T01:00:29.446668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:16.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.531745+0000","last_change":"2024-09-16T01:00:26.357785+0000","last_active":"2024-09-16T01:00:49.531745+0000","last_peered":"2024-09-16T01:00:49.531745+0000","last_clean":"2024-09-16T01:00:49.531745+0000","last_became_active":"2024-09-16T01:00:26.357450+0000","last_became_peered":"2024-09-16T01:00:26.357450+0000","last_unstale":"2024-09-16T01:00:49.531745+0000","last_undegraded":"2024-09-16T01:00:49.531745+0000","last_fullsized":"2024-09-16T01:00:49.531745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.778996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433774+0000","last_change":"2024-09-16T01:00:28.454416+0000","last_active":"2024-09-16T01:00:29.433774+0000","last_peered":"2024-09-16T01:00:29.433774+0000","last_clean":"2024-09-16T01:00:29.433774+0000","last_became_active":"2024-09-16T01:00:28.454117+0000","last_became_peered":"2024-09-16T01:00:28.454117+0000","last_unstale":"2024-09-16T01:00:29.433774+0000","last_undegraded":"2024-09-16T01:00:29.433774+0000","last_fullsized":"2024-09-16T01:00:29.433774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:32.487601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.503539+0000","last_change":"2024-09-16T01:00:26.359828+0000","last_active":"2024-09-16T01:00:38.503539+0000","last_peered":"2024-09-16T01:00:38.503539+0000","last_clean":"2024-09-16T01:00:38.503539+0000","last_became_active":"2024-09-16T01:00:26.359520+0000","last_became_peered":"2024-09-16T01:00:26.359520+0000","last_unstale":"2024-09-16T01:00:38.503539+0000","last_undegraded":"2024-09-16T01:00:38.503539+0000","last_fullsized":"2024-09-16T01:00:38.503539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:14.477791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.493792+0000","last_change":"2024-09-16T01:00:26.353227+0000","last_active":"2024-09-16T01:00:37.493792+0000","last_peered":"2024-09-16T01:00:37.493792+0000","last_clean":"2024-09-16T01:00:37.493792+0000","last_became_active":"2024-09-16T01:00:26.352869+0000","last_became_peered":"2024-09-16T01:00:26.352869+0000","last_unstale":"2024-09-16T01:00:37.493792+0000","last_undegraded":"2024-09-16T01:00:37.493792+0000","last_fullsized":"2024-09-16T01:00:37.493792+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:48.035596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430142+0000","last_change":"2024-09-16T01:00:28.444766+0000","last_active":"2024-09-16T01:00:29.430142+0000","last_peered":"2024-09-16T01:00:29.430142+0000","last_clean":"2024-09-16T01:00:29.430142+0000","last_became_active":"2024-09-16T01:00:28.444450+0000","last_became_peered":"2024-09-16T01:00:28.444450+0000","last_unstale":"2024-09-16T01:00:29.430142+0000","last_undegraded":"2024-09-16T01:00:29.430142+0000","last_fullsized":"2024-09-16T01:00:29.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:07.610462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510477+0000","last_change":"2024-09-16T01:00:26.357087+0000","last_active":"2024-09-16T01:00:39.510477+0000","last_peered":"2024-09-16T01:00:39.510477+0000","last_clean":"2024-09-16T01:00:39.510477+0000","last_became_active":"2024-09-16T01:00:26.356758+0000","last_became_peered":"2024-09-16T01:00:26.356758+0000","last_unstale":"2024-09-16T01:00:39.510477+0000","last_undegraded":"2024-09-16T01:00:39.510477+0000","last_fullsized":"2024-09-16T01:00:39.510477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:55.525693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445379+0000","last_change":"2024-09-16T01:00:28.438715+0000","last_active":"2024-09-16T01:00:29.445379+0000","last_peered":"2024-09-16T01:00:29.445379+0000","last_clean":"2024-09-16T01:00:29.445379+0000","last_became_active":"2024-09-16T01:00:28.438380+0000","last_became_peered":"2024-09-16T01:00:28.438380+0000","last_unstale":"2024-09-16T01:00:29.445379+0000","last_undegraded":"2024-09-16T01:00:29.445379+0000","last_fullsized":"2024-09-16T01:00:29.445379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:34.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.532327+0000","last_change":"2024-09-16T01:00:26.359263+0000","last_active":"2024-09-16T01:00:50.532327+0000","last_peered":"2024-09-16T01:00:50.532327+0000","last_clean":"2024-09-16T01:00:50.532327+0000","last_became_active":"2024-09-16T01:00:26.358936+0000","last_became_peered":"2024-09-16T01:00:26.358936+0000","last_unstale":"2024-09-16T01:00:50.532327+0000","last_undegraded":"2024-09-16T01:00:50.532327+0000","last_fullsized":"2024-09-16T01:00:50.532327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:31.125243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431558+0000","last_change":"2024-09-16T01:00:28.445330+0000","last_active":"2024-09-16T01:00:29.431558+0000","last_peered":"2024-09-16T01:00:29.431558+0000","last_clean":"2024-09-16T01:00:29.431558+0000","last_became_active":"2024-09-16T01:00:28.444913+0000","last_became_peered":"2024-09-16T01:00:28.444913+0000","last_unstale":"2024-09-16T01:00:29.431558+0000","last_undegraded":"2024-09-16T01:00:29.431558+0000","last_fullsized":"2024-09-16T01:00:29.431558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:16.583722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509989+0000","last_change":"2024-09-16T01:00:26.356972+0000","last_active":"2024-09-16T01:00:39.509989+0000","last_peered":"2024-09-16T01:00:39.509989+0000","last_clean":"2024-09-16T01:00:39.509989+0000","last_became_active":"2024-09-16T01:00:26.356525+0000","last_became_peered":"2024-09-16T01:00:26.356525+0000","last_unstale":"2024-09-16T01:00:39.509989+0000","last_undegraded":"2024-09-16T01:00:39.509989+0000","last_fullsized":"2024-09-16T01:00:39.509989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:42.908179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447323+0000","last_change":"2024-09-16T01:00:28.449732+0000","last_active":"2024-09-16T01:00:29.447323+0000","last_peered":"2024-09-16T01:00:29.447323+0000","last_clean":"2024-09-16T01:00:29.447323+0000","last_became_active":"2024-09-16T01:00:28.449325+0000","last_became_peered":"2024-09-16T01:00:28.449325+0000","last_unstale":"2024-09-16T01:00:29.447323+0000","last_undegraded":"2024-09-16T01:00:29.447323+0000","last_fullsized":"2024-09-16T01:00:29.447323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:55.370952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502667+0000","last_change":"2024-09-16T01:00:26.746513+0000","last_active":"2024-09-16T01:00:38.502667+0000","last_peered":"2024-09-16T01:00:38.502667+0000","last_clean":"2024-09-16T01:00:38.502667+0000","last_became_active":"2024-09-16T01:00:26.746114+0000","last_became_peered":"2024-09-16T01:00:26.746114+0000","last_unstale":"2024-09-16T01:00:38.502667+0000","last_undegraded":"2024-09-16T01:00:38.502667+0000","last_fullsized":"2024-09-16T01:00:38.502667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431274+0000","last_change":"2024-09-16T01:00:28.452854+0000","last_active":"2024-09-16T01:00:29.431274+0000","last_peered":"2024-09-16T01:00:29.431274+0000","last_clean":"2024-09-16T01:00:29.431274+0000","last_became_active":"2024-09-16T01:00:28.452548+0000","last_became_peered":"2024-09-16T01:00:28.452548+0000","last_unstale":"2024-09-16T01:00:29.431274+0000","last_undegraded":"2024-09-16T01:00:29.431274+0000","last_fullsized":"2024-09-16T01:00:29.431274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:12.527860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.535208+0000","last_change":"2024-09-16T01:00:26.361221+0000","last_active":"2024-09-16T01:00:50.535208+0000","last_peered":"2024-09-16T01:00:50.535208+0000","last_clean":"2024-09-16T01:00:50.535208+0000","last_became_active":"2024-09-16T01:00:26.360785+0000","last_became_peered":"2024-09-16T01:00:26.360785+0000","last_unstale":"2024-09-16T01:00:50.535208+0000","last_undegraded":"2024-09-16T01:00:50.535208+0000","last_fullsized":"2024-09-16T01:00:50.535208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:07.145342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447395+0000","last_change":"2024-09-16T01:00:28.443905+0000","last_active":"2024-09-16T01:00:29.447395+0000","last_peered":"2024-09-16T01:00:29.447395+0000","last_clean":"2024-09-16T01:00:29.447395+0000","last_became_active":"2024-09-16T01:00:28.442808+0000","last_became_peered":"2024-09-16T01:00:28.442808+0000","last_unstale":"2024-09-16T01:00:29.447395+0000","last_undegraded":"2024-09-16T01:00:29.447395+0000","last_fullsized":"2024-09-16T01:00:29.447395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.513028+0000","last_change":"2024-09-16T01:00:26.358696+0000","last_active":"2024-09-16T01:00:40.513028+0000","last_peered":"2024-09-16T01:00:40.513028+0000","last_clean":"2024-09-16T01:00:40.513028+0000","last_became_active":"2024-09-16T01:00:26.358306+0000","last_became_peered":"2024-09-16T01:00:26.358306+0000","last_unstale":"2024-09-16T01:00:40.513028+0000","last_undegraded":"2024-09-16T01:00:40.513028+0000","last_fullsized":"2024-09-16T01:00:40.513028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:34.811501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445791+0000","last_change":"2024-09-16T01:00:28.439511+0000","last_active":"2024-09-16T01:00:29.445791+0000","last_peered":"2024-09-16T01:00:29.445791+0000","last_clean":"2024-09-16T01:00:29.445791+0000","last_became_active":"2024-09-16T01:00:28.439204+0000","last_became_peered":"2024-09-16T01:00:28.439204+0000","last_unstale":"2024-09-16T01:00:29.445791+0000","last_undegraded":"2024-09-16T01:00:29.445791+0000","last_fullsized":"2024-09-16T01:00:29.445791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:00.331186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510658+0000","last_change":"2024-09-16T01:00:26.357142+0000","last_active":"2024-09-16T01:00:39.510658+0000","last_peered":"2024-09-16T01:00:39.510658+0000","last_clean":"2024-09-16T01:00:39.510658+0000","last_became_active":"2024-09-16T01:00:26.356738+0000","last_became_peered":"2024-09-16T01:00:26.356738+0000","last_unstale":"2024-09-16T01:00:39.510658+0000","last_undegraded":"2024-09-16T01:00:39.510658+0000","last_fullsized":"2024-09-16T01:00:39.510658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:41.895356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446568+0000","last_change":"2024-09-16T01:00:28.449767+0000","last_active":"2024-09-16T01:00:29.446568+0000","last_peered":"2024-09-16T01:00:29.446568+0000","last_clean":"2024-09-16T01:00:29.446568+0000","last_became_active":"2024-09-16T01:00:28.449454+0000","last_became_peered":"2024-09-16T01:00:28.449454+0000","last_unstale":"2024-09-16T01:00:29.446568+0000","last_undegraded":"2024-09-16T01:00:29.446568+0000","last_fullsized":"2024-09-16T01:00:29.446568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:44.395194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:48.530619+0000","last_change":"2024-09-16T01:00:26.358441+0000","last_active":"2024-09-16T01:00:48.530619+0000","last_peered":"2024-09-16T01:00:48.530619+0000","last_clean":"2024-09-16T01:00:48.530619+0000","last_became_active":"2024-09-16T01:00:26.358110+0000","last_became_peered":"2024-09-16T01:00:26.358110+0000","last_unstale":"2024-09-16T01:00:48.530619+0000","last_undegraded":"2024-09-16T01:00:48.530619+0000","last_fullsized":"2024-09-16T01:00:48.530619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446963+0000","last_change":"2024-09-16T01:00:28.447408+0000","last_active":"2024-09-16T01:00:29.446963+0000","last_peered":"2024-09-16T01:00:29.446963+0000","last_clean":"2024-09-16T01:00:29.446963+0000","last_became_active":"2024-09-16T01:00:28.447089+0000","last_became_peered":"2024-09-16T01:00:28.447089+0000","last_unstale":"2024-09-16T01:00:29.446963+0000","last_undegraded":"2024-09-16T01:00:29.446963+0000","last_fullsized":"2024-09-16T01:00:29.446963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:40.081429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508119+0000","last_change":"2024-09-16T01:00:26.745619+0000","last_active":"2024-09-16T01:00:39.508119+0000","last_peered":"2024-09-16T01:00:39.508119+0000","last_clean":"2024-09-16T01:00:39.508119+0000","last_became_active":"2024-09-16T01:00:26.745265+0000","last_became_peered":"2024-09-16T01:00:26.745265+0000","last_unstale":"2024-09-16T01:00:39.508119+0000","last_undegraded":"2024-09-16T01:00:39.508119+0000","last_fullsized":"2024-09-16T01:00:39.508119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:54.254160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434189+0000","last_change":"2024-09-16T01:00:28.456065+0000","last_active":"2024-09-16T01:00:29.434189+0000","last_peered":"2024-09-16T01:00:29.434189+0000","last_clean":"2024-09-16T01:00:29.434189+0000","last_became_active":"2024-09-16T01:00:28.455692+0000","last_became_peered":"2024-09-16T01:00:28.455692+0000","last_unstale":"2024-09-16T01:00:29.434189+0000","last_undegraded":"2024-09-16T01:00:29.434189+0000","last_fullsized":"2024-09-16T01:00:29.434189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.489340+0000","last_change":"2024-09-16T01:00:26.354191+0000","last_active":"2024-09-16T01:00:39.489340+0000","last_peered":"2024-09-16T01:00:39.489340+0000","last_clean":"2024-09-16T01:00:39.489340+0000","last_became_active":"2024-09-16T01:00:26.353753+0000","last_became_peered":"2024-09-16T01:00:26.353753+0000","last_unstale":"2024-09-16T01:00:39.489340+0000","last_undegraded":"2024-09-16T01:00:39.489340+0000","last_fullsized":"2024-09-16T01:00:39.489340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:16.098449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451025+0000","last_change":"2024-09-16T01:00:28.451056+0000","last_active":"2024-09-16T01:00:29.451025+0000","last_peered":"2024-09-16T01:00:29.451025+0000","last_clean":"2024-09-16T01:00:29.451025+0000","last_became_active":"2024-09-16T01:00:28.449801+0000","last_became_peered":"2024-09-16T01:00:28.449801+0000","last_unstale":"2024-09-16T01:00:29.451025+0000","last_undegraded":"2024-09-16T01:00:29.451025+0000","last_fullsized":"2024-09-16T01:00:29.451025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:06.207854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508582+0000","last_change":"2024-09-16T01:00:26.355975+0000","last_active":"2024-09-16T01:00:39.508582+0000","last_peered":"2024-09-16T01:00:39.508582+0000","last_clean":"2024-09-16T01:00:39.508582+0000","last_became_active":"2024-09-16T01:00:26.355629+0000","last_became_peered":"2024-09-16T01:00:26.355629+0000","last_unstale":"2024-09-16T01:00:39.508582+0000","last_undegraded":"2024-09-16T01:00:39.508582+0000","last_fullsized":"2024-09-16T01:00:39.508582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:06.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446815+0000","last_change":"2024-09-16T01:00:28.444387+0000","last_active":"2024-09-16T01:00:29.446815+0000","last_peered":"2024-09-16T01:00:29.446815+0000","last_clean":"2024-09-16T01:00:29.446815+0000","last_became_active":"2024-09-16T01:00:28.444076+0000","last_became_peered":"2024-09-16T01:00:28.444076+0000","last_unstale":"2024-09-16T01:00:29.446815+0000","last_undegraded":"2024-09-16T01:00:29.446815+0000","last_fullsized":"2024-09-16T01:00:29.446815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:50.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508980+0000","last_change":"2024-09-16T01:00:26.357038+0000","last_active":"2024-09-16T01:00:39.508980+0000","last_peered":"2024-09-16T01:00:39.508980+0000","last_clean":"2024-09-16T01:00:39.508980+0000","last_became_active":"2024-09-16T01:00:26.356599+0000","last_became_peered":"2024-09-16T01:00:26.356599+0000","last_unstale":"2024-09-16T01:00:39.508980+0000","last_undegraded":"2024-09-16T01:00:39.508980+0000","last_fullsized":"2024-09-16T01:00:39.508980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.288180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.833185+0000","last_change":"2024-09-16T01:00:28.443408+0000","last_active":"2024-09-16T01:00:31.833185+0000","last_peered":"2024-09-16T01:00:31.833185+0000","last_clean":"2024-09-16T01:00:31.833185+0000","last_became_active":"2024-09-16T01:00:28.443016+0000","last_became_peered":"2024-09-16T01:00:28.443016+0000","last_unstale":"2024-09-16T01:00:31.833185+0000","last_undegraded":"2024-09-16T01:00:31.833185+0000","last_fullsized":"2024-09-16T01:00:31.833185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:29.801811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:53.537349+0000","last_change":"2024-09-16T01:00:27.056514+0000","last_active":"2024-09-16T01:00:53.537349+0000","last_peered":"2024-09-16T01:00:53.537349+0000","last_clean":"2024-09-16T01:00:53.537349+0000","last_became_active":"2024-09-16T01:00:27.056137+0000","last_became_peered":"2024-09-16T01:00:27.056137+0000","last_unstale":"2024-09-16T01:00:53.537349+0000","last_undegraded":"2024-09-16T01:00:53.537349+0000","last_fullsized":"2024-09-16T01:00:53.537349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:07.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446792+0000","last_change":"2024-09-16T01:00:28.445866+0000","last_active":"2024-09-16T01:00:29.446792+0000","last_peered":"2024-09-16T01:00:29.446792+0000","last_clean":"2024-09-16T01:00:29.446792+0000","last_became_active":"2024-09-16T01:00:28.445454+0000","last_became_peered":"2024-09-16T01:00:28.445454+0000","last_unstale":"2024-09-16T01:00:29.446792+0000","last_undegraded":"2024-09-16T01:00:29.446792+0000","last_fullsized":"2024-09-16T01:00:29.446792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:44.340565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446297+0000","last_change":"2024-09-16T00:59:14.381567+0000","last_active":"2024-09-16T01:00:29.446297+0000","last_peered":"2024-09-16T01:00:29.446297+0000","last_clean":"2024-09-16T01:00:29.446297+0000","last_became_active":"2024-09-16T00:59:14.381088+0000","last_became_peered":"2024-09-16T00:59:14.381088+0000","last_unstale":"2024-09-16T01:00:29.446297+0000","last_undegraded":"2024-09-16T01:00:29.446297+0000","last_fullsized":"2024-09-16T01:00:29.446297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_clean_scrub_stamp":"2024-09-16T00:55:49.599122+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:14.170832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.512169+0000","last_change":"2024-09-16T01:00:26.357699+0000","last_active":"2024-09-16T01:00:40.512169+0000","last_peered":"2024-09-16T01:00:40.512169+0000","last_clean":"2024-09-16T01:00:40.512169+0000","last_became_active":"2024-09-16T01:00:26.357186+0000","last_became_peered":"2024-09-16T01:00:26.357186+0000","last_unstale":"2024-09-16T01:00:40.512169+0000","last_undegraded":"2024-09-16T01:00:40.512169+0000","last_fullsized":"2024-09-16T01:00:40.512169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:48.026723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430360+0000","last_change":"2024-09-16T01:00:28.446677+0000","last_active":"2024-09-16T01:00:29.430360+0000","last_peered":"2024-09-16T01:00:29.430360+0000","last_clean":"2024-09-16T01:00:29.430360+0000","last_became_active":"2024-09-16T01:00:28.446337+0000","last_became_peered":"2024-09-16T01:00:28.446337+0000","last_unstale":"2024-09-16T01:00:29.430360+0000","last_undegraded":"2024-09-16T01:00:29.430360+0000","last_fullsized":"2024-09-16T01:00:29.430360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:45.890312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.491499+0000","last_change":"2024-09-16T01:00:26.360153+0000","last_active":"2024-09-16T01:00:37.491499+0000","last_peered":"2024-09-16T01:00:37.491499+0000","last_clean":"2024-09-16T01:00:37.491499+0000","last_became_active":"2024-09-16T01:00:26.359828+0000","last_became_peered":"2024-09-16T01:00:26.359828+0000","last_unstale":"2024-09-16T01:00:37.491499+0000","last_undegraded":"2024-09-16T01:00:37.491499+0000","last_fullsized":"2024-09-16T01:00:37.491499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:27.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445683+0000","last_change":"2024-09-16T01:00:28.446587+0000","last_active":"2024-09-16T01:00:29.445683+0000","last_peered":"2024-09-16T01:00:29.445683+0000","last_clean":"2024-09-16T01:00:29.445683+0000","last_became_active":"2024-09-16T01:00:28.446221+0000","last_became_peered":"2024-09-16T01:00:28.446221+0000","last_unstale":"2024-09-16T01:00:29.445683+0000","last_undegraded":"2024-09-16T01:00:29.445683+0000","last_fullsized":"2024-09-16T01:00:29.445683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:07.027765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.531466+0000","last_change":"2024-09-16T01:00:26.745384+0000","last_active":"2024-09-16T01:00:49.531466+0000","last_peered":"2024-09-16T01:00:49.531466+0000","last_clean":"2024-09-16T01:00:49.531466+0000","last_became_active":"2024-09-16T01:00:26.745056+0000","last_became_peered":"2024-09-16T01:00:26.745056+0000","last_unstale":"2024-09-16T01:00:49.531466+0000","last_undegraded":"2024-09-16T01:00:49.531466+0000","last_fullsized":"2024-09-16T01:00:49.531466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:18.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433772+0000","last_change":"2024-09-16T01:00:28.454156+0000","last_active":"2024-09-16T01:00:29.433772+0000","last_peered":"2024-09-16T01:00:29.433772+0000","last_clean":"2024-09-16T01:00:29.433772+0000","last_became_active":"2024-09-16T01:00:28.453798+0000","last_became_peered":"2024-09-16T01:00:28.453798+0000","last_unstale":"2024-09-16T01:00:29.433772+0000","last_undegraded":"2024-09-16T01:00:29.433772+0000","last_fullsized":"2024-09-16T01:00:29.433772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.617433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:50.530359+0000","last_change":"2024-09-16T01:00:26.356232+0000","last_active":"2024-09-16T01:00:50.530359+0000","last_peered":"2024-09-16T01:00:50.530359+0000","last_clean":"2024-09-16T01:00:50.530359+0000","last_became_active":"2024-09-16T01:00:26.355874+0000","last_became_peered":"2024-09-16T01:00:26.355874+0000","last_unstale":"2024-09-16T01:00:50.530359+0000","last_undegraded":"2024-09-16T01:00:50.530359+0000","last_fullsized":"2024-09-16T01:00:50.530359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:53.426341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447525+0000","last_change":"2024-09-16T01:00:28.453279+0000","last_active":"2024-09-16T01:00:29.447525+0000","last_peered":"2024-09-16T01:00:29.447525+0000","last_clean":"2024-09-16T01:00:29.447525+0000","last_became_active":"2024-09-16T01:00:28.452808+0000","last_became_peered":"2024-09-16T01:00:28.452808+0000","last_unstale":"2024-09-16T01:00:29.447525+0000","last_undegraded":"2024-09-16T01:00:29.447525+0000","last_fullsized":"2024-09-16T01:00:29.447525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:06.096145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446100+0000","last_change":"2024-09-16T01:00:26.745692+0000","last_active":"2024-09-16T01:00:29.446100+0000","last_peered":"2024-09-16T01:00:29.446100+0000","last_clean":"2024-09-16T01:00:29.446100+0000","last_became_active":"2024-09-16T01:00:26.745325+0000","last_became_peered":"2024-09-16T01:00:26.745325+0000","last_unstale":"2024-09-16T01:00:29.446100+0000","last_undegraded":"2024-09-16T01:00:29.446100+0000","last_fullsized":"2024-09-16T01:00:29.446100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:19.061145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.358735+0000","last_change":"2024-09-16T01:00:28.452501+0000","last_active":"2024-09-16T01:00:31.358735+0000","last_peered":"2024-09-16T01:00:31.358735+0000","last_clean":"2024-09-16T01:00:31.358735+0000","last_became_active":"2024-09-16T01:00:28.451938+0000","last_became_peered":"2024-09-16T01:00:28.451938+0000","last_unstale":"2024-09-16T01:00:31.358735+0000","last_undegraded":"2024-09-16T01:00:31.358735+0000","last_fullsized":"2024-09-16T01:00:31.358735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:12.762849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510447+0000","last_change":"2024-09-16T01:00:26.746438+0000","last_active":"2024-09-16T01:00:39.510447+0000","last_peered":"2024-09-16T01:00:39.510447+0000","last_clean":"2024-09-16T01:00:39.510447+0000","last_became_active":"2024-09-16T01:00:26.746067+0000","last_became_peered":"2024-09-16T01:00:26.746067+0000","last_unstale":"2024-09-16T01:00:39.510447+0000","last_undegraded":"2024-09-16T01:00:39.510447+0000","last_fullsized":"2024-09-16T01:00:39.510447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:10.792354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445879+0000","last_change":"2024-09-16T01:00:28.446067+0000","last_active":"2024-09-16T01:00:29.445879+0000","last_peered":"2024-09-16T01:00:29.445879+0000","last_clean":"2024-09-16T01:00:29.445879+0000","last_became_active":"2024-09-16T01:00:28.445669+0000","last_became_peered":"2024-09-16T01:00:28.445669+0000","last_unstale":"2024-09-16T01:00:29.445879+0000","last_undegraded":"2024-09-16T01:00:29.445879+0000","last_fullsized":"2024-09-16T01:00:29.445879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:30.172271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:49.445144+0000","last_change":"2024-09-16T01:00:26.351033+0000","last_active":"2024-09-16T01:00:49.445144+0000","last_peered":"2024-09-16T01:00:49.445144+0000","last_clean":"2024-09-16T01:00:49.445144+0000","last_became_active":"2024-09-16T01:00:26.350670+0000","last_became_peered":"2024-09-16T01:00:26.350670+0000","last_unstale":"2024-09-16T01:00:49.445144+0000","last_undegraded":"2024-09-16T01:00:49.445144+0000","last_fullsized":"2024-09-16T01:00:49.445144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:23.634635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430572+0000","last_change":"2024-09-16T01:00:28.445229+0000","last_active":"2024-09-16T01:00:29.430572+0000","last_peered":"2024-09-16T01:00:29.430572+0000","last_clean":"2024-09-16T01:00:29.430572+0000","last_became_active":"2024-09-16T01:00:28.444794+0000","last_became_peered":"2024-09-16T01:00:28.444794+0000","last_unstale":"2024-09-16T01:00:29.430572+0000","last_undegraded":"2024-09-16T01:00:29.430572+0000","last_fullsized":"2024-09-16T01:00:29.430572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:05:34.117777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509104+0000","last_change":"2024-09-16T01:00:27.056718+0000","last_active":"2024-09-16T01:00:39.509104+0000","last_peered":"2024-09-16T01:00:39.509104+0000","last_clean":"2024-09-16T01:00:39.509104+0000","last_became_active":"2024-09-16T01:00:27.056331+0000","last_became_peered":"2024-09-16T01:00:27.056331+0000","last_unstale":"2024-09-16T01:00:39.509104+0000","last_undegraded":"2024-09-16T01:00:39.509104+0000","last_fullsized":"2024-09-16T01:00:39.509104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:47.094865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.453630+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.453272+0000","last_became_peered":"2024-09-16T01:00:28.453272+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:44.722743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484007+0000","last_change":"2024-09-16T01:00:26.745355+0000","last_active":"2024-09-16T01:00:36.484007+0000","last_peered":"2024-09-16T01:00:36.484007+0000","last_clean":"2024-09-16T01:00:36.484007+0000","last_became_active":"2024-09-16T01:00:26.745042+0000","last_became_peered":"2024-09-16T01:00:26.745042+0000","last_unstale":"2024-09-16T01:00:36.484007+0000","last_undegraded":"2024-09-16T01:00:36.484007+0000","last_fullsized":"2024-09-16T01:00:36.484007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:29.934482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446606+0000","last_change":"2024-09-16T01:00:28.441231+0000","last_active":"2024-09-16T01:00:29.446606+0000","last_peered":"2024-09-16T01:00:29.446606+0000","last_clean":"2024-09-16T01:00:29.446606+0000","last_became_active":"2024-09-16T01:00:28.440849+0000","last_became_peered":"2024-09-16T01:00:28.440849+0000","last_unstale":"2024-09-16T01:00:29.446606+0000","last_undegraded":"2024-09-16T01:00:29.446606+0000","last_fullsized":"2024-09-16T01:00:29.446606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:09.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508071+0000","last_change":"2024-09-16T01:00:26.357171+0000","last_active":"2024-09-16T01:00:39.508071+0000","last_peered":"2024-09-16T01:00:39.508071+0000","last_clean":"2024-09-16T01:00:39.508071+0000","last_became_active":"2024-09-16T01:00:26.356843+0000","last_became_peered":"2024-09-16T01:00:26.356843+0000","last_unstale":"2024-09-16T01:00:39.508071+0000","last_undegraded":"2024-09-16T01:00:39.508071+0000","last_fullsized":"2024-09-16T01:00:39.508071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:38.576314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450981+0000","last_change":"2024-09-16T01:00:28.450917+0000","last_active":"2024-09-16T01:00:29.450981+0000","last_peered":"2024-09-16T01:00:29.450981+0000","last_clean":"2024-09-16T01:00:29.450981+0000","last_became_active":"2024-09-16T01:00:28.448978+0000","last_became_peered":"2024-09-16T01:00:28.448978+0000","last_unstale":"2024-09-16T01:00:29.450981+0000","last_undegraded":"2024-09-16T01:00:29.450981+0000","last_fullsized":"2024-09-16T01:00:29.450981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:30.270617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502175+0000","last_change":"2024-09-16T01:00:26.360356+0000","last_active":"2024-09-16T01:00:38.502175+0000","last_peered":"2024-09-16T01:00:38.502175+0000","last_clean":"2024-09-16T01:00:38.502175+0000","last_became_active":"2024-09-16T01:00:26.359647+0000","last_became_peered":"2024-09-16T01:00:26.359647+0000","last_unstale":"2024-09-16T01:00:38.502175+0000","last_undegraded":"2024-09-16T01:00:38.502175+0000","last_fullsized":"2024-09-16T01:00:38.502175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:47.857659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430392+0000","last_change":"2024-09-16T01:00:28.444726+0000","last_active":"2024-09-16T01:00:29.430392+0000","last_peered":"2024-09-16T01:00:29.430392+0000","last_clean":"2024-09-16T01:00:29.430392+0000","last_became_active":"2024-09-16T01:00:28.444418+0000","last_became_peered":"2024-09-16T01:00:28.444418+0000","last_unstale":"2024-09-16T01:00:29.430392+0000","last_undegraded":"2024-09-16T01:00:29.430392+0000","last_fullsized":"2024-09-16T01:00:29.430392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484905+0000","last_change":"2024-09-16T01:00:26.357369+0000","last_active":"2024-09-16T01:00:36.484905+0000","last_peered":"2024-09-16T01:00:36.484905+0000","last_clean":"2024-09-16T01:00:36.484905+0000","last_became_active":"2024-09-16T01:00:26.356253+0000","last_became_peered":"2024-09-16T01:00:26.356253+0000","last_unstale":"2024-09-16T01:00:36.484905+0000","last_undegraded":"2024-09-16T01:00:36.484905+0000","last_fullsized":"2024-09-16T01:00:36.484905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:03.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446325+0000","last_change":"2024-09-16T01:00:28.446488+0000","last_active":"2024-09-16T01:00:29.446325+0000","last_peered":"2024-09-16T01:00:29.446325+0000","last_clean":"2024-09-16T01:00:29.446325+0000","last_became_active":"2024-09-16T01:00:28.446004+0000","last_became_peered":"2024-09-16T01:00:28.446004+0000","last_unstale":"2024-09-16T01:00:29.446325+0000","last_undegraded":"2024-09-16T01:00:29.446325+0000","last_fullsized":"2024-09-16T01:00:29.446325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.923219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434044+0000","last_change":"2024-09-16T01:00:28.455484+0000","last_active":"2024-09-16T01:00:29.434044+0000","last_peered":"2024-09-16T01:00:29.434044+0000","last_clean":"2024-09-16T01:00:29.434044+0000","last_became_active":"2024-09-16T01:00:28.455142+0000","last_became_peered":"2024-09-16T01:00:28.455142+0000","last_unstale":"2024-09-16T01:00:29.434044+0000","last_undegraded":"2024-09-16T01:00:29.434044+0000","last_fullsized":"2024-09-16T01:00:29.434044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:50:19.274265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509963+0000","last_change":"2024-09-16T01:00:26.354531+0000","last_active":"2024-09-16T01:00:39.509963+0000","last_peered":"2024-09-16T01:00:39.509963+0000","last_clean":"2024-09-16T01:00:39.509963+0000","last_became_active":"2024-09-16T01:00:26.354207+0000","last_became_peered":"2024-09-16T01:00:26.354207+0000","last_unstale":"2024-09-16T01:00:39.509963+0000","last_undegraded":"2024-09-16T01:00:39.509963+0000","last_fullsized":"2024-09-16T01:00:39.509963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:20.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431256+0000","last_change":"2024-09-16T01:00:28.439318+0000","last_active":"2024-09-16T01:00:29.431256+0000","last_peered":"2024-09-16T01:00:29.431256+0000","last_clean":"2024-09-16T01:00:29.431256+0000","last_became_active":"2024-09-16T01:00:28.437874+0000","last_became_peered":"2024-09-16T01:00:28.437874+0000","last_unstale":"2024-09-16T01:00:29.431256+0000","last_undegraded":"2024-09-16T01:00:29.431256+0000","last_fullsized":"2024-09-16T01:00:29.431256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:59.207551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.505737+0000","last_change":"2024-09-16T01:00:26.355952+0000","last_active":"2024-09-16T01:00:40.505737+0000","last_peered":"2024-09-16T01:00:40.505737+0000","last_clean":"2024-09-16T01:00:40.505737+0000","last_became_active":"2024-09-16T01:00:26.355600+0000","last_became_peered":"2024-09-16T01:00:26.355600+0000","last_unstale":"2024-09-16T01:00:40.505737+0000","last_undegraded":"2024-09-16T01:00:40.505737+0000","last_fullsized":"2024-09-16T01:00:40.505737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:29.294004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447285+0000","last_change":"2024-09-16T01:00:28.440130+0000","last_active":"2024-09-16T01:00:29.447285+0000","last_peered":"2024-09-16T01:00:29.447285+0000","last_clean":"2024-09-16T01:00:29.447285+0000","last_became_active":"2024-09-16T01:00:28.439805+0000","last_became_peered":"2024-09-16T01:00:28.439805+0000","last_unstale":"2024-09-16T01:00:29.447285+0000","last_undegraded":"2024-09-16T01:00:29.447285+0000","last_fullsized":"2024-09-16T01:00:29.447285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:38.977930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.841915+0000","last_change":"2024-09-16T01:00:26.745139+0000","last_active":"2024-09-16T01:00:29.841915+0000","last_peered":"2024-09-16T01:00:29.841915+0000","last_clean":"2024-09-16T01:00:29.841915+0000","last_became_active":"2024-09-16T01:00:26.744796+0000","last_became_peered":"2024-09-16T01:00:26.744796+0000","last_unstale":"2024-09-16T01:00:29.841915+0000","last_undegraded":"2024-09-16T01:00:29.841915+0000","last_fullsized":"2024-09-16T01:00:29.841915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:29.368451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430479+0000","last_change":"2024-09-16T01:00:28.449380+0000","last_active":"2024-09-16T01:00:29.430479+0000","last_peered":"2024-09-16T01:00:29.430479+0000","last_clean":"2024-09-16T01:00:29.430479+0000","last_became_active":"2024-09-16T01:00:28.448826+0000","last_became_peered":"2024-09-16T01:00:28.448826+0000","last_unstale":"2024-09-16T01:00:29.430479+0000","last_undegraded":"2024-09-16T01:00:29.430479+0000","last_fullsized":"2024-09-16T01:00:29.430479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:19.987506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:51.531094+0000","last_change":"2024-09-16T01:00:26.354148+0000","last_active":"2024-09-16T01:00:51.531094+0000","last_peered":"2024-09-16T01:00:51.531094+0000","last_clean":"2024-09-16T01:00:51.531094+0000","last_became_active":"2024-09-16T01:00:26.353477+0000","last_became_peered":"2024-09-16T01:00:26.353477+0000","last_unstale":"2024-09-16T01:00:51.531094+0000","last_undegraded":"2024-09-16T01:00:51.531094+0000","last_fullsized":"2024-09-16T01:00:51.531094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:44.715792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54796,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":156,"num_read_kb":139,"num_write":234,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":180692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215943,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":417671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":1055502,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":417586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":1010892,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1009784,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":416750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":473798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":473185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":418657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34623,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:00:56.494 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:00:56.494 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T01:00:56.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:56.882 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:56 smithi017 ceph-mon[31211]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-16T01:00:56.882 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:56 smithi017 ceph-mon[31211]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:56.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:56 smithi088 ceph-mon[34093]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-16T01:00:56.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:56 smithi088 ceph-mon[34093]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:56.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:56 smithi154 ceph-mon[34759]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-16T01:00:56.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:56 smithi154 ceph-mon[34759]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.246+0000 7f39d9128640 1 -- 172.21.15.17:0/2097159562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4102e00 msgr2=0x7f39d4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.246+0000 7f39d9128640 1 --2- 172.21.15.17:0/2097159562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4102e00 0x7f39d4103280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009900 tx=0x7f39bc02a410 comp rx=0 tx=0).stop 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 -- 172.21.15.17:0/2097159562 shutdown_connections 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 --2- 172.21.15.17:0/2097159562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 --2- 172.21.15.17:0/2097159562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4102e00 0x7f39d4103280 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 --2- 172.21.15.17:0/2097159562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4101c00 0x7f39d4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 -- 172.21.15.17:0/2097159562 >> 172.21.15.17:0/2097159562 conn(0x7f39d40fd390 msgr2=0x7f39d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 -- 172.21.15.17:0/2097159562 shutdown_connections 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 -- 172.21.15.17:0/2097159562 wait complete. 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 Processor -- start 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 -- start start 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.247+0000 7f39d9128640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4102e00 0x7f39d4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410d730 con 0x7f39d4101c00 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410d5b0 con 0x7f39d41037c0 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410d8b0 con 0x7f39d4102e00 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37140/0 (socket says 172.21.15.17:37140) 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 -- 172.21.15.17:0/3866573284 learned_addr learned my addr 172.21.15.17:0/3866573284 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d359e640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 -- 172.21.15.17:0/3866573284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4102e00 msgr2=0x7f39d4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39cbfff640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4102e00 0x7f39d4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4102e00 0x7f39d4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 -- 172.21.15.17:0/3866573284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 msgr2=0x7f39d419f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d419f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 -- 172.21.15.17:0/3866573284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d419fa50 con 0x7f39d4101c00 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d359e640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d2d9d640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c970 tx=0x7f39c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4004220 con 0x7f39d4101c00 2024-09-16T01:00:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d419fd40 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39c40043c0 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4004a00 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.248+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d41a0170 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.249+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d41090a0 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.250+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f39c40079b0 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.251+0000 7f39d0d99640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 0x7f39c00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.251+0000 7f39cbfff640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 0x7f39c00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.251+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f39c40cf7d0 con 0x7f39d4101c00 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.252+0000 7f39cbfff640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 0x7f39c00a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39bc02a930 tx=0x7f39bc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:57.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.255+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c4014030 con 0x7f39d4101c00 2024-09-16T01:00:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.496+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f39d402d7c0 con 0x7f39d4101c00 2024-09-16T01:00:57.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.499+0000 7f39d0d99640 1 -- 172.21.15.17:0/3866573284 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f39c409c440 con 0x7f39d4101c00 2024-09-16T01:00:57.500 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-16T01:00:57.500 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBJg+dm1We3HRAARVVRvaoOgGMRcgKPoUEveA== 2024-09-16T01:00:57.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 msgr2=0x7f39c00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 0x7f39c00a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f39bc02a930 tx=0x7f39bc000bc0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 msgr2=0x7f39d4197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c970 tx=0x7f39c400ce30 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 shutdown_connections 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f39c00a3300 0x7f39c00a57c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39d41037c0 0x7f39d419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d4102e00 0x7f39d4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 --2- 172.21.15.17:0/3866573284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39d4101c00 0x7f39d4197e20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 >> 172.21.15.17:0/3866573284 conn(0x7f39d40fd390 msgr2=0x7f39d4106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 shutdown_connections 2024-09-16T01:00:57.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:57.501+0000 7f39d9128640 1 -- 172.21.15.17:0/3866573284 wait complete. 2024-09-16T01:00:57.811 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:00:57.811 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:00:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:57 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:00:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:57 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:00:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:57 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:00:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:57 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3866573284' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:00:58.264 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T01:00:58.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T01:00:58.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T01:00:58.305 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T01:00:58.306 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T01:00:58.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T01:00:58.605 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:00:58.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:58 smithi017 ceph-mon[31211]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-16T01:00:58.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:58 smithi088 ceph-mon[34093]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-16T01:00:58.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:58 smithi154 ceph-mon[34759]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 -- 172.21.15.17:0/325934400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41601082a0 msgr2=0x7f416010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 --2- 172.21.15.17:0/325934400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41601082a0 0x7f416010ec40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4158009cd0 tx=0x7f415802a8e0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 -- 172.21.15.17:0/325934400 shutdown_connections 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 --2- 172.21.15.17:0/325934400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41601082a0 0x7f416010ec40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 --2- 172.21.15.17:0/325934400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 0x7f4160107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 --2- 172.21.15.17:0/325934400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4160102d30 0x7f4160103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 -- 172.21.15.17:0/325934400 >> 172.21.15.17:0/325934400 conn(0x7f41600fc7d0 msgr2=0x7f41600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 -- 172.21.15.17:0/325934400 shutdown_connections 2024-09-16T01:00:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 -- 172.21.15.17:0/325934400 wait complete. 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.126+0000 7f4166192640 1 Processor -- start 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 -- start start 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 0x7f4160100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41601082a0 0x7f4160101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4160111fa0 con 0x7f4160102d30 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4160111e20 con 0x7f41601036e0 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f4166192640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4160112120 con 0x7f41601082a0 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37156/0 (socket says 172.21.15.17:37156) 2024-09-16T01:00:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 -- 172.21.15.17:0/1081420482 learned_addr learned my addr 172.21.15.17:0/1081420482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415ffff640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41601082a0 0x7f4160101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415effd640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 0x7f4160100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 -- 172.21.15.17:0/1081420482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41601082a0 msgr2=0x7f4160101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41601082a0 0x7f4160101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 -- 172.21.15.17:0/1081420482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 msgr2=0x7f4160100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 0x7f4160100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 -- 172.21.15.17:0/1081420482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41601a6900 con 0x7f4160102d30 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.127+0000 7f415f7fe640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f415000d770 tx=0x7f415000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.128+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150017070 con 0x7f4160102d30 2024-09-16T01:00:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.128+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41500054d0 con 0x7f4160102d30 2024-09-16T01:00:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.128+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41601a6bf0 con 0x7f4160102d30 2024-09-16T01:00:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.128+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150004cf0 con 0x7f4160102d30 2024-09-16T01:00:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.128+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601a7130 con 0x7f4160102d30 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.130+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4160103110 con 0x7f4160102d30 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.130+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4150004e90 con 0x7f4160102d30 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.131+0000 7f415cff9640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 0x7f41480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.131+0000 7f415effd640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 0x7f41480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.131+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f41500cf390 con 0x7f4160102d30 2024-09-16T01:00:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.132+0000 7f415effd640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 0x7f41480a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4160102420 tx=0x7f415400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:00:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.135+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f415009c100 con 0x7f4160102d30 2024-09-16T01:00:59.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.356+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f416010a2b0 con 0x7f4160102d30 2024-09-16T01:00:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.361+0000 7f415cff9640 1 -- 172.21.15.17:0/1081420482 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264047 (secure 0 0 0) 0x7f415009ba00 con 0x7f4160102d30 2024-09-16T01:00:59.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:00:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 msgr2=0x7f41480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 0x7f41480a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4160102420 tx=0x7f415400c4a0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 msgr2=0x7f4160100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f415000d770 tx=0x7f415000dc30 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 shutdown_connections 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f41480a3350 0x7f41480a5810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41601082a0 0x7f4160101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41601036e0 0x7f4160100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 --2- 172.21.15.17:0/1081420482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4160102d30 0x7f4160100990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 >> 172.21.15.17:0/1081420482 conn(0x7f41600fc7d0 msgr2=0x7f4160106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 shutdown_connections 2024-09-16T01:00:59.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:00:59.364+0000 7f4166192640 1 -- 172.21.15.17:0/1081420482 wait complete. 2024-09-16T01:00:59.725 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:00:59 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1081420482' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:00:59.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:00:59 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1081420482' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:00:59.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:00:59 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1081420482' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:01:00.157 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":333607551},{"type":"v1","addr":"172.21.15.17:6801","nonce":333607551}]},"active_addr":"172.21.15.17:6801/333607551","active_change":"2024-09-16T00:53:32.835507+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3103598954}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1301615150}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":4120022701}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1167321081}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2928152864}]}]} 2024-09-16T01:01:00.163 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T01:01:00.163 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T01:01:00.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:01:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:00 smithi017 ceph-mon[31211]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-16T01:01:00.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:00 smithi088 ceph-mon[34093]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-16T01:01:00.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:00 smithi154 ceph-mon[34759]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-09-16T01:01:00.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 -- 172.21.15.17:0/1948681545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 msgr2=0x7f0220100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 --2- 172.21.15.17:0/1948681545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220100ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0208009930 tx=0x7f020802a420 comp rx=0 tx=0).stop 2024-09-16T01:01:00.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 -- 172.21.15.17:0/1948681545 shutdown_connections 2024-09-16T01:01:00.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 --2- 172.21.15.17:0/1948681545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220101420 0x7f022010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 --2- 172.21.15.17:0/1948681545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220100ee0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 --2- 172.21.15.17:0/1948681545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220106a80 0x7f0220106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 -- 172.21.15.17:0/1948681545 >> 172.21.15.17:0/1948681545 conn(0x7f02200fc7a0 msgr2=0x7f02200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 -- 172.21.15.17:0/1948681545 shutdown_connections 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.968+0000 7f0224c83640 1 -- 172.21.15.17:0/1948681545 wait complete. 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 Processor -- start 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 -- start start 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220101420 0x7f02201988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220106a80 0x7f022019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0220110d50 con 0x7f0220100a80 2024-09-16T01:01:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0220110bd0 con 0x7f0220106a80 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0224c83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0220110ed0 con 0x7f0220101420 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56366/0 (socket says 172.21.15.17:56366) 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 -- 172.21.15.17:0/759310710 learned_addr learned my addr 172.21.15.17:0/759310710 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f0217fff640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220101420 0x7f02201988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021ed9d640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220106a80 0x7f022019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 -- 172.21.15.17:0/759310710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220101420 msgr2=0x7f02201988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220101420 0x7f02201988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 -- 172.21.15.17:0/759310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220106a80 msgr2=0x7f022019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220106a80 0x7f022019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.969+0000 7f021e59c640 1 -- 172.21.15.17:0/759310710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022019d330 con 0x7f0220100a80 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f021e59c640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f021000b4a0 tx=0x7f021000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210014070 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0210010ac0 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022019d620 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210017c30 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.970+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02201a4f00 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.971+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0220100ee0 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.972+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0210017070 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.973+0000 7f02177fe640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 0x7f020c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.973+0000 7f0217fff640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 0x7f020c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.973+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f02100cee60 con 0x7f0220100a80 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.973+0000 7f0217fff640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 0x7f020c0a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0208006010 tx=0x7f0208000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:00.977+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f021009b590 con 0x7f0220100a80 2024-09-16T01:01:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.156+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02201a51e0 con 0x7f0220100a80 2024-09-16T01:01:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.157+0000 7f02177fe640 1 -- 172.21.15.17:0/759310710 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22205 (secure 0 0 0) 0x7f021009f890 con 0x7f0220100a80 2024-09-16T01:01:01.159 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:01.159 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:00:29.073282+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 msgr2=0x7f020c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 0x7f020c0a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0208006010 tx=0x7f0208000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 msgr2=0x7f0220198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f021000b4a0 tx=0x7f021000b960 comp rx=0 tx=0).stop 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 shutdown_connections 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f020c0a3350 0x7f020c0a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0220106a80 0x7f022019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0220101420 0x7f02201988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 --2- 172.21.15.17:0/759310710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0220100a80 0x7f0220198380 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 >> 172.21.15.17:0/759310710 conn(0x7f02200fc7a0 msgr2=0x7f0220104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 shutdown_connections 2024-09-16T01:01:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:01.160+0000 7f0224c83640 1 -- 172.21.15.17:0/759310710 wait complete. 2024-09-16T01:01:01.827 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:01 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/759310710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:01 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/759310710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:01.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:01 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/759310710' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:02.034 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T01:01:02.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:01:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:02.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:02 smithi017 ceph-mon[31211]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 -- 172.21.15.17:0/3138463115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290100e20 msgr2=0x7f9290101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 --2- 172.21.15.17:0/3138463115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290100e20 0x7f9290101200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9280009ca0 tx=0x7f928002a950 comp rx=0 tx=0).stop 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 -- 172.21.15.17:0/3138463115 shutdown_connections 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 --2- 172.21.15.17:0/3138463115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102ef0 0x7f929010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 --2- 172.21.15.17:0/3138463115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290102570 0x7f92901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 --2- 172.21.15.17:0/3138463115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290100e20 0x7f9290101200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 -- 172.21.15.17:0/3138463115 >> 172.21.15.17:0/3138463115 conn(0x7f92900fc7d0 msgr2=0x7f92900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 -- 172.21.15.17:0/3138463115 shutdown_connections 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 -- 172.21.15.17:0/3138463115 wait complete. 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.795+0000 7f92961c2640 1 Processor -- start 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 -- start start 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 0x7f92901992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102570 0x7f9290199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9290110e50 con 0x7f9290102ef0 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9290110cd0 con 0x7f9290100e20 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f92961c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9290110fd0 con 0x7f9290102570 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56384/0 (socket says 172.21.15.17:56384) 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 -- 172.21.15.17:0/4166089621 learned_addr learned my addr 172.21.15.17:0/4166089621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928effd640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102570 0x7f9290199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928f7fe640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 0x7f92901992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 -- 172.21.15.17:0/4166089621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102570 msgr2=0x7f9290199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102570 0x7f9290199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 -- 172.21.15.17:0/4166089621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 msgr2=0x7f92901992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 0x7f92901992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928ffff640 1 -- 172.21.15.17:0/4166089621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92901a4890 con 0x7f9290102ef0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.796+0000 7f928f7fe640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 0x7f92901992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f928ffff640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9288009fd0 tx=0x7f928800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288011830 con 0x7f9290102ef0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9288016070 con 0x7f9290102ef0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92901a4a60 con 0x7f9290102ef0 2024-09-16T01:01:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288010de0 con 0x7f9290102ef0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.797+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901a4f20 con 0x7f9290102ef0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.798+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9290101200 con 0x7f9290102ef0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.799+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f92880119d0 con 0x7f9290102ef0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.800+0000 7f928cff9640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 0x7f927c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.800+0000 7f928f7fe640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 0x7f927c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.800+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f92880cf630 con 0x7f9290102ef0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.800+0000 7f928f7fe640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 0x7f927c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9280009a60 tx=0x7f9280005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.803+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f928809c3b0 con 0x7f9290102ef0 2024-09-16T01:01:02.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:02 smithi088 ceph-mon[34093]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-16T01:01:02.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:02 smithi154 ceph-mon[34759]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-16T01:01:02.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.980+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f929006a560 con 0x7f9290102ef0 2024-09-16T01:01:02.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.982+0000 7f928cff9640 1 -- 172.21.15.17:0/4166089621 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22205 (secure 0 0 0) 0x7f929006a560 con 0x7f9290102ef0 2024-09-16T01:01:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:02.983 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:00:29.073282+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:02.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 msgr2=0x7f927c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:02.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 0x7f927c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9280009a60 tx=0x7f9280005c30 comp rx=0 tx=0).stop 2024-09-16T01:01:02.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 msgr2=0x7f92901a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:02.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9288009fd0 tx=0x7f928800b8e0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 shutdown_connections 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f927c0a32d0 0x7f927c0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9290102ef0 0x7f92901a4350 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9290102570 0x7f9290199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 --2- 172.21.15.17:0/4166089621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9290100e20 0x7f92901992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 >> 172.21.15.17:0/4166089621 conn(0x7f92900fc7d0 msgr2=0x7f92900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 shutdown_connections 2024-09-16T01:01:02.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:02.984+0000 7f92961c2640 1 -- 172.21.15.17:0/4166089621 wait complete. 2024-09-16T01:01:03.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T01:01:03.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T01:01:03.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T01:01:03.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T01:01:03.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T01:01:03.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T01:01:03.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-16T01:01:03.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-16T01:01:03.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-16T01:01:03.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-16T01:01:03.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-16T01:01:03.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-16T01:01:03.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:03 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4166089621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:03 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4166089621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:03 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4166089621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:04.356 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:04.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:04 smithi088 ceph-mon[34093]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-16T01:01:04.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:04 smithi154 ceph-mon[34759]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-16T01:01:04.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:04 smithi017 ceph-mon[31211]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 -- 172.21.15.17:0/3064526946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988100a80 msgr2=0x7ff988100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 --2- 172.21.15.17:0/3064526946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988100a80 0x7ff988100ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009930 tx=0x7ff97c02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 -- 172.21.15.17:0/3064526946 shutdown_connections 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 --2- 172.21.15.17:0/3064526946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff988101420 0x7ff98810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 --2- 172.21.15.17:0/3064526946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988100a80 0x7ff988100ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 --2- 172.21.15.17:0/3064526946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 0x7ff988106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 -- 172.21.15.17:0/3064526946 >> 172.21.15.17:0/3064526946 conn(0x7ff9880fc7a0 msgr2=0x7ff9880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 -- 172.21.15.17:0/3064526946 shutdown_connections 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.015+0000 7ff98d81a640 1 -- 172.21.15.17:0/3064526946 wait complete. 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 Processor -- start 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 -- start start 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff988100a80 0x7ff988198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 0x7ff9881988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 0x7ff98819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff988110d80 con 0x7ff988101420 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff988110c00 con 0x7ff988106a80 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.016+0000 7ff98d81a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff988110f00 con 0x7ff988100a80 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 0x7ff9881988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 0x7ff9881988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56398/0 (socket says 172.21.15.17:56398) 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 -- 172.21.15.17:0/158079204 learned_addr learned my addr 172.21.15.17:0/158079204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:05.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff986ffd640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff988100a80 0x7ff988198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9877fe640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 0x7ff98819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 -- 172.21.15.17:0/158079204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff988100a80 msgr2=0x7ff988198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff988100a80 0x7ff988198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 -- 172.21.15.17:0/158079204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 msgr2=0x7ff98819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 0x7ff98819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98819d320 con 0x7ff988101420 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9877fe640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff988106a80 0x7ff98819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff9867fc640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 0x7ff9881988b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff97c005ab0 tx=0x7ff97c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c03f070 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff97c031d60 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98819d5b0 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c035030 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.017+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9881a4ef0 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.018+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff988062980 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.020+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff97c042070 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.020+0000 7ff98c818640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff9700a3350 0x7ff9700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.020+0000 7ff986ffd640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff9700a3350 0x7ff9700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.020+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff97c0f06c0 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff98c818640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] conn(0x7ff9700acba0 0x7ff9700aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff97c038e90 con 0x7ff9700acba0 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff97c0f0ba0 con 0x7ff988101420 2024-09-16T01:01:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff9877fe640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] conn(0x7ff9700acba0 0x7ff9700aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff986ffd640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff9700a3350 0x7ff9700a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff978005d00 tx=0x7ff97800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.021+0000 7ff9877fe640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] conn(0x7ff9700acba0 0x7ff9700aefc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.022+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== osd.6 v2:172.21.15.17:6818/2722817993 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff97c038e90 con 0x7ff9700acba0 2024-09-16T01:01:05.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 --> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff988062d80 con 0x7ff9700acba0 2024-09-16T01:01:05.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98c818640 1 -- 172.21.15.17:0/158079204 <== osd.6 v2:172.21.15.17:6818/2722817993 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff988062d80 con 0x7ff9700acba0 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] conn(0x7ff9700acba0 msgr2=0x7ff9700aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] conn(0x7ff9700acba0 0x7ff9700aefc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff9700a3350 msgr2=0x7ff9700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff9700a3350 0x7ff9700a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff978005d00 tx=0x7ff97800b410 comp rx=0 tx=0).stop 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 msgr2=0x7ff9881988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 --2- 172.21.15.17:0/158079204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff988101420 0x7ff9881988b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff97c005ab0 tx=0x7ff97c003cd0 comp rx=0 tx=0).stop 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff9877fe640 1 -- 172.21.15.17:0/158079204 reap_dead start 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 shutdown_connections 2024-09-16T01:01:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.036+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 >> 172.21.15.17:0/158079204 conn(0x7ff9880fc7a0 msgr2=0x7ff98806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.037+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 shutdown_connections 2024-09-16T01:01:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:05.037+0000 7ff98d81a640 1 -- 172.21.15.17:0/158079204 wait complete. 2024-09-16T01:01:05.856 INFO:teuthology.orchestra.run.smithi017.stdout:184683593774 2024-09-16T01:01:05.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-16T01:01:05.919 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.945 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.945 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.947 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.952 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:06.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:06 smithi017 ceph-mon[31211]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-16T01:01:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 -- 172.21.15.17:0/1556850540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714106f10 msgr2=0x7f571410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 --2- 172.21.15.17:0/1556850540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714106f10 0x7f571410ea90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f570c009ca0 tx=0x7f570c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 -- 172.21.15.17:0/1556850540 shutdown_connections 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 --2- 172.21.15.17:0/1556850540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714106f10 0x7f571410ea90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 --2- 172.21.15.17:0/1556850540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 0x7f57141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 --2- 172.21.15.17:0/1556850540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5714101de0 0x7f57141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 -- 172.21.15.17:0/1556850540 >> 172.21.15.17:0/1556850540 conn(0x7f57140fd8c0 msgr2=0x7f57140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 -- 172.21.15.17:0/1556850540 shutdown_connections 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.797+0000 7f571ac59640 1 -- 172.21.15.17:0/1556850540 wait complete. 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 Processor -- start 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 -- start start 2024-09-16T01:01:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5714111e20 con 0x7f5714101de0 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5714111ca0 con 0x7f5714106f10 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f571ac59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5714111fa0 con 0x7f5714102790 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f57189f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f57189f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 0x7f57140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56428/0 (socket says 172.21.15.17:56428) 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f57189f5640 1 -- 172.21.15.17:0/2808343731 learned_addr learned my addr 172.21.15.17:0/2808343731 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f5713fff640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.798+0000 7f57191f6640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 -- 172.21.15.17:0/2808343731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 msgr2=0x7f5714074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 -- 172.21.15.17:0/2808343731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5714106f10 msgr2=0x7f5714074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5714106f10 0x7f5714074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57141a67e0 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f5713fff640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5714102790 0x7f5714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f57189f5640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 0x7f57140744f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f570800d950 tx=0x7f570800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708017070 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5708009c30 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57141a6ad0 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570800f620 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.799+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57141a7060 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.800+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57140628c0 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f57080109a0 con 0x7f5714101de0 2024-09-16T01:01:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f57040a3350 0x7f57040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5713fff640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f57040a3350 0x7f57040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f57080cf940 con 0x7f5714101de0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] conn(0x7f57040acba0 0x7f57040aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5708001d30 con 0x7f57040acba0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.802+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f57080cfe20 con 0x7f5714101de0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.803+0000 7f57191f6640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] conn(0x7f57040acba0 0x7f57040aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.803+0000 7f5713fff640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f57040a3350 0x7f57040a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5700005fd0 tx=0x7f570000b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.803+0000 7f57191f6640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] conn(0x7f57040acba0 0x7f57040aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.804+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== osd.9 v2:172.21.15.17:6826/2711605096 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5708001d30 con 0x7f57040acba0 2024-09-16T01:01:06.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.817+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 --> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5714062cc0 con 0x7f57040acba0 2024-09-16T01:01:06.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f5711ffb640 1 -- 172.21.15.17:0/2808343731 <== osd.9 v2:172.21.15.17:6826/2711605096 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5714062cc0 con 0x7f57040acba0 2024-09-16T01:01:06.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] conn(0x7f57040acba0 msgr2=0x7f57040aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] conn(0x7f57040acba0 0x7f57040aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f57040a3350 msgr2=0x7f57040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f57040a3350 0x7f57040a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5700005fd0 tx=0x7f570000b5d0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 msgr2=0x7f57140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 --2- 172.21.15.17:0/2808343731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5714101de0 0x7f57140744f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f570800d950 tx=0x7f570800de10 comp rx=0 tx=0).stop 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f57191f6640 1 -- 172.21.15.17:0/2808343731 reap_dead start 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 shutdown_connections 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 >> 172.21.15.17:0/2808343731 conn(0x7f57140fd8c0 msgr2=0x7f57140feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 shutdown_connections 2024-09-16T01:01:06.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:06.818+0000 7f571ac59640 1 -- 172.21.15.17:0/2808343731 wait complete. 2024-09-16T01:01:06.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:06 smithi088 ceph-mon[34093]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-16T01:01:06.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:06 smithi154 ceph-mon[34759]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-16T01:01:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 -- 172.21.15.17:0/2205684290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c101410 msgr2=0x7f932c10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2205684290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c101410 0x7f932c10d940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9324009cd0 tx=0x7f932402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 -- 172.21.15.17:0/2205684290 shutdown_connections 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2205684290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c101410 0x7f932c10d940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2205684290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f932c100a70 0x7f932c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2205684290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c106a70 0x7f932c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 -- 172.21.15.17:0/2205684290 >> 172.21.15.17:0/2205684290 conn(0x7f932c0fc790 msgr2=0x7f932c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 -- 172.21.15.17:0/2205684290 shutdown_connections 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 -- 172.21.15.17:0/2205684290 wait complete. 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.555+0000 7f9332b5b640 1 Processor -- start 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 -- start start 2024-09-16T01:01:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f932c100a70 0x7f932c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101410 0x7f932c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 0x7f932c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f932c110d20 con 0x7f932c106a70 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f932c110ba0 con 0x7f932c100a70 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f9332b5b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f932c110ea0 con 0x7f932c101410 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 0x7f932c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 0x7f932c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56458/0 (socket says 172.21.15.17:56458) 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 -- 172.21.15.17:0/2350984496 learned_addr learned my addr 172.21.15.17:0/2350984496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f932bfff640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101410 0x7f932c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93308f7640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f932c100a70 0x7f932c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 -- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101410 msgr2=0x7f932c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932c101410 0x7f932c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 -- 172.21.15.17:0/2350984496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f932c100a70 msgr2=0x7f932c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f932c100a70 0x7f932c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932c19d310 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.556+0000 7f93310f8640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 0x7f932c19cc30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9324033040 tx=0x7f9324009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.557+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324004040 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.557+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9324004690 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.557+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324030da0 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.557+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932c19d5a0 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.557+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932c1a4ee0 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.558+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f932c062980 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.559+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f93240041e0 con 0x7f932c106a70 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f9329ffb640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f931c0a32d0 0x7f931c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f93308f7640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f931c0a32d0 0x7f931c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f932402e030 con 0x7f932c106a70 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f9329ffb640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] conn(0x7f931c0acb20 0x7f931c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9324030690 con 0x7f931c0acb20 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f93240f10e0 con 0x7f932c106a70 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f93308f7640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f931c0a32d0 0x7f931c0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9320009ae0 tx=0x7f9320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.560+0000 7f932bfff640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] conn(0x7f931c0acb20 0x7f931c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.561+0000 7f932bfff640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] conn(0x7f931c0acb20 0x7f931c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.562+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== osd.8 v2:172.21.15.154:6816/307626373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9324030690 con 0x7f931c0acb20 2024-09-16T01:01:07.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.578+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 --> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f932c062e00 con 0x7f931c0acb20 2024-09-16T01:01:07.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.578+0000 7f9329ffb640 1 -- 172.21.15.17:0/2350984496 <== osd.8 v2:172.21.15.154:6816/307626373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f932c062e00 con 0x7f931c0acb20 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] conn(0x7f931c0acb20 msgr2=0x7f931c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] conn(0x7f931c0acb20 0x7f931c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f931c0a32d0 msgr2=0x7f931c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f931c0a32d0 0x7f931c0a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9320009ae0 tx=0x7f9320005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 msgr2=0x7f932c19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 --2- 172.21.15.17:0/2350984496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f932c106a70 0x7f932c19cc30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9324033040 tx=0x7f9324009360 comp rx=0 tx=0).stop 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f93310f8640 1 -- 172.21.15.17:0/2350984496 reap_dead start 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 shutdown_connections 2024-09-16T01:01:07.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 >> 172.21.15.17:0/2350984496 conn(0x7f932c0fc790 msgr2=0x7f932c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 shutdown_connections 2024-09-16T01:01:07.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:07.579+0000 7f9332b5b640 1 -- 172.21.15.17:0/2350984496 wait complete. 2024-09-16T01:01:08.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- 172.21.15.17:0/3379565600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 msgr2=0x7f69a410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/3379565600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a410ec30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f699c009cd0 tx=0x7f699c02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- 172.21.15.17:0/3379565600 shutdown_connections 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/3379565600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a410ec30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/3379565600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a4103740 0x7f69a4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/3379565600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4102d90 0x7f69a4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- 172.21.15.17:0/3379565600 >> 172.21.15.17:0/3379565600 conn(0x7f69a40fc7d0 msgr2=0x7f69a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- 172.21.15.17:0/3379565600 shutdown_connections 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- 172.21.15.17:0/3379565600 wait complete. 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 Processor -- start 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.253+0000 7f69aa2bb640 1 -- start start 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4102d90 0x7f69a4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a4103740 0x7f69a41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69a4111f70 con 0x7f69a4108290 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69a4111df0 con 0x7f69a4103740 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69aa2bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69a41120f0 con 0x7f69a4102d90 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56482/0 (socket says 172.21.15.17:56482) 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 -- 172.21.15.17:0/2195604921 learned_addr learned my addr 172.21.15.17:0/2195604921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f699bfff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a4103740 0x7f69a41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a3fff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4102d90 0x7f69a4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 -- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4102d90 msgr2=0x7f69a4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a4102d90 0x7f69a4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 -- 172.21.15.17:0/2195604921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a4103740 msgr2=0x7f69a41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69a4103740 0x7f69a41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a419d410 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.254+0000 7f69a8858640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a419cd30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f699c005e30 tx=0x7f699c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.255+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c004240 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.255+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f699c031d00 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.255+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c030e30 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.255+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a419d6a0 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.255+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a41a4fe0 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.256+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69a4062980 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.257+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f699c0043e0 con 0x7f69a4108290 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.257+0000 7f69a1ffb640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f69900a3350 0x7f69900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a3fff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f69900a3350 0x7f69900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f699c02e030 con 0x7f69a4108290 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a1ffb640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] conn(0x7f69900acba0 0x7f69900aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69900af670 con 0x7f69900acba0 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f699c0f52c0 con 0x7f69a4108290 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f69a3fff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f69900a3350 0x7f69900a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6994005fd0 tx=0x7f6994005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.258+0000 7f699bfff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] conn(0x7f69900acba0 0x7f69900aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.259+0000 7f699bfff640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] conn(0x7f69900acba0 0x7f69900aefc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.259+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== osd.5 v2:172.21.15.154:6808/995559400 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69900af670 con 0x7f69900acba0 2024-09-16T01:01:08.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.274+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 --> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69a4062d80 con 0x7f69900acba0 2024-09-16T01:01:08.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.274+0000 7f69a1ffb640 1 -- 172.21.15.17:0/2195604921 <== osd.5 v2:172.21.15.154:6808/995559400 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f69a4062d80 con 0x7f69900acba0 2024-09-16T01:01:08.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] conn(0x7f69900acba0 msgr2=0x7f69900aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] conn(0x7f69900acba0 0x7f69900aefc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f69900a3350 msgr2=0x7f69900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f69900a3350 0x7f69900a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6994005fd0 tx=0x7f6994005e20 comp rx=0 tx=0).stop 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 msgr2=0x7f69a419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 --2- 172.21.15.17:0/2195604921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4108290 0x7f69a419cd30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f699c005e30 tx=0x7f699c003ba0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69a8858640 1 -- 172.21.15.17:0/2195604921 reap_dead start 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 shutdown_connections 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 >> 172.21.15.17:0/2195604921 conn(0x7f69a40fc7d0 msgr2=0x7f69a4105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 shutdown_connections 2024-09-16T01:01:08.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.275+0000 7f69aa2bb640 1 -- 172.21.15.17:0/2195604921 wait complete. 2024-09-16T01:01:08.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:08 smithi017 ceph-mon[31211]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-16T01:01:08.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:08 smithi088 ceph-mon[34093]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-16T01:01:08.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:08 smithi154 ceph-mon[34759]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 -- 172.21.15.17:0/1868112884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 msgr2=0x7f23e0107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 --2- 172.21.15.17:0/1868112884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e0107010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009900 tx=0x7f23d802a3f0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 -- 172.21.15.17:0/1868112884 shutdown_connections 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 --2- 172.21.15.17:0/1868112884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e0101b40 0x7f23e010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 --2- 172.21.15.17:0/1868112884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e01011a0 0x7f23e0101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 --2- 172.21.15.17:0/1868112884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e0107010 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 -- 172.21.15.17:0/1868112884 >> 172.21.15.17:0/1868112884 conn(0x7f23e0077210 msgr2=0x7f23e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 -- 172.21.15.17:0/1868112884 shutdown_connections 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.926+0000 7f23e7d30640 1 -- 172.21.15.17:0/1868112884 wait complete. 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 Processor -- start 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 -- start start 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e01011a0 0x7f23e00fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e0101b40 0x7f23e00fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e00fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0110e20 con 0x7f23e0106c30 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0110ca0 con 0x7f23e01011a0 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e7d30640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0110fa0 con 0x7f23e0101b40 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e62cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e00fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e62cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e00fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56488/0 (socket says 172.21.15.17:56488) 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e62cd640 1 -- 172.21.15.17:0/215397099 learned_addr learned my addr 172.21.15.17:0/215397099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.927+0000 7f23e52cb640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e0101b40 0x7f23e00fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e5acc640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e01011a0 0x7f23e00fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 -- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e0101b40 msgr2=0x7f23e00fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23e0101b40 0x7f23e00fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 -- 172.21.15.17:0/215397099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e01011a0 msgr2=0x7f23e00fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e01011a0 0x7f23e00fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01a6890 con 0x7f23e0106c30 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e5acc640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e01011a0 0x7f23e00fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e62cd640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e00fd110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c970 tx=0x7f23d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0007bb0 con 0x7f23e0106c30 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d0007d50 con 0x7f23e0106c30 2024-09-16T01:01:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01a6b80 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0018700 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.928+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01a7070 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.929+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23e0100b70 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.930+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f23d000fa20 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23deffd640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f23c80a32d0 0x7f23c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23e5acc640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f23c80a32d0 0x7f23c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f23d00cfbe0 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23deffd640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] conn(0x7f23c80acb20 0x7f23c80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23c80af5f0 con 0x7f23c80acb20 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.931+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f23d00d00c0 con 0x7f23e0106c30 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.932+0000 7f23e5acc640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f23c80a32d0 0x7f23c80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23d8031440 tx=0x7f23d80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.932+0000 7f23e52cb640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] conn(0x7f23c80acb20 0x7f23c80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.932+0000 7f23e52cb640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] conn(0x7f23c80acb20 0x7f23c80aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.933+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== osd.2 v2:172.21.15.154:6800/634195580 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23c80af5f0 con 0x7f23c80acb20 2024-09-16T01:01:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.947+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 --> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23e01023c0 con 0x7f23c80acb20 2024-09-16T01:01:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.947+0000 7f23deffd640 1 -- 172.21.15.17:0/215397099 <== osd.2 v2:172.21.15.154:6800/634195580 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f23e01023c0 con 0x7f23c80acb20 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] conn(0x7f23c80acb20 msgr2=0x7f23c80aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] conn(0x7f23c80acb20 0x7f23c80aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f23c80a32d0 msgr2=0x7f23c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f23c80a32d0 0x7f23c80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23d8031440 tx=0x7f23d80095f0 comp rx=0 tx=0).stop 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 msgr2=0x7f23e00fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 --2- 172.21.15.17:0/215397099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0106c30 0x7f23e00fd110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c970 tx=0x7f23d000ce30 comp rx=0 tx=0).stop 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e62cd640 1 -- 172.21.15.17:0/215397099 reap_dead start 2024-09-16T01:01:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 shutdown_connections 2024-09-16T01:01:08.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 >> 172.21.15.17:0/215397099 conn(0x7f23e0077210 msgr2=0x7f23e01001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:08.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 shutdown_connections 2024-09-16T01:01:08.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:08.948+0000 7f23e7d30640 1 -- 172.21.15.17:0/215397099 wait complete. 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- 172.21.15.17:0/2796783332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4290102d40 msgr2=0x7f4290103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 --2- 172.21.15.17:0/2796783332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4290102d40 0x7f4290103120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f428c009900 tx=0x7f428c02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- 172.21.15.17:0/2796783332 shutdown_connections 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 --2- 172.21.15.17:0/2796783332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f429010c170 0x7f429010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 --2- 172.21.15.17:0/2796783332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290103660 0x7f429010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 --2- 172.21.15.17:0/2796783332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4290102d40 0x7f4290103120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- 172.21.15.17:0/2796783332 >> 172.21.15.17:0/2796783332 conn(0x7f42900fc7a0 msgr2=0x7f42900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- 172.21.15.17:0/2796783332 shutdown_connections 2024-09-16T01:01:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- 172.21.15.17:0/2796783332 wait complete. 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 Processor -- start 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.862+0000 7f4297ed4640 1 -- start start 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290102d40 0x7f42901984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4290103660 0x7f42901989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 0x7f429019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111e20 con 0x7f429010c170 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111ca0 con 0x7f4290103660 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4290111fa0 con 0x7f4290102d40 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 0x7f429019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 0x7f429019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56510/0 (socket says 172.21.15.17:56510) 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 -- 172.21.15.17:0/851093580 learned_addr learned my addr 172.21.15.17:0/851093580 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f429546f640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4290103660 0x7f42901989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4295c70640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290102d40 0x7f42901984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 -- 172.21.15.17:0/851093580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290102d40 msgr2=0x7f42901984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290102d40 0x7f42901984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 -- 172.21.15.17:0/851093580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4290103660 msgr2=0x7f42901989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4290103660 0x7f42901989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429019d450 con 0x7f429010c170 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4295c70640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4290102d40 0x7f42901984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f429546f640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4290103660 0x7f42901989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4296471640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 0x7f429019cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f428800eaa0 tx=0x7f428800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428800cdb0 con 0x7f429010c170 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4288005020 con 0x7f429010c170 2024-09-16T01:01:09.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.863+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429019d740 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.864+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42880116d0 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.864+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42901a5020 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.864+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4290062900 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f42880051d0 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f427c0a32d0 0x7f427c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f42880cfe80 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4295c70640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f427c0a32d0 0x7f427c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] conn(0x7f427c0acb20 0x7f427c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4288014ec0 con 0x7f427c0acb20 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.866+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f42880d0360 con 0x7f429010c170 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.867+0000 7f429546f640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] conn(0x7f427c0acb20 0x7f427c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.867+0000 7f4295c70640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f427c0a32d0 0x7f427c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f428c031440 tx=0x7f428c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.867+0000 7f429546f640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] conn(0x7f427c0acb20 0x7f427c0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.868+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== osd.0 v2:172.21.15.17:6802/1660486395 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4288014ec0 con 0x7f427c0acb20 2024-09-16T01:01:09.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.881+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 --> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4290062d00 con 0x7f427c0acb20 2024-09-16T01:01:09.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4286ffd640 1 -- 172.21.15.17:0/851093580 <== osd.0 v2:172.21.15.17:6802/1660486395 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4290062d00 con 0x7f427c0acb20 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] conn(0x7f427c0acb20 msgr2=0x7f427c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] conn(0x7f427c0acb20 0x7f427c0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f427c0a32d0 msgr2=0x7f427c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f427c0a32d0 0x7f427c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f428c031440 tx=0x7f428c005a20 comp rx=0 tx=0).stop 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 msgr2=0x7f429019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 --2- 172.21.15.17:0/851093580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f429010c170 0x7f429019cd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f428800eaa0 tx=0x7f428800ef60 comp rx=0 tx=0).stop 2024-09-16T01:01:09.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4296471640 1 -- 172.21.15.17:0/851093580 reap_dead start 2024-09-16T01:01:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 shutdown_connections 2024-09-16T01:01:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 >> 172.21.15.17:0/851093580 conn(0x7f42900fc7a0 msgr2=0x7f42900fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 shutdown_connections 2024-09-16T01:01:09.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:09.882+0000 7f4297ed4640 1 -- 172.21.15.17:0/851093580 wait complete. 2024-09-16T01:01:10.670 INFO:teuthology.orchestra.run.smithi017.stdout:266287972383 2024-09-16T01:01:10.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-16T01:01:10.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:10 smithi088 ceph-mon[34093]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:01:10.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:10 smithi154 ceph-mon[34759]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:01:10.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:10 smithi017 ceph-mon[31211]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:01:11.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 -- 172.21.15.17:0/2331652175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 msgr2=0x7f4f3c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/2331652175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c100ee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009930 tx=0x7f4f3002a420 comp rx=0 tx=0).stop 2024-09-16T01:01:11.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 -- 172.21.15.17:0/2331652175 shutdown_connections 2024-09-16T01:01:11.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/2331652175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c101420 0x7f4f3c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/2331652175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c100ee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/2331652175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f3c106a80 0x7f4f3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 -- 172.21.15.17:0/2331652175 >> 172.21.15.17:0/2331652175 conn(0x7f4f3c0fc7a0 msgr2=0x7f4f3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 -- 172.21.15.17:0/2331652175 shutdown_connections 2024-09-16T01:01:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 -- 172.21.15.17:0/2331652175 wait complete. 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.647+0000 7f4f41dc3640 1 Processor -- start 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 -- start start 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c0fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c101420 0x7f4f3c0fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f3c106a80 0x7f4f3c0fd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c110dd0 con 0x7f4f3c100a80 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c110c50 con 0x7f4f3c106a80 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f41dc3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c110f50 con 0x7f4f3c101420 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c0fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c0fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45406/0 (socket says 172.21.15.17:45406) 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 -- 172.21.15.17:0/3443587032 learned_addr learned my addr 172.21.15.17:0/3443587032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3affd640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c101420 0x7f4f3c0fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3bfff640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f3c106a80 0x7f4f3c0fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 -- 172.21.15.17:0/3443587032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c101420 msgr2=0x7f4f3c0fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c101420 0x7f4f3c0fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 -- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f3c106a80 msgr2=0x7f4f3c0fd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f3c106a80 0x7f4f3c0fd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c1a69e0 con 0x7f4f3c100a80 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.648+0000 7f4f3b7fe640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c0fceb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00b4a0 tx=0x7f4f2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:11.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.649+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c014070 con 0x7f4f3c100a80 2024-09-16T01:01:11.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.649+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f2c010ac0 con 0x7f4f3c100a80 2024-09-16T01:01:11.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.649+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3c1a6cd0 con 0x7f4f3c100a80 2024-09-16T01:01:11.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.649+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c017c30 con 0x7f4f3c100a80 2024-09-16T01:01:11.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.649+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f3c1a71d0 con 0x7f4f3c100a80 2024-09-16T01:01:11.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.650+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f3c0628c0 con 0x7f4f3c100a80 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.651+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4f2c017070 con 0x7f4f3c100a80 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f38ff9640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f240a3350 0x7f4f240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f3affd640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f240a3350 0x7f4f240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4f2c0ceec0 con 0x7f4f3c100a80 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f38ff9640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] conn(0x7f4f240acba0 0x7f4f240aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f240af670 con 0x7f4f240acba0 2024-09-16T01:01:11.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f4f2c0cf3a0 con 0x7f4f3c100a80 2024-09-16T01:01:11.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f3affd640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f240a3350 0x7f4f240a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006010 tx=0x7f4f30000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:11.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.652+0000 7f4f3bfff640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] conn(0x7f4f240acba0 0x7f4f240aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:11.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.653+0000 7f4f3bfff640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] conn(0x7f4f240acba0 0x7f4f240aefc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:11.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.654+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== osd.7 v2:172.21.15.88:6816/1774608231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f240af670 con 0x7f4f240acba0 2024-09-16T01:01:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.667+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 --> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f3c062d40 con 0x7f4f240acba0 2024-09-16T01:01:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f38ff9640 1 -- 172.21.15.17:0/3443587032 <== osd.7 v2:172.21.15.88:6816/1774608231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4f3c062d40 con 0x7f4f240acba0 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] conn(0x7f4f240acba0 msgr2=0x7f4f240aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] conn(0x7f4f240acba0 0x7f4f240aefc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f240a3350 msgr2=0x7f4f240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f240a3350 0x7f4f240a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006010 tx=0x7f4f30000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 msgr2=0x7f4f3c0fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 --2- 172.21.15.17:0/3443587032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3c100a80 0x7f4f3c0fceb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00b4a0 tx=0x7f4f2c00b960 comp rx=0 tx=0).stop 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f3bfff640 1 -- 172.21.15.17:0/3443587032 reap_dead start 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 shutdown_connections 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 >> 172.21.15.17:0/3443587032 conn(0x7f4f3c0fc7a0 msgr2=0x7f4f3c06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 shutdown_connections 2024-09-16T01:01:11.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.668+0000 7f4f41dc3640 1 -- 172.21.15.17:0/3443587032 wait complete. 2024-09-16T01:01:11.908 INFO:teuthology.orchestra.run.smithi017.stdout:34359738446 2024-09-16T01:01:11.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T01:01:12.018 INFO:teuthology.orchestra.run.smithi017.stdout:236223201316 2024-09-16T01:01:12.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-16T01:01:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 -- 172.21.15.17:0/778276555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc1068b0 msgr2=0x7f9bcc106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/778276555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc106c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009930 tx=0x7f9bbc02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 -- 172.21.15.17:0/778276555 shutdown_connections 2024-09-16T01:01:12.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/778276555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc101250 0x7f9bcc10d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/778276555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bcc1008b0 0x7f9bcc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/778276555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc106c90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 -- 172.21.15.17:0/778276555 >> 172.21.15.17:0/778276555 conn(0x7f9bcc0fc5d0 msgr2=0x7f9bcc0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 -- 172.21.15.17:0/778276555 shutdown_connections 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.428+0000 7f9bcb59e640 1 -- 172.21.15.17:0/778276555 wait complete. 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 Processor -- start 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 -- start start 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bcc1008b0 0x7f9bcc0fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 0x7f9bcc0fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc0fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc110b20 con 0x7f9bcc101250 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc1109a0 con 0x7f9bcc1068b0 2024-09-16T01:01:12.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcb59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc110ca0 con 0x7f9bcc1008b0 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 0x7f9bcc0fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 0x7f9bcc0fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45454/0 (socket says 172.21.15.17:45454) 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 -- 172.21.15.17:0/1114846787 learned_addr learned my addr 172.21.15.17:0/1114846787 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bca59c640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bcc1008b0 0x7f9bcc0fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bcad9d640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc0fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 -- 172.21.15.17:0/1114846787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bcc1008b0 msgr2=0x7f9bcc0fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bcc1008b0 0x7f9bcc0fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 -- 172.21.15.17:0/1114846787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc1068b0 msgr2=0x7f9bcc0fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.429+0000 7f9bc9d9b640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc0fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bc9d9b640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc1a65a0 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bcad9d640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bcc1068b0 0x7f9bcc0fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bc9d9b640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 0x7f9bcc0fd240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000c920 tx=0x7f9bc000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0007c70 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc1a6890 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bc0007e10 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0018820 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.430+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc1a6e20 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.431+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bcc062900 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.433+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9bc00189c0 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.433+0000 7f9bbb7fe640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9bb40a32d0 0x7f9bb40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.433+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9bc00cfea0 con 0x7f9bcc101250 2024-09-16T01:01:12.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.433+0000 7f9bca59c640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9bb40a32d0 0x7f9bb40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bbb7fe640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] conn(0x7f9bb40acb20 0x7f9bb40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bc0015e70 con 0x7f9bb40acb20 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f9bc00d0380 con 0x7f9bcc101250 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bcad9d640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] conn(0x7f9bb40acb20 0x7f9bb40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bca59c640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9bb40a32d0 0x7f9bb40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.434+0000 7f9bcad9d640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] conn(0x7f9bb40acb20 0x7f9bb40aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.435+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== osd.3 v2:172.21.15.17:6810/920279967 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9bc0015e70 con 0x7f9bb40acb20 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.448+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 --> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9bcc062d00 con 0x7f9bb40acb20 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bbb7fe640 1 -- 172.21.15.17:0/1114846787 <== osd.3 v2:172.21.15.17:6810/920279967 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9bcc062d00 con 0x7f9bb40acb20 2024-09-16T01:01:12.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] conn(0x7f9bb40acb20 msgr2=0x7f9bb40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] conn(0x7f9bb40acb20 0x7f9bb40aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9bb40a32d0 msgr2=0x7f9bb40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9bb40a32d0 0x7f9bb40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 msgr2=0x7f9bcc0fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 --2- 172.21.15.17:0/1114846787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bcc101250 0x7f9bcc0fd240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000c920 tx=0x7f9bc000cde0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcad9d640 1 -- 172.21.15.17:0/1114846787 reap_dead start 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 shutdown_connections 2024-09-16T01:01:12.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.449+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 >> 172.21.15.17:0/1114846787 conn(0x7f9bcc0fc5d0 msgr2=0x7f9bcc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:12.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.450+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 shutdown_connections 2024-09-16T01:01:12.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.450+0000 7f9bcb59e640 1 -- 172.21.15.17:0/1114846787 wait complete. 2024-09-16T01:01:12.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:12 smithi017 ceph-mon[31211]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:12.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:12 smithi088 ceph-mon[34093]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:12.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:12 smithi154 ceph-mon[34759]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-16T01:01:13.459 INFO:teuthology.orchestra.run.smithi017.stdout:206158430250 2024-09-16T01:01:13.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-16T01:01:13.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 -- 172.21.15.17:0/3865743214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100eb0 msgr2=0x7f9954106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 --2- 172.21.15.17:0/3865743214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100eb0 0x7f9954106840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f993c009900 tx=0x7f993c02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 -- 172.21.15.17:0/3865743214 shutdown_connections 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 --2- 172.21.15.17:0/3865743214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9954106f70 0x7f995410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 --2- 172.21.15.17:0/3865743214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100eb0 0x7f9954106840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 --2- 172.21.15.17:0/3865743214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9954100500 0x7f99541008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 -- 172.21.15.17:0/3865743214 >> 172.21.15.17:0/3865743214 conn(0x7f99540fc5c0 msgr2=0x7f99540fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 -- 172.21.15.17:0/3865743214 shutdown_connections 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.509+0000 7f995abc1640 1 -- 172.21.15.17:0/3865743214 wait complete. 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 Processor -- start 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 -- start start 2024-09-16T01:01:13.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 0x7f99541982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9954100eb0 0x7f9954198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9954106f70 0x7f995419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9954111e00 con 0x7f9954100500 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9954111c80 con 0x7f9954100eb0 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995abc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9954111f80 con 0x7f9954106f70 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 0x7f99541982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 0x7f99541982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45474/0 (socket says 172.21.15.17:45474) 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 -- 172.21.15.17:0/914988543 learned_addr learned my addr 172.21.15.17:0/914988543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f9953fff640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9954100eb0 0x7f9954198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995915e640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9954106f70 0x7f995419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 -- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9954106f70 msgr2=0x7f995419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9954106f70 0x7f995419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 -- 172.21.15.17:0/914988543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9954100eb0 msgr2=0x7f9954198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9954100eb0 0x7f9954198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.510+0000 7f995895d640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995419d270 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f995895d640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 0x7f99541982c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f994400c970 tx=0x7f994400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944007c10 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995419d560 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9944007db0 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994400f7d0 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.511+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541a4e40 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.512+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9954062980 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.513+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9944018480 con 0x7f9954100500 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9951ffb640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f99400a32d0 0x7f99400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9953fff640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f99400a32d0 0x7f99400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f99440d0120 con 0x7f9954100500 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9951ffb640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] conn(0x7f99400acb20 0x7f99400aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99400af5f0 con 0x7f99400acb20 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f99440d0600 con 0x7f9954100500 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.514+0000 7f9953fff640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f99400a32d0 0x7f99400a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f993c009230 tx=0x7f993c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.515+0000 7f995915e640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] conn(0x7f99400acb20 0x7f99400aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.515+0000 7f995915e640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] conn(0x7f99400acb20 0x7f99400aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:13.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.516+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== osd.11 v2:172.21.15.154:6824/2457783951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99400af5f0 con 0x7f99400acb20 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.530+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 --> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9954062e00 con 0x7f99400acb20 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.530+0000 7f9951ffb640 1 -- 172.21.15.17:0/914988543 <== osd.11 v2:172.21.15.154:6824/2457783951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9954062e00 con 0x7f99400acb20 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.530+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] conn(0x7f99400acb20 msgr2=0x7f99400aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.530+0000 7f995abc1640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] conn(0x7f99400acb20 0x7f99400aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f99400a32d0 msgr2=0x7f99400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f99400a32d0 0x7f99400a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f993c009230 tx=0x7f993c031400 comp rx=0 tx=0).stop 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 msgr2=0x7f99541982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 --2- 172.21.15.17:0/914988543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9954100500 0x7f99541982c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f994400c970 tx=0x7f994400ce30 comp rx=0 tx=0).stop 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995915e640 1 -- 172.21.15.17:0/914988543 reap_dead start 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 shutdown_connections 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 >> 172.21.15.17:0/914988543 conn(0x7f99540fc5c0 msgr2=0x7f9954105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:13.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 shutdown_connections 2024-09-16T01:01:13.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:12.531+0000 7f995abc1640 1 -- 172.21.15.17:0/914988543 wait complete. 2024-09-16T01:01:14.581 INFO:teuthology.orchestra.run.smithi017.stdout:154618822707 2024-09-16T01:01:14.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T01:01:14.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:14 smithi017 ceph-mon[31211]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:01:14.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:14 smithi088 ceph-mon[34093]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:01:14.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:14 smithi154 ceph-mon[34759]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-16T01:01:14.914 INFO:teuthology.orchestra.run.smithi017.stdout:77309411395 2024-09-16T01:01:14.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T01:01:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/1116758255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 msgr2=0x7fcd0410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/1116758255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd0410bb50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009900 tx=0x7fccf802a480 comp rx=0 tx=0).stop 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/1116758255 shutdown_connections 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/1116758255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0410c170 0x7fcd0410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/1116758255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd0410bb50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/1116758255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd04102d40 0x7fcd04103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/1116758255 >> 172.21.15.17:0/1116758255 conn(0x7fcd040fc7a0 msgr2=0x7fcd040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/1116758255 shutdown_connections 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.847+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/1116758255 wait complete. 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 Processor -- start 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 -- start start 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd04102d40 0x7fcd041983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd04198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0410c170 0x7fcd0419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd04111e60 con 0x7fcd04103660 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcd04111ce0 con 0x7fcd04102d40 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd0a1cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd04111fe0 con 0x7fcd0410c170 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd02ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd04198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd02ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd04198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45428/0 (socket says 172.21.15.17:45428) 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd02ffd640 1 -- 172.21.15.17:0/559137943 learned_addr learned my addr 172.21.15.17:0/559137943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.848+0000 7fcd037fe640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd04102d40 0x7fcd041983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd03fff640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0410c170 0x7fcd0419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 -- 172.21.15.17:0/559137943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0410c170 msgr2=0x7fcd0419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0410c170 0x7fcd0419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 -- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd04102d40 msgr2=0x7fcd041983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd04102d40 0x7fcd041983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0419d370 con 0x7fcd04103660 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd02ffd640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd04198900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fccf8005940 tx=0x7fccf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf803f030 con 0x7fcd04103660 2024-09-16T01:01:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccf8003cb0 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0419d600 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8035070 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.849+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd041a4f40 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.850+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd04062980 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.851+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fccf8042030 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd00ff9640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fccec0a32d0 0x7fccec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd037fe640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fccec0a32d0 0x7fccec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fccf80f0210 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd00ff9640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] conn(0x7fccec0acb20 0x7fccec0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccec0af5f0 con 0x7fccec0acb20 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fccf80f7050 con 0x7fcd04103660 2024-09-16T01:01:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.852+0000 7fcd037fe640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fccec0a32d0 0x7fccec0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005d00 tx=0x7fccf400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.853+0000 7fcd03fff640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] conn(0x7fccec0acb20 0x7fccec0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.853+0000 7fcd03fff640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] conn(0x7fccec0acb20 0x7fccec0aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.854+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== osd.1 v2:172.21.15.88:6800/2469077193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccec0af5f0 con 0x7fccec0acb20 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.867+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 --> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd04062e00 con 0x7fccec0acb20 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd00ff9640 1 -- 172.21.15.17:0/559137943 <== osd.1 v2:172.21.15.88:6800/2469077193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd04062e00 con 0x7fccec0acb20 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] conn(0x7fccec0acb20 msgr2=0x7fccec0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] conn(0x7fccec0acb20 0x7fccec0aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fccec0a32d0 msgr2=0x7fccec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fccec0a32d0 0x7fccec0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005d00 tx=0x7fccf400b410 comp rx=0 tx=0).stop 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 msgr2=0x7fcd04198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 --2- 172.21.15.17:0/559137943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd04103660 0x7fcd04198900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fccf8005940 tx=0x7fccf80042f0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd03fff640 1 -- 172.21.15.17:0/559137943 reap_dead start 2024-09-16T01:01:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 shutdown_connections 2024-09-16T01:01:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.868+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 >> 172.21.15.17:0/559137943 conn(0x7fcd040fc7a0 msgr2=0x7fcd040fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.869+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 shutdown_connections 2024-09-16T01:01:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:11.869+0000 7fcd0a1cc640 1 -- 172.21.15.17:0/559137943 wait complete. 2024-09-16T01:01:15.787 INFO:teuthology.orchestra.run.smithi017.stdout:103079215167 2024-09-16T01:01:15.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T01:01:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 -- 172.21.15.17:0/3716588861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 msgr2=0x7f39b41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/3716588861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b41021d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009900 tx=0x7f39a402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 -- 172.21.15.17:0/3716588861 shutdown_connections 2024-09-16T01:01:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/3716588861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 0x7f39b410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/3716588861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 0x7f39b41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/3716588861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b41021d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.966+0000 7f39b9d3e640 1 -- 172.21.15.17:0/3716588861 >> 172.21.15.17:0/3716588861 conn(0x7f39b40fd8f0 msgr2=0x7f39b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.967+0000 7f39b9d3e640 1 -- 172.21.15.17:0/3716588861 shutdown_connections 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.967+0000 7f39b9d3e640 1 -- 172.21.15.17:0/3716588861 wait complete. 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.967+0000 7f39b9d3e640 1 Processor -- start 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 -- start start 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 0x7f39b4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 0x7f39b419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4111e30 con 0x7f39b4101df0 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4111cb0 con 0x7f39b4106f20 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b9d3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4111fb0 con 0x7f39b41027a0 2024-09-16T01:01:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 0x7f39b419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 0x7f39b4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45490/0 (socket says 172.21.15.17:45490) 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b37fe640 1 -- 172.21.15.17:0/4026976729 learned_addr learned my addr 172.21.15.17:0/4026976729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 -- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 msgr2=0x7f39b419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 0x7f39b419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 -- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 msgr2=0x7f39b4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b2ffd640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b419d400 con 0x7f39b41027a0 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b3fff640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b4106f20 0x7f39b419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.968+0000 7f39b37fe640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b4101df0 0x7f39b4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:15.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b2ffd640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 0x7f39b4198990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39a800e9f0 tx=0x7f39a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a800ccc0 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b419d6f0 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39a8005020 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a800ce60 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.969+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b41a4fd0 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.970+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39b4062880 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.971+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f39a80051d0 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b0ff9640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f399c0a32d0 0x7f399c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b37fe640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f399c0a32d0 0x7f399c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f39a80cfb10 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b0ff9640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] conn(0x7f399c0acb20 0x7f399c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39a8011e50 con 0x7f399c0acb20 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f39a80cfff0 con 0x7f39b41027a0 2024-09-16T01:01:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b3fff640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] conn(0x7f399c0acb20 0x7f399c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b37fe640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f399c0a32d0 0x7f399c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39a4031440 tx=0x7f39a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.972+0000 7f39b3fff640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] conn(0x7f399c0acb20 0x7f399c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.973+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== osd.4 v2:172.21.15.88:6808/1483055508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39a8011e50 con 0x7f399c0acb20 2024-09-16T01:01:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.989+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 --> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39b4062d00 con 0x7f399c0acb20 2024-09-16T01:01:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.989+0000 7f39b0ff9640 1 -- 172.21.15.17:0/4026976729 <== osd.4 v2:172.21.15.88:6808/1483055508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f39b4062d00 con 0x7f399c0acb20 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] conn(0x7f399c0acb20 msgr2=0x7f399c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] conn(0x7f399c0acb20 0x7f399c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f399c0a32d0 msgr2=0x7f399c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f399c0a32d0 0x7f399c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39a4031440 tx=0x7f39a40058d0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 msgr2=0x7f39b4198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 --2- 172.21.15.17:0/4026976729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39b41027a0 0x7f39b4198990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39a800e9f0 tx=0x7f39a800edf0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b3fff640 1 -- 172.21.15.17:0/4026976729 reap_dead start 2024-09-16T01:01:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 shutdown_connections 2024-09-16T01:01:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 >> 172.21.15.17:0/4026976729 conn(0x7f39b40fd8f0 msgr2=0x7f39b40fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 shutdown_connections 2024-09-16T01:01:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:15.990+0000 7f39b9d3e640 1 -- 172.21.15.17:0/4026976729 wait complete. 2024-09-16T01:01:16.643 INFO:teuthology.orchestra.run.smithi017.stdout:133143986235 2024-09-16T01:01:16.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T01:01:16.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:16 smithi088 ceph-mon[34093]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:01:16.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:16 smithi154 ceph-mon[34759]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:01:16.926 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:16 smithi017 ceph-mon[31211]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:01:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 -- 172.21.15.17:0/3605956763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 msgr2=0x7fbf4010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 --2- 172.21.15.17:0/3605956763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4010e610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009ca0 tx=0x7fbf3802a950 comp rx=0 tx=0).stop 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 -- 172.21.15.17:0/3605956763 shutdown_connections 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 --2- 172.21.15.17:0/3605956763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4010e610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 --2- 172.21.15.17:0/3605956763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40103660 0x7fbf4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 --2- 172.21.15.17:0/3605956763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf40102d40 0x7fbf40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 -- 172.21.15.17:0/3605956763 >> 172.21.15.17:0/3605956763 conn(0x7fbf400fc7a0 msgr2=0x7fbf400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 -- 172.21.15.17:0/3605956763 shutdown_connections 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.925+0000 7fbf457e6640 1 -- 172.21.15.17:0/3605956763 wait complete. 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 Processor -- start 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 -- start start 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40102d40 0x7fbf40198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf40103660 0x7fbf40198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40111de0 con 0x7fbf4010c170 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40111c60 con 0x7fbf40103660 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.926+0000 7fbf457e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40111f60 con 0x7fbf40102d40 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40102d40 0x7fbf40198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45510/0 (socket says 172.21.15.17:45510) 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40102d40 0x7fbf40198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.17:54532/0 (socket says 172.21.15.17:54532) 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 -- 172.21.15.17:0/1467013711 learned_addr learned my addr 172.21.15.17:0/1467013711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3e7fc640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf40103660 0x7fbf40198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 -- 172.21.15.17:0/1467013711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40102d40 msgr2=0x7fbf40198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf40102d40 0x7fbf40198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 -- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf40103660 msgr2=0x7fbf40198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf40103660 0x7fbf40198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4019d2f0 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf3f7fe640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4019cc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf3802ae70 tx=0x7fbf3802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38034040 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4019d580 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf380308f0 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.927+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf380047f0 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.928+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf401a4ec0 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.928+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf40062940 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.930+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbf38037020 con 0x7fbf4010c170 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.930+0000 7fbf27fff640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fbf280a32d0 0x7fbf280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf3effd640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fbf280a32d0 0x7fbf280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbf380f0aa0 con 0x7fbf4010c170 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf27fff640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] conn(0x7fbf280acb20 0x7fbf280aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf3802c030 con 0x7fbf280acb20 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fbf380f0f80 con 0x7fbf4010c170 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf3effd640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fbf280a32d0 0x7fbf280a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf30005d00 tx=0x7fbf3000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf3e7fc640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] conn(0x7fbf280acb20 0x7fbf280aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.931+0000 7fbf3e7fc640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] conn(0x7fbf280acb20 0x7fbf280aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.932+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== osd.10 v2:172.21.15.88:6824/40654334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf3802c030 con 0x7fbf280acb20 2024-09-16T01:01:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.946+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 --> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf40062d40 con 0x7fbf280acb20 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf27fff640 1 -- 172.21.15.17:0/1467013711 <== osd.10 v2:172.21.15.88:6824/40654334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbf40062d40 con 0x7fbf280acb20 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] conn(0x7fbf280acb20 msgr2=0x7fbf280aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] conn(0x7fbf280acb20 0x7fbf280aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fbf280a32d0 msgr2=0x7fbf280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fbf280a32d0 0x7fbf280a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf30005d00 tx=0x7fbf3000b410 comp rx=0 tx=0).stop 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 msgr2=0x7fbf4019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 --2- 172.21.15.17:0/1467013711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf4010c170 0x7fbf4019cc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf3802ae70 tx=0x7fbf3802f5d0 comp rx=0 tx=0).stop 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf3f7fe640 1 -- 172.21.15.17:0/1467013711 reap_dead start 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 shutdown_connections 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 >> 172.21.15.17:0/1467013711 conn(0x7fbf400fc7a0 msgr2=0x7fbf400fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 shutdown_connections 2024-09-16T01:01:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:16.947+0000 7fbf457e6640 1 -- 172.21.15.17:0/1467013711 wait complete. 2024-09-16T01:01:17.638 INFO:teuthology.orchestra.run.smithi017.stdout:287762808860 2024-09-16T01:01:17.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-16T01:01:18.130 INFO:teuthology.orchestra.run.smithi017.stdout:55834574921 2024-09-16T01:01:18.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T01:01:18.584 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:18.633 INFO:teuthology.orchestra.run.smithi017.stdout:317827579927 2024-09-16T01:01:18.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-16T01:01:18.881 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:18 smithi017 ceph-mon[31211]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T01:01:18.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:18 smithi088 ceph-mon[34093]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T01:01:18.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:18 smithi154 ceph-mon[34759]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T01:01:19.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 -- 172.21.15.17:0/2062863058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 msgr2=0x7f4f28100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 --2- 172.21.15.17:0/2062863058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f28100f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009900 tx=0x7f4f2402a470 comp rx=0 tx=0).stop 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 -- 172.21.15.17:0/2062863058 shutdown_connections 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 --2- 172.21.15.17:0/2062863058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28105f40 0x7f4f281063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 --2- 172.21.15.17:0/2062863058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28101450 0x7f4f28105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 --2- 172.21.15.17:0/2062863058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f28100f10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 -- 172.21.15.17:0/2062863058 >> 172.21.15.17:0/2062863058 conn(0x7f4f280fc7a0 msgr2=0x7f4f280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 -- 172.21.15.17:0/2062863058 shutdown_connections 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.109+0000 7f4f30030640 1 -- 172.21.15.17:0/2062863058 wait complete. 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 Processor -- start 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 -- start start 2024-09-16T01:01:19.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 0x7f4f281a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 0x7f4f2819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28118470 con 0x7f4f28100b30 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281182f0 con 0x7f4f28101450 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f30030640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281185f0 con 0x7f4f28105f40 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f2ddcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f2ddcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45530/0 (socket says 172.21.15.17:45530) 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f2ddcc640 1 -- 172.21.15.17:0/537389922 learned_addr learned my addr 172.21.15.17:0/537389922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f2d5cb640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 0x7f4f281a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.110+0000 7f4f2e5cd640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 0x7f4f2819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 -- 172.21.15.17:0/537389922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 msgr2=0x7f4f2819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:19.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 0x7f4f2819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 -- 172.21.15.17:0/537389922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 msgr2=0x7f4f281a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 0x7f4f281a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 -- 172.21.15.17:0/537389922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2819eff0 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2e5cd640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 0x7f4f2819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2d5cb640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 0x7f4f281a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f2ddcc640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006010 tx=0x7f4f24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2403f030 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2819f280 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f240035f0 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24035070 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.111+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281ab5d0 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.112+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28105920 con 0x7f4f28100b30 2024-09-16T01:01:19.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.113+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4f24003b10 con 0x7f4f28100b30 2024-09-16T01:01:19.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.114+0000 7f4f1effd640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 0x7f4f140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:19.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.114+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4f240f0730 con 0x7f4f28100b30 2024-09-16T01:01:19.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.114+0000 7f4f2d5cb640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 0x7f4f140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:19.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.115+0000 7f4f2d5cb640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 0x7f4f140a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006fd0 tx=0x7f4f18008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:19.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.118+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f240bd4a0 con 0x7f4f28100b30 2024-09-16T01:01:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.353+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4f281ab7a0 con 0x7f4f28100b30 2024-09-16T01:01:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.353+0000 7f4f1effd640 1 -- 172.21.15.17:0/537389922 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4f240bcda0 con 0x7f4f28100b30 2024-09-16T01:01:19.354 INFO:teuthology.orchestra.run.smithi017.stdout:184683593777 2024-09-16T01:01:19.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 msgr2=0x7f4f140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:19.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 0x7f4f140a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f18006fd0 tx=0x7f4f18008040 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 msgr2=0x7f4f281a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006010 tx=0x7f4f24004270 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 shutdown_connections 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f4f140a32d0 0x7f4f140a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f28105f40 0x7f4f2819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f28101450 0x7f4f281a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 --2- 172.21.15.17:0/537389922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f28100b30 0x7f4f281a4700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 >> 172.21.15.17:0/537389922 conn(0x7f4f280fc7a0 msgr2=0x7f4f2810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 shutdown_connections 2024-09-16T01:01:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:19.355+0000 7f4f30030640 1 -- 172.21.15.17:0/537389922 wait complete. 2024-09-16T01:01:19.876 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:19 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/537389922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:01:19.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:19 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/537389922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:01:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:19 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/537389922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:01:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 -- 172.21.15.17:0/161258881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac106a80 msgr2=0x7fe9ac106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/161258881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac106a80 0x7fe9ac106e60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009930 tx=0x7fe99c02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 -- 172.21.15.17:0/161258881 shutdown_connections 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/161258881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac101420 0x7fe9ac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/161258881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac100a80 0x7fe9ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/161258881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac106a80 0x7fe9ac106e60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 -- 172.21.15.17:0/161258881 >> 172.21.15.17:0/161258881 conn(0x7fe9ac0fc7a0 msgr2=0x7fe9ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 -- 172.21.15.17:0/161258881 shutdown_connections 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.389+0000 7fe9b13d5640 1 -- 172.21.15.17:0/161258881 wait complete. 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 Processor -- start 2024-09-16T01:01:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 -- start start 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac100a80 0x7fe9ac198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac106a80 0x7fe9ac19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac110d30 con 0x7fe9ac101420 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac110bb0 con 0x7fe9ac100a80 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9b13d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac110eb0 con 0x7fe9ac106a80 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45550/0 (socket says 172.21.15.17:45550) 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9aa7fc640 1 -- 172.21.15.17:0/335739778 learned_addr learned my addr 172.21.15.17:0/335739778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9aaffd640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac100a80 0x7fe9ac198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.390+0000 7fe9ab7fe640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac106a80 0x7fe9ac19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 -- 172.21.15.17:0/335739778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac106a80 msgr2=0x7fe9ac19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac106a80 0x7fe9ac19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 -- 172.21.15.17:0/335739778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac100a80 msgr2=0x7fe9ac198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac100a80 0x7fe9ac198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 -- 172.21.15.17:0/335739778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac19d340 con 0x7fe9ac101420 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9aa7fc640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c890 tx=0x7fe99400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994004220 con 0x7fe9ac101420 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9940043c0 con 0x7fe9ac101420 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac19d630 con 0x7fe9ac101420 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994004a00 con 0x7fe9ac101420 2024-09-16T01:01:20.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.391+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac1a4f10 con 0x7fe9ac101420 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.392+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac100ee0 con 0x7fe9ac101420 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.393+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe994004ba0 con 0x7fe9ac101420 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.394+0000 7fe9a3fff640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 0x7fe9980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.394+0000 7fe9aaffd640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 0x7fe9980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.394+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe9940cf500 con 0x7fe9ac101420 2024-09-16T01:01:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.395+0000 7fe9aaffd640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 0x7fe9980a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009900 tx=0x7fe99c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:20.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.398+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe994014030 con 0x7fe9ac101420 2024-09-16T01:01:20.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.577+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe9ac1a5200 con 0x7fe9ac101420 2024-09-16T01:01:20.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.577+0000 7fe9a3fff640 1 -- 172.21.15.17:0/335739778 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe99409bc20 con 0x7fe9ac101420 2024-09-16T01:01:20.581 INFO:teuthology.orchestra.run.smithi017.stdout:103079215168 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 msgr2=0x7fe9980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 0x7fe9980a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009900 tx=0x7fe99c000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 msgr2=0x7fe9ac1988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c890 tx=0x7fe99400cd50 comp rx=0 tx=0).stop 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 shutdown_connections 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe9980a32d0 0x7fe9980a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac106a80 0x7fe9ac19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac101420 0x7fe9ac1988d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 --2- 172.21.15.17:0/335739778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ac100a80 0x7fe9ac198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:20.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.579+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 >> 172.21.15.17:0/335739778 conn(0x7fe9ac0fc7a0 msgr2=0x7fe9ac104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:20.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.580+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 shutdown_connections 2024-09-16T01:01:20.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:20.580+0000 7fe9b13d5640 1 -- 172.21.15.17:0/335739778 wait complete. 2024-09-16T01:01:20.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:20 smithi017 ceph-mon[31211]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-16T01:01:20.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:20 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/335739778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:01:20.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:20 smithi088 ceph-mon[34093]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-16T01:01:20.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:20 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/335739778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:01:20.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:20 smithi154 ceph-mon[34759]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-16T01:01:20.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:20 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/335739778' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:01:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 -- 172.21.15.17:0/2972421477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102ef0 msgr2=0x7f457c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 --2- 172.21.15.17:0/2972421477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102ef0 0x7f457c10da40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4574009ca0 tx=0x7f457402a950 comp rx=0 tx=0).stop 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 -- 172.21.15.17:0/2972421477 shutdown_connections 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 --2- 172.21.15.17:0/2972421477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102ef0 0x7f457c10da40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 --2- 172.21.15.17:0/2972421477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102570 0x7f457c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 --2- 172.21.15.17:0/2972421477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 -- 172.21.15.17:0/2972421477 >> 172.21.15.17:0/2972421477 conn(0x7f457c0fc7d0 msgr2=0x7f457c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 -- 172.21.15.17:0/2972421477 shutdown_connections 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.230+0000 7f4582ad5640 1 -- 172.21.15.17:0/2972421477 wait complete. 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 Processor -- start 2024-09-16T01:01:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 -- start start 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102ef0 0x7f457c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f457c110e30 con 0x7f457c102570 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f457c110cb0 con 0x7f457c100e20 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f4582ad5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f457c110fb0 con 0x7f457c102ef0 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.231+0000 7f457bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44606/0 (socket says 172.21.15.17:44606) 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 -- 172.21.15.17:0/3733048991 learned_addr learned my addr 172.21.15.17:0/3733048991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4580871640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4581072640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102ef0 0x7f457c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 -- 172.21.15.17:0/3733048991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102ef0 msgr2=0x7f457c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102ef0 0x7f457c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 -- 172.21.15.17:0/3733048991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 msgr2=0x7f457c1972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c1972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 -- 172.21.15.17:0/3733048991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c19c280 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4580871640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c1972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f457bfff640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f456800d770 tx=0x7f456800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568017070 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45680054d0 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457c19c570 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.232+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568004cf0 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.233+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457c1a3e50 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.233+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457c101200 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.235+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4568004e90 con 0x7f457c102570 2024-09-16T01:01:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.236+0000 7f4579ffb640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 0x7f456c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.236+0000 7f4580871640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 0x7f456c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.236+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f45680cf2b0 con 0x7f457c102570 2024-09-16T01:01:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.237+0000 7f4580871640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 0x7f456c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4570005d00 tx=0x7f457000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.241+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f456809b8d0 con 0x7f457c102570 2024-09-16T01:01:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f457c109090 con 0x7f457c102570 2024-09-16T01:01:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f4579ffb640 1 -- 172.21.15.17:0/3733048991 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f456809fbd0 con 0x7f457c102570 2024-09-16T01:01:21.433 INFO:teuthology.orchestra.run.smithi017.stdout:34359738448 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 msgr2=0x7f456c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 0x7f456c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4570005d00 tx=0x7f457000b410 comp rx=0 tx=0).stop 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 msgr2=0x7f457c197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f456800d770 tx=0x7f456800dc30 comp rx=0 tx=0).stop 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 shutdown_connections 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f456c0a3350 0x7f456c0a5810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f457c102ef0 0x7f457c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f457c102570 0x7f457c197810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 --2- 172.21.15.17:0/3733048991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f457c100e20 0x7f457c1972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.435+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 >> 172.21.15.17:0/3733048991 conn(0x7f457c0fc7d0 msgr2=0x7f457c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.436+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 shutdown_connections 2024-09-16T01:01:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.436+0000 7f4582ad5640 1 -- 172.21.15.17:0/3733048991 wait complete. 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.430+0000 7f47190c5640 1 -- 172.21.15.17:0/425411318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 msgr2=0x7f4714101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.430+0000 7f47190c5640 1 --2- 172.21.15.17:0/425411318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f4714101200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4704009900 tx=0x7f470402a480 comp rx=0 tx=0).stop 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 -- 172.21.15.17:0/425411318 shutdown_connections 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 --2- 172.21.15.17:0/425411318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102ef0 0x7f471410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 --2- 172.21.15.17:0/425411318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102570 0x7f47141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 --2- 172.21.15.17:0/425411318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f4714101200 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 -- 172.21.15.17:0/425411318 >> 172.21.15.17:0/425411318 conn(0x7f47140fc7d0 msgr2=0x7f47140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 -- 172.21.15.17:0/425411318 shutdown_connections 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 -- 172.21.15.17:0/425411318 wait complete. 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.431+0000 7f47190c5640 1 Processor -- start 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 -- start start 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110e00 con 0x7f4714100e20 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110c80 con 0x7f4714102ef0 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f47190c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110f80 con 0x7f4714102570 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f471359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44634/0 (socket says 172.21.15.17:44634) 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f471359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:52870/0 (socket says 172.21.15.17:52870) 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f4712d9d640 1 -- 172.21.15.17:0/1846459448 learned_addr learned my addr 172.21.15.17:0/1846459448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.432+0000 7f471259c640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 -- 172.21.15.17:0/1846459448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102570 msgr2=0x7f47140fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 -- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 msgr2=0x7f47140fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 -- 172.21.15.17:0/1846459448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141a69b0 con 0x7f4714102ef0 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f4712d9d640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f471359e640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f470c00ca30 tx=0x7f470c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c007d90 con 0x7f4714102ef0 2024-09-16T01:01:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141a6ca0 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f470c005020 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00f690 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.433+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a71e0 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.434+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4714101200 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.436+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f470c0051d0 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.436+0000 7f46fbfff640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 0x7f46fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.437+0000 7f4712d9d640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 0x7f46fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.437+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f470c0cfb00 con 0x7f4714102ef0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.437+0000 7f4712d9d640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 0x7f46fc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47040096c0 tx=0x7f4704005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.440+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f470c014070 con 0x7f4714102ef0 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 -- 172.21.15.17:0/2077706438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 msgr2=0x7ffb98100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 --2- 172.21.15.17:0/2077706438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb98100cb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009900 tx=0x7ffb9402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 -- 172.21.15.17:0/2077706438 shutdown_connections 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 --2- 172.21.15.17:0/2077706438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 0x7ffb98110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 --2- 172.21.15.17:0/2077706438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 0x7ffb9810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 --2- 172.21.15.17:0/2077706438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb98100cb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 -- 172.21.15.17:0/2077706438 >> 172.21.15.17:0/2077706438 conn(0x7ffb980fc7a0 msgr2=0x7ffb980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 -- 172.21.15.17:0/2077706438 shutdown_connections 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.120+0000 7ffba011f640 1 -- 172.21.15.17:0/2077706438 wait complete. 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 Processor -- start 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 -- start start 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 0x7ffb981a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 0x7ffb9819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98114110 con 0x7ffb981008d0 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98113f90 con 0x7ffb9810e480 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffba011f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98114290 con 0x7ffb98101280 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffb9debb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffb9debb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44586/0 (socket says 172.21.15.17:44586) 2024-09-16T01:01:21.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffb9debb640 1 -- 172.21.15.17:0/2100352612 learned_addr learned my addr 172.21.15.17:0/2100352612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffb9e6bc640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 0x7ffb9819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stdout:133143986235 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.121+0000 7ffb9d6ba640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 0x7ffb981a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 -- 172.21.15.17:0/2100352612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 msgr2=0x7ffb981a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 0x7ffb981a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 -- 172.21.15.17:0/2100352612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 msgr2=0x7ffb9819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 0x7ffb9819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 -- 172.21.15.17:0/2100352612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9819ad20 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb9debb640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005940 tx=0x7ffb940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9403f030 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9819afb0 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb94003cb0 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94035070 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.122+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb981a7300 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.123+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb98100d30 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.124+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffb94042030 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.125+0000 7ffb8effd640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 0x7ffb840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.125+0000 7ffb9d6ba640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 0x7ffb840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.125+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ffb940efe20 con 0x7ffb981008d0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.125+0000 7ffb9d6ba640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 0x7ffb840a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb9810eb30 tx=0x7ffb88009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.129+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb940bcb90 con 0x7ffb981008d0 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.313+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ffb98109610 con 0x7ffb981008d0 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.313+0000 7ffb8effd640 1 -- 172.21.15.17:0/2100352612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffb940bc490 con 0x7ffb981008d0 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 msgr2=0x7ffb840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 0x7ffb840a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb9810eb30 tx=0x7ffb88009110 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 msgr2=0x7ffb981a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005940 tx=0x7ffb940042f0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 shutdown_connections 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffb840a32d0 0x7ffb840a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb9810e480 0x7ffb9819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb98101280 0x7ffb981a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 --2- 172.21.15.17:0/2100352612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb981008d0 0x7ffb981a0430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 >> 172.21.15.17:0/2100352612 conn(0x7ffb980fc7a0 msgr2=0x7ffb980feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 shutdown_connections 2024-09-16T01:01:21.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.316+0000 7ffba011f640 1 -- 172.21.15.17:0/2100352612 wait complete. 2024-09-16T01:01:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.632+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f471410a0a0 con 0x7f4714102ef0 2024-09-16T01:01:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.632+0000 7f46fbfff640 1 -- 172.21.15.17:0/1846459448 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f470c09c220 con 0x7f4714102ef0 2024-09-16T01:01:21.633 INFO:teuthology.orchestra.run.smithi017.stdout:154618822710 2024-09-16T01:01:21.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 msgr2=0x7f46fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 0x7f46fc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47040096c0 tx=0x7f4704005a20 comp rx=0 tx=0).stop 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 msgr2=0x7f47140fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f470c00ca30 tx=0x7f470c00cef0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 shutdown_connections 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f46fc0a32d0 0x7f46fc0a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 --2- 172.21.15.17:0/1846459448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 >> 172.21.15.17:0/1846459448 conn(0x7f47140fc7d0 msgr2=0x7f471406a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 shutdown_connections 2024-09-16T01:01:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:21.635+0000 7f47190c5640 1 -- 172.21.15.17:0/1846459448 wait complete. 2024-09-16T01:01:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:21 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2100352612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:01:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:21 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3733048991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:01:21.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:21 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2100352612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:01:21.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:21 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3733048991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:01:21.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:21 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2100352612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:01:21.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:21 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3733048991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:01:22.202 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986235 got 133143986235 for osd.4 2024-09-16T01:01:22.202 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:22.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822710 for osd.5 2024-09-16T01:01:22.811 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:22.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:22 smithi088 ceph-mon[34093]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-16T01:01:22.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:22 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1846459448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:01:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:22 smithi154 ceph-mon[34759]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-16T01:01:22.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:22 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1846459448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:01:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:22 smithi017 ceph-mon[31211]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-16T01:01:22.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:22 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1846459448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:01:23.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.617+0000 7f2a1112e640 1 -- 172.21.15.17:0/1032215203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c102d30 msgr2=0x7f2a0c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.617+0000 7f2a1112e640 1 --2- 172.21.15.17:0/1032215203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c102d30 0x7f2a0c103110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009900 tx=0x7f29fc02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:23.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 -- 172.21.15.17:0/1032215203 shutdown_connections 2024-09-16T01:01:23.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 --2- 172.21.15.17:0/1032215203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c10c160 0x7f2a0c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 --2- 172.21.15.17:0/1032215203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c103650 0x7f2a0c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 --2- 172.21.15.17:0/1032215203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c102d30 0x7f2a0c103110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 -- 172.21.15.17:0/1032215203 >> 172.21.15.17:0/1032215203 conn(0x7f2a0c0fc790 msgr2=0x7f2a0c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 -- 172.21.15.17:0/1032215203 shutdown_connections 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 -- 172.21.15.17:0/1032215203 wait complete. 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.618+0000 7f2a1112e640 1 Processor -- start 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 -- start start 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 0x7f2a0c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c103650 0x7f2a0c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c111e10 con 0x7f2a0c10c160 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c111c90 con 0x7f2a0c103650 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a1112e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c111f90 con 0x7f2a0c102d30 2024-09-16T01:01:23.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44678/0 (socket says 172.21.15.17:44678) 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 -- 172.21.15.17:0/3229374530 learned_addr learned my addr 172.21.15.17:0/3229374530 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0a59c640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c103650 0x7f2a0c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0ad9d640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 0x7f2a0c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 -- 172.21.15.17:0/3229374530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 msgr2=0x7f2a0c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 0x7f2a0c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 -- 172.21.15.17:0/3229374530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c103650 msgr2=0x7f2a0c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.619+0000 7f2a0b59e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c103650 0x7f2a0c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.620+0000 7f2a0b59e640 1 -- 172.21.15.17:0/3229374530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c19d380 con 0x7f2a0c10c160 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.620+0000 7f2a0ad9d640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 0x7f2a0c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.620+0000 7f2a0b59e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400d950 tx=0x7f2a0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.621+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04017030 con 0x7f2a0c10c160 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.621+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a04004020 con 0x7f2a0c10c160 2024-09-16T01:01:23.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.621+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04003b20 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.621+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c19d670 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.621+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c1a4f50 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.622+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c103110 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.623+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2a0401a070 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.623+0000 7f29f3fff640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 0x7f29f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.623+0000 7f2a0ad9d640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 0x7f29f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.624+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2a040cf030 con 0x7f2a0c10c160 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.624+0000 7f2a0ad9d640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 0x7f29f40a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29fc031440 tx=0x7f29fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.628+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a04021070 con 0x7f2a0c10c160 2024-09-16T01:01:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.808+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f2a0c107200 con 0x7f2a0c10c160 2024-09-16T01:01:23.808 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:23 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3533187552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:01:23.809 INFO:teuthology.orchestra.run.smithi017.stdout:236223201319 2024-09-16T01:01:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.808+0000 7f29f3fff640 1 -- 172.21.15.17:0/3229374530 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2a0409bda0 con 0x7f2a0c10c160 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 msgr2=0x7f29f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 0x7f29f40a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f29fc031440 tx=0x7f29fc005a20 comp rx=0 tx=0).stop 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 msgr2=0x7f2a0c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400d950 tx=0x7f2a0400de10 comp rx=0 tx=0).stop 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 shutdown_connections 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f29f40a3350 0x7f29f40a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a0c10c160 0x7f2a0c19cca0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a0c103650 0x7f2a0c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.810+0000 7f2a1112e640 1 --2- 172.21.15.17:0/3229374530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c102d30 0x7f2a0c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.811+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 >> 172.21.15.17:0/3229374530 conn(0x7f2a0c0fc790 msgr2=0x7f2a0c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.811+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 shutdown_connections 2024-09-16T01:01:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.811+0000 7f2a1112e640 1 -- 172.21.15.17:0/3229374530 wait complete. 2024-09-16T01:01:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:23 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3533187552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:01:23.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:23 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3533187552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:01:24.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201316 got 236223201319 for osd.8 2024-09-16T01:01:24.494 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:24.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:24 smithi017 ceph-mon[31211]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-16T01:01:24.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:24 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3229374530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:01:24.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:24 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:24.887 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738448 for osd.0 2024-09-16T01:01:24.887 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:24 smithi088 ceph-mon[34093]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-16T01:01:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:24 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3229374530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:01:24.892 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:24 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:24.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:24 smithi154 ceph-mon[34759]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-16T01:01:24.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:24 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3229374530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:01:24.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:24 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:25.319 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593774 got 184683593777 for osd.6 2024-09-16T01:01:25.320 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:25.980 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:25.997 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215167 got 103079215168 for osd.3 2024-09-16T01:01:25.998 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 -- 172.21.15.17:0/1605277012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8103660 msgr2=0x7fd4a810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 --2- 172.21.15.17:0/1605277012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8103660 0x7fd4a810bb50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd49c009900 tx=0x7fd49c02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 -- 172.21.15.17:0/1605277012 shutdown_connections 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 --2- 172.21.15.17:0/1605277012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 --2- 172.21.15.17:0/1605277012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8103660 0x7fd4a810bb50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 --2- 172.21.15.17:0/1605277012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8102d40 0x7fd4a8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 -- 172.21.15.17:0/1605277012 >> 172.21.15.17:0/1605277012 conn(0x7fd4a80fc7a0 msgr2=0x7fd4a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:26.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 -- 172.21.15.17:0/1605277012 shutdown_connections 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.410+0000 7fd4adac0640 1 -- 172.21.15.17:0/1605277012 wait complete. 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 Processor -- start 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 -- start start 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 0x7fd4a8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8111e20 con 0x7fd4a8102d40 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8111ca0 con 0x7fd4a810c170 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4adac0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8111fa0 con 0x7fd4a8103660 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.411+0000 7fd4a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44688/0 (socket says 172.21.15.17:44688) 2024-09-16T01:01:26.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 -- 172.21.15.17:0/3382937372 learned_addr learned my addr 172.21.15.17:0/3382937372 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a6ffd640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 0x7fd4a8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a7fff640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 -- 172.21.15.17:0/3382937372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 msgr2=0x7fd4a8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 0x7fd4a8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 -- 172.21.15.17:0/3382937372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 msgr2=0x7fd4a8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 -- 172.21.15.17:0/3382937372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a81a6880 con 0x7fd4a8102d40 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a7fff640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a6ffd640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 0x7fd4a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a77fe640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c890 tx=0x7fd49800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498004220 con 0x7fd4a8102d40 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4980043c0 con 0x7fd4a8102d40 2024-09-16T01:01:26.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a81a6b70 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498004a00 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.412+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a81a7080 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.413+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a8103120 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.414+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd498004ba0 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.415+0000 7fd4a4ff9640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 0x7fd4900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.415+0000 7fd4a6ffd640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 0x7fd4900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.415+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd4980cf660 con 0x7fd4a8102d40 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.416+0000 7fd4a6ffd640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 0x7fd4900a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd49c031440 tx=0x7fd49c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.420+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd498014030 con 0x7fd4a8102d40 2024-09-16T01:01:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.597+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd4a8101ed0 con 0x7fd4a8102d40 2024-09-16T01:01:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.598+0000 7fd4a4ff9640 1 -- 172.21.15.17:0/3382937372 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd49809c3d0 con 0x7fd4a8102d40 2024-09-16T01:01:26.598 INFO:teuthology.orchestra.run.smithi017.stdout:287762808861 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 msgr2=0x7fd4900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 0x7fd4900a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd49c031440 tx=0x7fd49c0095f0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 msgr2=0x7fd4a81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c890 tx=0x7fd49800cd50 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 shutdown_connections 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd4900a32d0 0x7fd4900a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4a810c170 0x7fd4a8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a8103660 0x7fd4a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 --2- 172.21.15.17:0/3382937372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a8102d40 0x7fd4a81009a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 >> 172.21.15.17:0/3382937372 conn(0x7fd4a80fc7a0 msgr2=0x7fd4a80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.600+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 shutdown_connections 2024-09-16T01:01:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.601+0000 7fd4adac0640 1 -- 172.21.15.17:0/3382937372 wait complete. 2024-09-16T01:01:26.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 -- 172.21.15.17:0/3802658688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac10c190 msgr2=0x7f56ac10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 --2- 172.21.15.17:0/3802658688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac10c190 0x7f56ac10e600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009ca0 tx=0x7f56a402a950 comp rx=0 tx=0).stop 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 -- 172.21.15.17:0/3802658688 shutdown_connections 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 --2- 172.21.15.17:0/3802658688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac10c190 0x7f56ac10e600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 --2- 172.21.15.17:0/3802658688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac103710 0x7f56ac10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 --2- 172.21.15.17:0/3802658688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac102df0 0x7f56ac1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 -- 172.21.15.17:0/3802658688 >> 172.21.15.17:0/3802658688 conn(0x7f56ac0fc790 msgr2=0x7f56ac0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 -- 172.21.15.17:0/3802658688 shutdown_connections 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 -- 172.21.15.17:0/3802658688 wait complete. 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.624+0000 7f56b1344640 1 Processor -- start 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 -- start start 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac102df0 0x7f56ac100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac10c190 0x7f56ac1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac111e40 con 0x7f56ac103710 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac111cc0 con 0x7f56ac10c190 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56b1344640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac111fc0 con 0x7f56ac102df0 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44704/0 (socket says 172.21.15.17:44704) 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 -- 172.21.15.17:0/2312235307 learned_addr learned my addr 172.21.15.17:0/2312235307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aaffd640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac102df0 0x7f56ac100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56ab7fe640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac10c190 0x7f56ac1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 -- 172.21.15.17:0/2312235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac102df0 msgr2=0x7f56ac100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac102df0 0x7f56ac100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 -- 172.21.15.17:0/2312235307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac10c190 msgr2=0x7f56ac1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac10c190 0x7f56ac1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.625+0000 7f56aa7fc640 1 -- 172.21.15.17:0/2312235307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac1a6820 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f56aa7fc640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d770 tx=0x7f56a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0017070 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac198120 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56a00054d0 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004cf0 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.626+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac198660 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.627+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac1031d0 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.628+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f56a0004e90 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.629+0000 7f5693fff640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 0x7f56940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.629+0000 7f56aaffd640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 0x7f56940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.629+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f56a00cf1b0 con 0x7f56ac103710 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.630+0000 7f56aaffd640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 0x7f56940a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f569c0095f0 tx=0x7f569c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:26.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.633+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56a009b8d0 con 0x7f56ac103710 2024-09-16T01:01:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.812+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f56ac107270 con 0x7f56ac103710 2024-09-16T01:01:26.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-16T01:01:26.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:26.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:26.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:26.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:26.814 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:26 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3382937372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.813+0000 7f5693fff640 1 -- 172.21.15.17:0/2312235307 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56a009fbd0 con 0x7f56ac103710 2024-09-16T01:01:26.814 INFO:teuthology.orchestra.run.smithi017.stdout:77309411399 2024-09-16T01:01:26.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 msgr2=0x7f56940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 0x7f56940a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f569c0095f0 tx=0x7f569c005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 msgr2=0x7f56ac100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d770 tx=0x7f56a000dc30 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 shutdown_connections 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f56940a3350 0x7f56940a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ac10c190 0x7f56ac1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac103710 0x7f56ac100f90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 --2- 172.21.15.17:0/2312235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56ac102df0 0x7f56ac100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 >> 172.21.15.17:0/2312235307 conn(0x7f56ac0fc790 msgr2=0x7f56ac0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 shutdown_connections 2024-09-16T01:01:26.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:26.815+0000 7f56b1344640 1 -- 172.21.15.17:0/2312235307 wait complete. 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:26 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3382937372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:01:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-16T01:01:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:27.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:26 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3382937372' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- 172.21.15.17:0/2295084082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102570 msgr2=0x7f163c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 --2- 172.21.15.17:0/2295084082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102570 0x7f163c1029b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1630009900 tx=0x7f163002a480 comp rx=0 tx=0).stop 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- 172.21.15.17:0/2295084082 shutdown_connections 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 --2- 172.21.15.17:0/2295084082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102ef0 0x7f163c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 --2- 172.21.15.17:0/2295084082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102570 0x7f163c1029b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 --2- 172.21.15.17:0/2295084082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- 172.21.15.17:0/2295084082 >> 172.21.15.17:0/2295084082 conn(0x7f163c0fc7d0 msgr2=0x7f163c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- 172.21.15.17:0/2295084082 shutdown_connections 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- 172.21.15.17:0/2295084082 wait complete. 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 Processor -- start 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.309+0000 7f164242b640 1 -- start start 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102570 0x7f163c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f163c110e00 con 0x7f163c102ef0 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f163c110c80 con 0x7f163c100e20 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f164242b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f163c110f80 con 0x7f163c102570 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44720/0 (socket says 172.21.15.17:44720) 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 -- 172.21.15.17:0/341539198 learned_addr learned my addr 172.21.15.17:0/341539198 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f163b7fe640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102570 0x7f163c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f163bfff640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 -- 172.21.15.17:0/341539198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102570 msgr2=0x7f163c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102570 0x7f163c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 -- 172.21.15.17:0/341539198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 msgr2=0x7f163c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f16409c8640 1 -- 172.21.15.17:0/341539198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c1a4870 con 0x7f163c102ef0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.310+0000 7f163bfff640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f16409c8640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f163400eaa0 tx=0x7f163400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163400cdb0 con 0x7f163c102ef0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163c1a4a40 con 0x7f163c102ef0 2024-09-16T01:01:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1634005020 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16340116d0 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.311+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163c1a4f00 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.312+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163c1021b0 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.313+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f16340051d0 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.314+0000 7f16397fa640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 0x7f16240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.314+0000 7f163bfff640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 0x7f16240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.314+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f16340cfed0 con 0x7f163c102ef0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.314+0000 7f163bfff640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 0x7f16240a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f162c0058c0 tx=0x7f162c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.317+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1634016030 con 0x7f163c102ef0 2024-09-16T01:01:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- 172.21.15.17:0/334093986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c106a80 msgr2=0x7f7c4c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/334093986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c106a80 0x7f7c4c106e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7c480099b0 tx=0x7f7c4802c650 comp rx=0 tx=0).stop 2024-09-16T01:01:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- 172.21.15.17:0/334093986 shutdown_connections 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/334093986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c101420 0x7f7c4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/334093986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c100a80 0x7f7c4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/334093986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c106a80 0x7f7c4c106e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- 172.21.15.17:0/334093986 >> 172.21.15.17:0/334093986 conn(0x7f7c4c0fc7a0 msgr2=0x7f7c4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- 172.21.15.17:0/334093986 shutdown_connections 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- 172.21.15.17:0/334093986 wait complete. 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 Processor -- start 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.305+0000 7f7c53c4a640 1 -- start start 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 0x7f7c4c1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 0x7f7c4c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10fc20 con 0x7f7c4c100a80 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10faa0 con 0x7f7c4c106a80 2024-09-16T01:01:27.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c53c4a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10fda0 con 0x7f7c4c101420 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44652/0 (socket says 172.21.15.17:44652) 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 -- 172.21.15.17:0/3533187552 learned_addr learned my addr 172.21.15.17:0/3533187552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c511e5640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 0x7f7c4c1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c521e7640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 0x7f7c4c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.459 INFO:teuthology.orchestra.run.smithi017.stdout:266287972386 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 -- 172.21.15.17:0/3533187552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 msgr2=0x7f7c4c1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 0x7f7c4c1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 -- 172.21.15.17:0/3533187552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 msgr2=0x7f7c4c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 0x7f7c4c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 -- 172.21.15.17:0/3533187552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c19b150 con 0x7f7c4c100a80 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c521e7640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 0x7f7c4c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c511e5640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 0x7f7c4c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c519e6640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c48004770 tx=0x7f7c480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.306+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48041070 con 0x7f7c4c100a80 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.307+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c4803d460 con 0x7f7c4c100a80 2024-09-16T01:01:27.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.307+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c19b3e0 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.307+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48037070 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.307+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a2d20 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.308+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c100ee0 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.309+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7c4803d610 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.310+0000 7f7c42ffd640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 0x7f7c380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.310+0000 7f7c511e5640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 0x7f7c380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.310+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7c480f2030 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.310+0000 7f7c511e5640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 0x7f7c380a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0058c0 tx=0x7f7c3c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.313+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c480beda0 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.513+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7c4c109020 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.514+0000 7f7c42ffd640 1 -- 172.21.15.17:0/3533187552 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7c480be6a0 con 0x7f7c4c100a80 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 msgr2=0x7f7c380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 0x7f7c380a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0058c0 tx=0x7f7c3c005850 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 msgr2=0x7f7c4c1961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c48004770 tx=0x7f7c480042f0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 shutdown_connections 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f7c380a32d0 0x7f7c380a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c4c106a80 0x7f7c4c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c4c101420 0x7f7c4c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 --2- 172.21.15.17:0/3533187552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c100a80 0x7f7c4c1961a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.516+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 >> 172.21.15.17:0/3533187552 conn(0x7f7c4c0fc7a0 msgr2=0x7f7c4c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.517+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 shutdown_connections 2024-09-16T01:01:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:23.517+0000 7f7c53c4a640 1 -- 172.21.15.17:0/3533187552 wait complete. 2024-09-16T01:01:27.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.496+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f163c101200 con 0x7f163c102ef0 2024-09-16T01:01:27.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.497+0000 7f16397fa640 1 -- 172.21.15.17:0/341539198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f163c101200 con 0x7f163c102ef0 2024-09-16T01:01:27.497 INFO:teuthology.orchestra.run.smithi017.stdout:206158430253 2024-09-16T01:01:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 msgr2=0x7f16240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 0x7f16240a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f162c0058c0 tx=0x7f162c005850 comp rx=0 tx=0).stop 2024-09-16T01:01:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 msgr2=0x7f163c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f163400eaa0 tx=0x7f163400ef60 comp rx=0 tx=0).stop 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 shutdown_connections 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f16240a32d0 0x7f16240a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f163c102ef0 0x7f163c1a4330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163c102570 0x7f163c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 --2- 172.21.15.17:0/341539198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f163c100e20 0x7f163c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 >> 172.21.15.17:0/341539198 conn(0x7f163c0fc7d0 msgr2=0x7f163c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 shutdown_connections 2024-09-16T01:01:27.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:27.499+0000 7f164242b640 1 -- 172.21.15.17:0/341539198 wait complete. 2024-09-16T01:01:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:27 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2312235307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:01:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:27 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/341539198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:01:28.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:27 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2312235307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:01:28.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:27 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/341539198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:01:28.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:27 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2312235307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:01:28.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:27 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/341539198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:01:28.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411399 for osd.2 2024-09-16T01:01:28.314 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:28.476 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:28.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:28 smithi017 ceph-mon[31211]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-16T01:01:28.878 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972383 got 266287972386 for osd.9 2024-09-16T01:01:28.879 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:29.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:28 smithi088 ceph-mon[34093]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-16T01:01:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:28 smithi154 ceph-mon[34759]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-16T01:01:29.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808860 got 287762808861 for osd.10 2024-09-16T01:01:29.367 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.532+0000 7f8e0ce66640 1 -- 172.21.15.17:0/2879790748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08102790 msgr2=0x7f8e081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.532+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/2879790748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08102790 0x7f8e081067e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009900 tx=0x7f8dfc02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 -- 172.21.15.17:0/2879790748 shutdown_connections 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/2879790748 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/2879790748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08102790 0x7f8e081067e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/2879790748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08101de0 0x7f8e081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 -- 172.21.15.17:0/2879790748 >> 172.21.15.17:0/2879790748 conn(0x7f8e080fd8c0 msgr2=0x7f8e080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 -- 172.21.15.17:0/2879790748 shutdown_connections 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 -- 172.21.15.17:0/2879790748 wait complete. 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.533+0000 7f8e0ce66640 1 Processor -- start 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 -- start start 2024-09-16T01:01:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08102790 0x7f8e081988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08111e20 con 0x7f8e08101de0 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08111ca0 con 0x7f8e08106f10 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0ce66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e08111fa0 con 0x7f8e08102790 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44742/0 (socket says 172.21.15.17:44742) 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 -- 172.21.15.17:0/1519513230 learned_addr learned my addr 172.21.15.17:0/1519513230 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e05d9b640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08102790 0x7f8e081988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e06d9d640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 -- 172.21.15.17:0/1519513230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08102790 msgr2=0x7f8e081988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08102790 0x7f8e081988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 -- 172.21.15.17:0/1519513230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 msgr2=0x7f8e0819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 -- 172.21.15.17:0/1519513230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0819d350 con 0x7f8e08101de0 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e06d9d640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.534+0000 7f8e0659c640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9f0 tx=0x7f8df800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.535+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df800cd80 con 0x7f8e08101de0 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.535+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8df80054d0 con 0x7f8e08101de0 2024-09-16T01:01:29.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.535+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0819d640 con 0x7f8e08101de0 2024-09-16T01:01:29.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.535+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8010490 con 0x7f8e08101de0 2024-09-16T01:01:29.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.535+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e081a4f20 con 0x7f8e08101de0 2024-09-16T01:01:29.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.536+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e081021c0 con 0x7f8e08101de0 2024-09-16T01:01:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.537+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8df8005020 con 0x7f8e08101de0 2024-09-16T01:01:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.538+0000 7f8df77fe640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 0x7f8df00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.538+0000 7f8e05d9b640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 0x7f8df00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.538+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8df80cfd00 con 0x7f8e08101de0 2024-09-16T01:01:29.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.538+0000 7f8e05d9b640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 0x7f8df00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc031440 tx=0x7f8dfc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:29.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.542+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8df80d3030 con 0x7f8e08101de0 2024-09-16T01:01:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.719+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f8e0810a150 con 0x7f8e08101de0 2024-09-16T01:01:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.720+0000 7f8df77fe640 1 -- 172.21.15.17:0/1519513230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8df809ca70 con 0x7f8e08101de0 2024-09-16T01:01:29.721 INFO:teuthology.orchestra.run.smithi017.stdout:317827579930 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 msgr2=0x7f8df00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 0x7f8df00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc031440 tx=0x7f8dfc005b50 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 msgr2=0x7f8e081983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9f0 tx=0x7f8df800edf0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 shutdown_connections 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8df00a32d0 0x7f8df00a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e08106f10 0x7f8e0819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e08102790 0x7f8e081988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 --2- 172.21.15.17:0/1519513230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e08101de0 0x7f8e081983a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 >> 172.21.15.17:0/1519513230 conn(0x7f8e080fd8c0 msgr2=0x7f8e080fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 shutdown_connections 2024-09-16T01:01:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:29.722+0000 7f8e0ce66640 1 -- 172.21.15.17:0/1519513230 wait complete. 2024-09-16T01:01:30.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430250 got 206158430253 for osd.7 2024-09-16T01:01:30.412 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:30.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579927 got 317827579930 for osd.11 2024-09-16T01:01:30.854 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:30.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:30 smithi017 ceph-mon[31211]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-16T01:01:30.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:30 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1519513230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:01:31.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:30 smithi088 ceph-mon[34093]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-16T01:01:31.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:30 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1519513230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:01:31.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:30 smithi154 ceph-mon[34759]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-16T01:01:31.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:30 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1519513230' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 -- 172.21.15.17:0/1399397569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20102d40 msgr2=0x7f5e20103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 --2- 172.21.15.17:0/1399397569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20102d40 0x7f5e20103120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e1002a480 comp rx=0 tx=0).stop 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 -- 172.21.15.17:0/1399397569 shutdown_connections 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 --2- 172.21.15.17:0/1399397569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e2010c170 0x7f5e2010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 --2- 172.21.15.17:0/1399397569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e20103660 0x7f5e2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 --2- 172.21.15.17:0/1399397569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20102d40 0x7f5e20103120 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 -- 172.21.15.17:0/1399397569 >> 172.21.15.17:0/1399397569 conn(0x7f5e200fc7a0 msgr2=0x7f5e200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 -- 172.21.15.17:0/1399397569 shutdown_connections 2024-09-16T01:01:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.270+0000 7f5e26922640 1 -- 172.21.15.17:0/1399397569 wait complete. 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 Processor -- start 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 -- start start 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e20102d40 0x7f5e201983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 0x7f5e2019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5e20111e60 con 0x7f5e20103660 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e20111ce0 con 0x7f5e2010c170 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e26922640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e20111fe0 con 0x7f5e20102d40 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43558/0 (socket says 172.21.15.17:43558) 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.271+0000 7f5e17fff640 1 -- 172.21.15.17:0/3059555884 learned_addr learned my addr 172.21.15.17:0/3059555884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e24ebf640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 0x7f5e2019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e1ffff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e20102d40 0x7f5e201983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 -- 172.21.15.17:0/3059555884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e20102d40 msgr2=0x7f5e201983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e20102d40 0x7f5e201983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 -- 172.21.15.17:0/3059555884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 msgr2=0x7f5e2019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 0x7f5e2019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 -- 172.21.15.17:0/3059555884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2019d390 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e24ebf640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 0x7f5e2019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e17fff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800d740 tx=0x7f5e0800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08017070 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e0800de50 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2019d680 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800f620 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.272+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e201a4f60 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.273+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e20103120 con 0x7f5e20103660 2024-09-16T01:01:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.274+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5e08009c30 con 0x7f5e20103660 2024-09-16T01:01:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.275+0000 7f5e1dffb640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 0x7f5e0c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.275+0000 7f5e1ffff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 0x7f5e0c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.275+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5e080cf5d0 con 0x7f5e20103660 2024-09-16T01:01:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.275+0000 7f5e1ffff640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 0x7f5e0c0a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006010 tx=0x7f5e10000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.279+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e0809c240 con 0x7f5e20103660 2024-09-16T01:01:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.477+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5e20106c80 con 0x7f5e20103660 2024-09-16T01:01:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.477+0000 7f5e1dffb640 1 -- 172.21.15.17:0/3059555884 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e0809bb40 con 0x7f5e20103660 2024-09-16T01:01:31.477 INFO:teuthology.orchestra.run.smithi017.stdout:55834574924 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 msgr2=0x7f5e0c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 0x7f5e0c0a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006010 tx=0x7f5e10000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 msgr2=0x7f5e20198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800d740 tx=0x7f5e0800dc00 comp rx=0 tx=0).stop 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 shutdown_connections 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f5e0c0a3350 0x7f5e0c0a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e2010c170 0x7f5e2019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e20103660 0x7f5e20198920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 --2- 172.21.15.17:0/3059555884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e20102d40 0x7f5e201983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 >> 172.21.15.17:0/3059555884 conn(0x7f5e200fc7a0 msgr2=0x7f5e200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 shutdown_connections 2024-09-16T01:01:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:31.479+0000 7f5e26922640 1 -- 172.21.15.17:0/3059555884 wait complete. 2024-09-16T01:01:31.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:31 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3059555884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:01:32.136 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574924 for osd.1 2024-09-16T01:01:32.136 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:32.136 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:01:32.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:01:32.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:31 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3059555884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:01:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:31 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3059555884' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:01:32.862 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:32.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:32 smithi017 ceph-mon[31211]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:01:33.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:32 smithi088 ceph-mon[34093]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:01:33.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:32 smithi154 ceph-mon[34759]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-16T01:01:33.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 -- 172.21.15.17:0/99985183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 msgr2=0x7f9dd010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/99985183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd010ea90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009ca0 tx=0x7f9dc802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 -- 172.21.15.17:0/99985183 shutdown_connections 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/99985183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd010ea90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/99985183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/99985183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 0x7f9dd01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 -- 172.21.15.17:0/99985183 >> 172.21.15.17:0/99985183 conn(0x7f9dd00fd8c0 msgr2=0x7f9dd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 -- 172.21.15.17:0/99985183 shutdown_connections 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.338+0000 7f9dd66e1640 1 -- 172.21.15.17:0/99985183 wait complete. 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 Processor -- start 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 -- start start 2024-09-16T01:01:33.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 0x7f9dd019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0111e40 con 0x7f9dd0106f10 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0111cc0 con 0x7f9dd0101de0 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd66e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0111fc0 con 0x7f9dd0102790 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd4c7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd4c7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43574/0 (socket says 172.21.15.17:43574) 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dd4c7e640 1 -- 172.21.15.17:0/3468178500 learned_addr learned my addr 172.21.15.17:0/3468178500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dcffff640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 0x7f9dd019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.339+0000 7f9dcf7fe640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 -- 172.21.15.17:0/3468178500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 msgr2=0x7f9dd019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 -- 172.21.15.17:0/3468178500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 msgr2=0x7f9dd019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 0x7f9dd019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 -- 172.21.15.17:0/3468178500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd019f5b0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dcf7fe640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd4c7e640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009dc0 tx=0x7f9dc8032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8003cf0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9dc80044f0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd019f840 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8030bf0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.340+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01a7180 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.341+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd01021c0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.343+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9dc8004040 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.344+0000 7f9dcd7fa640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 0x7f9db80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.344+0000 7f9dcffff640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 0x7f9db80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.344+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9dc80f0fe0 con 0x7f9dd0106f10 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.344+0000 7f9dcffff640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 0x7f9db80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000bbe0 tx=0x7f9dc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.347+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dc80bde60 con 0x7f9dd0106f10 2024-09-16T01:01:33.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.548+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dd0075430 con 0x7f9db80a32d0 2024-09-16T01:01:33.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.555+0000 7f9dcd7fa640 1 -- 172.21.15.17:0/3468178500 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258868 (secure 0 0 0) 0x7f9dd0075430 con 0x7f9db80a32d0 2024-09-16T01:01:33.558 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:33.559 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 msgr2=0x7f9db80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 0x7f9db80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000bbe0 tx=0x7f9dc000b390 comp rx=0 tx=0).stop 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 msgr2=0x7f9dd019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009dc0 tx=0x7f9dc8032ff0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 shutdown_connections 2024-09-16T01:01:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f9db80a32d0 0x7f9db80a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0106f10 0x7f9dd019eed0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd0102790 0x7f9dd019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 --2- 172.21.15.17:0/3468178500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dd0101de0 0x7f9dd019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 >> 172.21.15.17:0/3468178500 conn(0x7f9dd00fd8c0 msgr2=0x7f9dd00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 shutdown_connections 2024-09-16T01:01:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:33.558+0000 7f9dd66e1640 1 -- 172.21.15.17:0/3468178500 wait complete. 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-16T01:01:33.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:33 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-16T01:01:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:33 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-16T01:01:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-16T01:01:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-16T01:01:34.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:33 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-16T01:01:34.315 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-16T01:01:32.930106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658360,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":689,"num_read_kb":471,"num_write":427,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376688,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565136,"statfs":{"total":1151940427776,"available":1151554699264,"internally_reserved":0,"allocated":11059200,"data_stored":6968112,"data_compressed":108792,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":67,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003466"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451354+0000","last_change":"2024-09-16T01:00:28.449298+0000","last_active":"2024-09-16T01:00:29.451354+0000","last_peered":"2024-09-16T01:00:29.451354+0000","last_clean":"2024-09-16T01:00:29.451354+0000","last_became_active":"2024-09-16T01:00:28.448925+0000","last_became_peered":"2024-09-16T01:00:28.448925+0000","last_unstale":"2024-09-16T01:00:29.451354+0000","last_undegraded":"2024-09-16T01:00:29.451354+0000","last_fullsized":"2024-09-16T01:00:29.451354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:54.432714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447088+0000","last_change":"2024-09-16T01:00:28.440068+0000","last_active":"2024-09-16T01:00:29.447088+0000","last_peered":"2024-09-16T01:00:29.447088+0000","last_clean":"2024-09-16T01:00:29.447088+0000","last_became_active":"2024-09-16T01:00:28.439730+0000","last_became_peered":"2024-09-16T01:00:28.439730+0000","last_unstale":"2024-09-16T01:00:29.447088+0000","last_undegraded":"2024-09-16T01:00:29.447088+0000","last_fullsized":"2024-09-16T01:00:29.447088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.021941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447237+0000","last_change":"2024-09-16T01:00:28.451754+0000","last_active":"2024-09-16T01:00:29.447237+0000","last_peered":"2024-09-16T01:00:29.447237+0000","last_clean":"2024-09-16T01:00:29.447237+0000","last_became_active":"2024-09-16T01:00:28.451418+0000","last_became_peered":"2024-09-16T01:00:28.451418+0000","last_unstale":"2024-09-16T01:00:29.447237+0000","last_undegraded":"2024-09-16T01:00:29.447237+0000","last_fullsized":"2024-09-16T01:00:29.447237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:10.383137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446778+0000","last_change":"2024-09-16T01:00:28.451256+0000","last_active":"2024-09-16T01:00:29.446778+0000","last_peered":"2024-09-16T01:00:29.446778+0000","last_clean":"2024-09-16T01:00:29.446778+0000","last_became_active":"2024-09-16T01:00:28.450929+0000","last_became_peered":"2024-09-16T01:00:28.450929+0000","last_unstale":"2024-09-16T01:00:29.446778+0000","last_undegraded":"2024-09-16T01:00:29.446778+0000","last_fullsized":"2024-09-16T01:00:29.446778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446924+0000","last_change":"2024-09-16T01:00:28.436789+0000","last_active":"2024-09-16T01:00:29.446924+0000","last_peered":"2024-09-16T01:00:29.446924+0000","last_clean":"2024-09-16T01:00:29.446924+0000","last_became_active":"2024-09-16T01:00:28.436386+0000","last_became_peered":"2024-09-16T01:00:28.436386+0000","last_unstale":"2024-09-16T01:00:29.446924+0000","last_undegraded":"2024-09-16T01:00:29.446924+0000","last_fullsized":"2024-09-16T01:00:29.446924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:07.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446537+0000","last_change":"2024-09-16T01:00:28.449819+0000","last_active":"2024-09-16T01:00:29.446537+0000","last_peered":"2024-09-16T01:00:29.446537+0000","last_clean":"2024-09-16T01:00:29.446537+0000","last_became_active":"2024-09-16T01:00:28.449474+0000","last_became_peered":"2024-09-16T01:00:28.449474+0000","last_unstale":"2024-09-16T01:00:29.446537+0000","last_undegraded":"2024-09-16T01:00:29.446537+0000","last_fullsized":"2024-09-16T01:00:29.446537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:21.879279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447035+0000","last_change":"2024-09-16T01:00:28.442449+0000","last_active":"2024-09-16T01:00:29.447035+0000","last_peered":"2024-09-16T01:00:29.447035+0000","last_clean":"2024-09-16T01:00:29.447035+0000","last_became_active":"2024-09-16T01:00:28.442087+0000","last_became_peered":"2024-09-16T01:00:28.442087+0000","last_unstale":"2024-09-16T01:00:29.447035+0000","last_undegraded":"2024-09-16T01:00:29.447035+0000","last_fullsized":"2024-09-16T01:00:29.447035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:01.996570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430109+0000","last_change":"2024-09-16T01:00:28.443923+0000","last_active":"2024-09-16T01:00:29.430109+0000","last_peered":"2024-09-16T01:00:29.430109+0000","last_clean":"2024-09-16T01:00:29.430109+0000","last_became_active":"2024-09-16T01:00:28.443598+0000","last_became_peered":"2024-09-16T01:00:28.443598+0000","last_unstale":"2024-09-16T01:00:29.430109+0000","last_undegraded":"2024-09-16T01:00:29.430109+0000","last_fullsized":"2024-09-16T01:00:29.430109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:55.479224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431754+0000","last_change":"2024-09-16T01:00:28.451668+0000","last_active":"2024-09-16T01:00:29.431754+0000","last_peered":"2024-09-16T01:00:29.431754+0000","last_clean":"2024-09-16T01:00:29.431754+0000","last_became_active":"2024-09-16T01:00:28.451360+0000","last_became_peered":"2024-09-16T01:00:28.451360+0000","last_unstale":"2024-09-16T01:00:29.431754+0000","last_undegraded":"2024-09-16T01:00:29.431754+0000","last_fullsized":"2024-09-16T01:00:29.431754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:32.969507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446207+0000","last_change":"2024-09-16T01:00:28.450791+0000","last_active":"2024-09-16T01:00:29.446207+0000","last_peered":"2024-09-16T01:00:29.446207+0000","last_clean":"2024-09-16T01:00:29.446207+0000","last_became_active":"2024-09-16T01:00:28.450408+0000","last_became_peered":"2024-09-16T01:00:28.450408+0000","last_unstale":"2024-09-16T01:00:29.446207+0000","last_undegraded":"2024-09-16T01:00:29.446207+0000","last_fullsized":"2024-09-16T01:00:29.446207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:31.301796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446779+0000","last_change":"2024-09-16T01:00:28.446736+0000","last_active":"2024-09-16T01:00:29.446779+0000","last_peered":"2024-09-16T01:00:29.446779+0000","last_clean":"2024-09-16T01:00:29.446779+0000","last_became_active":"2024-09-16T01:00:28.446201+0000","last_became_peered":"2024-09-16T01:00:28.446201+0000","last_unstale":"2024-09-16T01:00:29.446779+0000","last_undegraded":"2024-09-16T01:00:29.446779+0000","last_fullsized":"2024-09-16T01:00:29.446779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:50.274171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.452266+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.451927+0000","last_became_peered":"2024-09-16T01:00:28.451927+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:10.361046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446281+0000","last_change":"2024-09-16T01:00:28.440957+0000","last_active":"2024-09-16T01:00:29.446281+0000","last_peered":"2024-09-16T01:00:29.446281+0000","last_clean":"2024-09-16T01:00:29.446281+0000","last_became_active":"2024-09-16T01:00:28.440653+0000","last_became_peered":"2024-09-16T01:00:28.440653+0000","last_unstale":"2024-09-16T01:00:29.446281+0000","last_undegraded":"2024-09-16T01:00:29.446281+0000","last_fullsized":"2024-09-16T01:00:29.446281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:15.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446856+0000","last_change":"2024-09-16T01:00:28.443914+0000","last_active":"2024-09-16T01:00:29.446856+0000","last_peered":"2024-09-16T01:00:29.446856+0000","last_clean":"2024-09-16T01:00:29.446856+0000","last_became_active":"2024-09-16T01:00:28.443600+0000","last_became_peered":"2024-09-16T01:00:28.443600+0000","last_unstale":"2024-09-16T01:00:29.446856+0000","last_undegraded":"2024-09-16T01:00:29.446856+0000","last_fullsized":"2024-09-16T01:00:29.446856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:35.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446638+0000","last_change":"2024-09-16T01:00:28.449970+0000","last_active":"2024-09-16T01:00:29.446638+0000","last_peered":"2024-09-16T01:00:29.446638+0000","last_clean":"2024-09-16T01:00:29.446638+0000","last_became_active":"2024-09-16T01:00:28.449464+0000","last_became_peered":"2024-09-16T01:00:28.449464+0000","last_unstale":"2024-09-16T01:00:29.446638+0000","last_undegraded":"2024-09-16T01:00:29.446638+0000","last_fullsized":"2024-09-16T01:00:29.446638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:01.537338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431182+0000","last_change":"2024-09-16T01:00:28.445004+0000","last_active":"2024-09-16T01:00:29.431182+0000","last_peered":"2024-09-16T01:00:29.431182+0000","last_clean":"2024-09-16T01:00:29.431182+0000","last_became_active":"2024-09-16T01:00:28.444503+0000","last_became_peered":"2024-09-16T01:00:28.444503+0000","last_unstale":"2024-09-16T01:00:29.431182+0000","last_undegraded":"2024-09-16T01:00:29.431182+0000","last_fullsized":"2024-09-16T01:00:29.431182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:05.330992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451229+0000","last_change":"2024-09-16T01:00:28.451975+0000","last_active":"2024-09-16T01:00:29.451229+0000","last_peered":"2024-09-16T01:00:29.451229+0000","last_clean":"2024-09-16T01:00:29.451229+0000","last_became_active":"2024-09-16T01:00:28.451582+0000","last_became_peered":"2024-09-16T01:00:28.451582+0000","last_unstale":"2024-09-16T01:00:29.451229+0000","last_undegraded":"2024-09-16T01:00:29.451229+0000","last_fullsized":"2024-09-16T01:00:29.451229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.032697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446326+0000","last_change":"2024-09-16T01:00:28.439491+0000","last_active":"2024-09-16T01:00:29.446326+0000","last_peered":"2024-09-16T01:00:29.446326+0000","last_clean":"2024-09-16T01:00:29.446326+0000","last_became_active":"2024-09-16T01:00:28.439130+0000","last_became_peered":"2024-09-16T01:00:28.439130+0000","last_unstale":"2024-09-16T01:00:29.446326+0000","last_undegraded":"2024-09-16T01:00:29.446326+0000","last_fullsized":"2024-09-16T01:00:29.446326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:33.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446504+0000","last_change":"2024-09-16T01:00:28.448537+0000","last_active":"2024-09-16T01:00:29.446504+0000","last_peered":"2024-09-16T01:00:29.446504+0000","last_clean":"2024-09-16T01:00:29.446504+0000","last_became_active":"2024-09-16T01:00:28.448146+0000","last_became_peered":"2024-09-16T01:00:28.448146+0000","last_unstale":"2024-09-16T01:00:29.446504+0000","last_undegraded":"2024-09-16T01:00:29.446504+0000","last_fullsized":"2024-09-16T01:00:29.446504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:58.466156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450747+0000","last_change":"2024-09-16T01:00:28.452877+0000","last_active":"2024-09-16T01:00:29.450747+0000","last_peered":"2024-09-16T01:00:29.450747+0000","last_clean":"2024-09-16T01:00:29.450747+0000","last_became_active":"2024-09-16T01:00:28.452542+0000","last_became_peered":"2024-09-16T01:00:28.452542+0000","last_unstale":"2024-09-16T01:00:29.450747+0000","last_undegraded":"2024-09-16T01:00:29.450747+0000","last_fullsized":"2024-09-16T01:00:29.450747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:56.337456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446432+0000","last_change":"2024-09-16T01:00:28.442157+0000","last_active":"2024-09-16T01:00:29.446432+0000","last_peered":"2024-09-16T01:00:29.446432+0000","last_clean":"2024-09-16T01:00:29.446432+0000","last_became_active":"2024-09-16T01:00:28.441852+0000","last_became_peered":"2024-09-16T01:00:28.441852+0000","last_unstale":"2024-09-16T01:00:29.446432+0000","last_undegraded":"2024-09-16T01:00:29.446432+0000","last_fullsized":"2024-09-16T01:00:29.446432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:36.503203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431210+0000","last_change":"2024-09-16T01:00:28.443734+0000","last_active":"2024-09-16T01:00:29.431210+0000","last_peered":"2024-09-16T01:00:29.431210+0000","last_clean":"2024-09-16T01:00:29.431210+0000","last_became_active":"2024-09-16T01:00:28.443287+0000","last_became_peered":"2024-09-16T01:00:28.443287+0000","last_unstale":"2024-09-16T01:00:29.431210+0000","last_undegraded":"2024-09-16T01:00:29.431210+0000","last_fullsized":"2024-09-16T01:00:29.431210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:12.920159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430171+0000","last_change":"2024-09-16T01:00:28.448425+0000","last_active":"2024-09-16T01:00:29.430171+0000","last_peered":"2024-09-16T01:00:29.430171+0000","last_clean":"2024-09-16T01:00:29.430171+0000","last_became_active":"2024-09-16T01:00:28.448109+0000","last_became_peered":"2024-09-16T01:00:28.448109+0000","last_unstale":"2024-09-16T01:00:29.430171+0000","last_undegraded":"2024-09-16T01:00:29.430171+0000","last_fullsized":"2024-09-16T01:00:29.430171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:22.671812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434004+0000","last_change":"2024-09-16T01:00:28.446417+0000","last_active":"2024-09-16T01:00:29.434004+0000","last_peered":"2024-09-16T01:00:29.434004+0000","last_clean":"2024-09-16T01:00:29.434004+0000","last_became_active":"2024-09-16T01:00:28.445919+0000","last_became_peered":"2024-09-16T01:00:28.445919+0000","last_unstale":"2024-09-16T01:00:29.434004+0000","last_undegraded":"2024-09-16T01:00:29.434004+0000","last_fullsized":"2024-09-16T01:00:29.434004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:11.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430471+0000","last_change":"2024-09-16T01:00:28.451072+0000","last_active":"2024-09-16T01:00:29.430471+0000","last_peered":"2024-09-16T01:00:29.430471+0000","last_clean":"2024-09-16T01:00:29.430471+0000","last_became_active":"2024-09-16T01:00:28.450760+0000","last_became_peered":"2024-09-16T01:00:28.450760+0000","last_unstale":"2024-09-16T01:00:29.430471+0000","last_undegraded":"2024-09-16T01:00:29.430471+0000","last_fullsized":"2024-09-16T01:00:29.430471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:24.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446272+0000","last_change":"2024-09-16T01:00:28.445776+0000","last_active":"2024-09-16T01:00:29.446272+0000","last_peered":"2024-09-16T01:00:29.446272+0000","last_clean":"2024-09-16T01:00:29.446272+0000","last_became_active":"2024-09-16T01:00:28.445456+0000","last_became_peered":"2024-09-16T01:00:28.445456+0000","last_unstale":"2024-09-16T01:00:29.446272+0000","last_undegraded":"2024-09-16T01:00:29.446272+0000","last_fullsized":"2024-09-16T01:00:29.446272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451378+0000","last_change":"2024-09-16T01:00:28.447437+0000","last_active":"2024-09-16T01:00:29.451378+0000","last_peered":"2024-09-16T01:00:29.451378+0000","last_clean":"2024-09-16T01:00:29.451378+0000","last_became_active":"2024-09-16T01:00:28.447108+0000","last_became_peered":"2024-09-16T01:00:28.447108+0000","last_unstale":"2024-09-16T01:00:29.451378+0000","last_undegraded":"2024-09-16T01:00:29.451378+0000","last_fullsized":"2024-09-16T01:00:29.451378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:12.484102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445726+0000","last_change":"2024-09-16T01:00:28.452750+0000","last_active":"2024-09-16T01:00:29.445726+0000","last_peered":"2024-09-16T01:00:29.445726+0000","last_clean":"2024-09-16T01:00:29.445726+0000","last_became_active":"2024-09-16T01:00:28.452382+0000","last_became_peered":"2024-09-16T01:00:28.452382+0000","last_unstale":"2024-09-16T01:00:29.445726+0000","last_undegraded":"2024-09-16T01:00:29.445726+0000","last_fullsized":"2024-09-16T01:00:29.445726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.127201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447646+0000","last_change":"2024-09-16T01:00:28.450220+0000","last_active":"2024-09-16T01:00:29.447646+0000","last_peered":"2024-09-16T01:00:29.447646+0000","last_clean":"2024-09-16T01:00:29.447646+0000","last_became_active":"2024-09-16T01:00:28.449824+0000","last_became_peered":"2024-09-16T01:00:28.449824+0000","last_unstale":"2024-09-16T01:00:29.447646+0000","last_undegraded":"2024-09-16T01:00:29.447646+0000","last_fullsized":"2024-09-16T01:00:29.447646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:08.428729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446478+0000","last_change":"2024-09-16T01:00:28.447282+0000","last_active":"2024-09-16T01:00:29.446478+0000","last_peered":"2024-09-16T01:00:29.446478+0000","last_clean":"2024-09-16T01:00:29.446478+0000","last_became_active":"2024-09-16T01:00:28.446839+0000","last_became_peered":"2024-09-16T01:00:28.446839+0000","last_unstale":"2024-09-16T01:00:29.446478+0000","last_undegraded":"2024-09-16T01:00:29.446478+0000","last_fullsized":"2024-09-16T01:00:29.446478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:33.594170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445915+0000","last_change":"2024-09-16T01:00:28.454019+0000","last_active":"2024-09-16T01:00:29.445915+0000","last_peered":"2024-09-16T01:00:29.445915+0000","last_clean":"2024-09-16T01:00:29.445915+0000","last_became_active":"2024-09-16T01:00:28.453706+0000","last_became_peered":"2024-09-16T01:00:28.453706+0000","last_unstale":"2024-09-16T01:00:29.445915+0000","last_undegraded":"2024-09-16T01:00:29.445915+0000","last_fullsized":"2024-09-16T01:00:29.445915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:09.704344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450704+0000","last_change":"2024-09-16T01:00:28.449323+0000","last_active":"2024-09-16T01:00:29.450704+0000","last_peered":"2024-09-16T01:00:29.450704+0000","last_clean":"2024-09-16T01:00:29.450704+0000","last_became_active":"2024-09-16T01:00:28.448536+0000","last_became_peered":"2024-09-16T01:00:28.448536+0000","last_unstale":"2024-09-16T01:00:29.450704+0000","last_undegraded":"2024-09-16T01:00:29.450704+0000","last_fullsized":"2024-09-16T01:00:29.450704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:11.145663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446668+0000","last_change":"2024-09-16T01:00:28.440882+0000","last_active":"2024-09-16T01:00:29.446668+0000","last_peered":"2024-09-16T01:00:29.446668+0000","last_clean":"2024-09-16T01:00:29.446668+0000","last_became_active":"2024-09-16T01:00:28.440496+0000","last_became_peered":"2024-09-16T01:00:28.440496+0000","last_unstale":"2024-09-16T01:00:29.446668+0000","last_undegraded":"2024-09-16T01:00:29.446668+0000","last_fullsized":"2024-09-16T01:00:29.446668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:16.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:29.587328+0000","last_change":"2024-09-16T01:00:26.357785+0000","last_active":"2024-09-16T01:01:29.587328+0000","last_peered":"2024-09-16T01:01:29.587328+0000","last_clean":"2024-09-16T01:01:29.587328+0000","last_became_active":"2024-09-16T01:00:26.357450+0000","last_became_peered":"2024-09-16T01:00:26.357450+0000","last_unstale":"2024-09-16T01:01:29.587328+0000","last_undegraded":"2024-09-16T01:01:29.587328+0000","last_fullsized":"2024-09-16T01:01:29.587328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.778996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433774+0000","last_change":"2024-09-16T01:00:28.454416+0000","last_active":"2024-09-16T01:00:29.433774+0000","last_peered":"2024-09-16T01:00:29.433774+0000","last_clean":"2024-09-16T01:00:29.433774+0000","last_became_active":"2024-09-16T01:00:28.454117+0000","last_became_peered":"2024-09-16T01:00:28.454117+0000","last_unstale":"2024-09-16T01:00:29.433774+0000","last_undegraded":"2024-09-16T01:00:29.433774+0000","last_fullsized":"2024-09-16T01:00:29.433774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:32.487601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.503539+0000","last_change":"2024-09-16T01:00:26.359828+0000","last_active":"2024-09-16T01:00:38.503539+0000","last_peered":"2024-09-16T01:00:38.503539+0000","last_clean":"2024-09-16T01:00:38.503539+0000","last_became_active":"2024-09-16T01:00:26.359520+0000","last_became_peered":"2024-09-16T01:00:26.359520+0000","last_unstale":"2024-09-16T01:00:38.503539+0000","last_undegraded":"2024-09-16T01:00:38.503539+0000","last_fullsized":"2024-09-16T01:00:38.503539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:14.477791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.493792+0000","last_change":"2024-09-16T01:00:26.353227+0000","last_active":"2024-09-16T01:00:37.493792+0000","last_peered":"2024-09-16T01:00:37.493792+0000","last_clean":"2024-09-16T01:00:37.493792+0000","last_became_active":"2024-09-16T01:00:26.352869+0000","last_became_peered":"2024-09-16T01:00:26.352869+0000","last_unstale":"2024-09-16T01:00:37.493792+0000","last_undegraded":"2024-09-16T01:00:37.493792+0000","last_fullsized":"2024-09-16T01:00:37.493792+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:48.035596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430142+0000","last_change":"2024-09-16T01:00:28.444766+0000","last_active":"2024-09-16T01:00:29.430142+0000","last_peered":"2024-09-16T01:00:29.430142+0000","last_clean":"2024-09-16T01:00:29.430142+0000","last_became_active":"2024-09-16T01:00:28.444450+0000","last_became_peered":"2024-09-16T01:00:28.444450+0000","last_unstale":"2024-09-16T01:00:29.430142+0000","last_undegraded":"2024-09-16T01:00:29.430142+0000","last_fullsized":"2024-09-16T01:00:29.430142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:07.610462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510477+0000","last_change":"2024-09-16T01:00:26.357087+0000","last_active":"2024-09-16T01:00:39.510477+0000","last_peered":"2024-09-16T01:00:39.510477+0000","last_clean":"2024-09-16T01:00:39.510477+0000","last_became_active":"2024-09-16T01:00:26.356758+0000","last_became_peered":"2024-09-16T01:00:26.356758+0000","last_unstale":"2024-09-16T01:00:39.510477+0000","last_undegraded":"2024-09-16T01:00:39.510477+0000","last_fullsized":"2024-09-16T01:00:39.510477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:55.525693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445379+0000","last_change":"2024-09-16T01:00:28.438715+0000","last_active":"2024-09-16T01:00:29.445379+0000","last_peered":"2024-09-16T01:00:29.445379+0000","last_clean":"2024-09-16T01:00:29.445379+0000","last_became_active":"2024-09-16T01:00:28.438380+0000","last_became_peered":"2024-09-16T01:00:28.438380+0000","last_unstale":"2024-09-16T01:00:29.445379+0000","last_undegraded":"2024-09-16T01:00:29.445379+0000","last_fullsized":"2024-09-16T01:00:29.445379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:34.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.587849+0000","last_change":"2024-09-16T01:00:26.359263+0000","last_active":"2024-09-16T01:01:30.587849+0000","last_peered":"2024-09-16T01:01:30.587849+0000","last_clean":"2024-09-16T01:01:30.587849+0000","last_became_active":"2024-09-16T01:00:26.358936+0000","last_became_peered":"2024-09-16T01:00:26.358936+0000","last_unstale":"2024-09-16T01:01:30.587849+0000","last_undegraded":"2024-09-16T01:01:30.587849+0000","last_fullsized":"2024-09-16T01:01:30.587849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:31.125243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431558+0000","last_change":"2024-09-16T01:00:28.445330+0000","last_active":"2024-09-16T01:00:29.431558+0000","last_peered":"2024-09-16T01:00:29.431558+0000","last_clean":"2024-09-16T01:00:29.431558+0000","last_became_active":"2024-09-16T01:00:28.444913+0000","last_became_peered":"2024-09-16T01:00:28.444913+0000","last_unstale":"2024-09-16T01:00:29.431558+0000","last_undegraded":"2024-09-16T01:00:29.431558+0000","last_fullsized":"2024-09-16T01:00:29.431558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:16.583722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509989+0000","last_change":"2024-09-16T01:00:26.356972+0000","last_active":"2024-09-16T01:00:39.509989+0000","last_peered":"2024-09-16T01:00:39.509989+0000","last_clean":"2024-09-16T01:00:39.509989+0000","last_became_active":"2024-09-16T01:00:26.356525+0000","last_became_peered":"2024-09-16T01:00:26.356525+0000","last_unstale":"2024-09-16T01:00:39.509989+0000","last_undegraded":"2024-09-16T01:00:39.509989+0000","last_fullsized":"2024-09-16T01:00:39.509989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:42.908179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447323+0000","last_change":"2024-09-16T01:00:28.449732+0000","last_active":"2024-09-16T01:00:29.447323+0000","last_peered":"2024-09-16T01:00:29.447323+0000","last_clean":"2024-09-16T01:00:29.447323+0000","last_became_active":"2024-09-16T01:00:28.449325+0000","last_became_peered":"2024-09-16T01:00:28.449325+0000","last_unstale":"2024-09-16T01:00:29.447323+0000","last_undegraded":"2024-09-16T01:00:29.447323+0000","last_fullsized":"2024-09-16T01:00:29.447323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:55.370952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502667+0000","last_change":"2024-09-16T01:00:26.746513+0000","last_active":"2024-09-16T01:00:38.502667+0000","last_peered":"2024-09-16T01:00:38.502667+0000","last_clean":"2024-09-16T01:00:38.502667+0000","last_became_active":"2024-09-16T01:00:26.746114+0000","last_became_peered":"2024-09-16T01:00:26.746114+0000","last_unstale":"2024-09-16T01:00:38.502667+0000","last_undegraded":"2024-09-16T01:00:38.502667+0000","last_fullsized":"2024-09-16T01:00:38.502667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431274+0000","last_change":"2024-09-16T01:00:28.452854+0000","last_active":"2024-09-16T01:00:29.431274+0000","last_peered":"2024-09-16T01:00:29.431274+0000","last_clean":"2024-09-16T01:00:29.431274+0000","last_became_active":"2024-09-16T01:00:28.452548+0000","last_became_peered":"2024-09-16T01:00:28.452548+0000","last_unstale":"2024-09-16T01:00:29.431274+0000","last_undegraded":"2024-09-16T01:00:29.431274+0000","last_fullsized":"2024-09-16T01:00:29.431274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:12.527860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.587834+0000","last_change":"2024-09-16T01:00:26.361221+0000","last_active":"2024-09-16T01:01:30.587834+0000","last_peered":"2024-09-16T01:01:30.587834+0000","last_clean":"2024-09-16T01:01:30.587834+0000","last_became_active":"2024-09-16T01:00:26.360785+0000","last_became_peered":"2024-09-16T01:00:26.360785+0000","last_unstale":"2024-09-16T01:01:30.587834+0000","last_undegraded":"2024-09-16T01:01:30.587834+0000","last_fullsized":"2024-09-16T01:01:30.587834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:07.145342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":113,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447395+0000","last_change":"2024-09-16T01:00:28.443905+0000","last_active":"2024-09-16T01:00:29.447395+0000","last_peered":"2024-09-16T01:00:29.447395+0000","last_clean":"2024-09-16T01:00:29.447395+0000","last_became_active":"2024-09-16T01:00:28.442808+0000","last_became_peered":"2024-09-16T01:00:28.442808+0000","last_unstale":"2024-09-16T01:00:29.447395+0000","last_undegraded":"2024-09-16T01:00:29.447395+0000","last_fullsized":"2024-09-16T01:00:29.447395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.513028+0000","last_change":"2024-09-16T01:00:26.358696+0000","last_active":"2024-09-16T01:00:40.513028+0000","last_peered":"2024-09-16T01:00:40.513028+0000","last_clean":"2024-09-16T01:00:40.513028+0000","last_became_active":"2024-09-16T01:00:26.358306+0000","last_became_peered":"2024-09-16T01:00:26.358306+0000","last_unstale":"2024-09-16T01:00:40.513028+0000","last_undegraded":"2024-09-16T01:00:40.513028+0000","last_fullsized":"2024-09-16T01:00:40.513028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:34.811501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445791+0000","last_change":"2024-09-16T01:00:28.439511+0000","last_active":"2024-09-16T01:00:29.445791+0000","last_peered":"2024-09-16T01:00:29.445791+0000","last_clean":"2024-09-16T01:00:29.445791+0000","last_became_active":"2024-09-16T01:00:28.439204+0000","last_became_peered":"2024-09-16T01:00:28.439204+0000","last_unstale":"2024-09-16T01:00:29.445791+0000","last_undegraded":"2024-09-16T01:00:29.445791+0000","last_fullsized":"2024-09-16T01:00:29.445791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:00.331186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510658+0000","last_change":"2024-09-16T01:00:26.357142+0000","last_active":"2024-09-16T01:00:39.510658+0000","last_peered":"2024-09-16T01:00:39.510658+0000","last_clean":"2024-09-16T01:00:39.510658+0000","last_became_active":"2024-09-16T01:00:26.356738+0000","last_became_peered":"2024-09-16T01:00:26.356738+0000","last_unstale":"2024-09-16T01:00:39.510658+0000","last_undegraded":"2024-09-16T01:00:39.510658+0000","last_fullsized":"2024-09-16T01:00:39.510658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:41.895356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446568+0000","last_change":"2024-09-16T01:00:28.449767+0000","last_active":"2024-09-16T01:00:29.446568+0000","last_peered":"2024-09-16T01:00:29.446568+0000","last_clean":"2024-09-16T01:00:29.446568+0000","last_became_active":"2024-09-16T01:00:28.449454+0000","last_became_peered":"2024-09-16T01:00:28.449454+0000","last_unstale":"2024-09-16T01:00:29.446568+0000","last_undegraded":"2024-09-16T01:00:29.446568+0000","last_fullsized":"2024-09-16T01:00:29.446568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:44.395194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:28.579110+0000","last_change":"2024-09-16T01:00:26.358441+0000","last_active":"2024-09-16T01:01:28.579110+0000","last_peered":"2024-09-16T01:01:28.579110+0000","last_clean":"2024-09-16T01:01:28.579110+0000","last_became_active":"2024-09-16T01:00:26.358110+0000","last_became_peered":"2024-09-16T01:00:26.358110+0000","last_unstale":"2024-09-16T01:01:28.579110+0000","last_undegraded":"2024-09-16T01:01:28.579110+0000","last_fullsized":"2024-09-16T01:01:28.579110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446963+0000","last_change":"2024-09-16T01:00:28.447408+0000","last_active":"2024-09-16T01:00:29.446963+0000","last_peered":"2024-09-16T01:00:29.446963+0000","last_clean":"2024-09-16T01:00:29.446963+0000","last_became_active":"2024-09-16T01:00:28.447089+0000","last_became_peered":"2024-09-16T01:00:28.447089+0000","last_unstale":"2024-09-16T01:00:29.446963+0000","last_undegraded":"2024-09-16T01:00:29.446963+0000","last_fullsized":"2024-09-16T01:00:29.446963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:40.081429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508119+0000","last_change":"2024-09-16T01:00:26.745619+0000","last_active":"2024-09-16T01:00:39.508119+0000","last_peered":"2024-09-16T01:00:39.508119+0000","last_clean":"2024-09-16T01:00:39.508119+0000","last_became_active":"2024-09-16T01:00:26.745265+0000","last_became_peered":"2024-09-16T01:00:26.745265+0000","last_unstale":"2024-09-16T01:00:39.508119+0000","last_undegraded":"2024-09-16T01:00:39.508119+0000","last_fullsized":"2024-09-16T01:00:39.508119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:54.254160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434189+0000","last_change":"2024-09-16T01:00:28.456065+0000","last_active":"2024-09-16T01:00:29.434189+0000","last_peered":"2024-09-16T01:00:29.434189+0000","last_clean":"2024-09-16T01:00:29.434189+0000","last_became_active":"2024-09-16T01:00:28.455692+0000","last_became_peered":"2024-09-16T01:00:28.455692+0000","last_unstale":"2024-09-16T01:00:29.434189+0000","last_undegraded":"2024-09-16T01:00:29.434189+0000","last_fullsized":"2024-09-16T01:00:29.434189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.489340+0000","last_change":"2024-09-16T01:00:26.354191+0000","last_active":"2024-09-16T01:00:39.489340+0000","last_peered":"2024-09-16T01:00:39.489340+0000","last_clean":"2024-09-16T01:00:39.489340+0000","last_became_active":"2024-09-16T01:00:26.353753+0000","last_became_peered":"2024-09-16T01:00:26.353753+0000","last_unstale":"2024-09-16T01:00:39.489340+0000","last_undegraded":"2024-09-16T01:00:39.489340+0000","last_fullsized":"2024-09-16T01:00:39.489340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:16.098449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451025+0000","last_change":"2024-09-16T01:00:28.451056+0000","last_active":"2024-09-16T01:00:29.451025+0000","last_peered":"2024-09-16T01:00:29.451025+0000","last_clean":"2024-09-16T01:00:29.451025+0000","last_became_active":"2024-09-16T01:00:28.449801+0000","last_became_peered":"2024-09-16T01:00:28.449801+0000","last_unstale":"2024-09-16T01:00:29.451025+0000","last_undegraded":"2024-09-16T01:00:29.451025+0000","last_fullsized":"2024-09-16T01:00:29.451025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:06.207854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508582+0000","last_change":"2024-09-16T01:00:26.355975+0000","last_active":"2024-09-16T01:00:39.508582+0000","last_peered":"2024-09-16T01:00:39.508582+0000","last_clean":"2024-09-16T01:00:39.508582+0000","last_became_active":"2024-09-16T01:00:26.355629+0000","last_became_peered":"2024-09-16T01:00:26.355629+0000","last_unstale":"2024-09-16T01:00:39.508582+0000","last_undegraded":"2024-09-16T01:00:39.508582+0000","last_fullsized":"2024-09-16T01:00:39.508582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:06.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446815+0000","last_change":"2024-09-16T01:00:28.444387+0000","last_active":"2024-09-16T01:00:29.446815+0000","last_peered":"2024-09-16T01:00:29.446815+0000","last_clean":"2024-09-16T01:00:29.446815+0000","last_became_active":"2024-09-16T01:00:28.444076+0000","last_became_peered":"2024-09-16T01:00:28.444076+0000","last_unstale":"2024-09-16T01:00:29.446815+0000","last_undegraded":"2024-09-16T01:00:29.446815+0000","last_fullsized":"2024-09-16T01:00:29.446815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:50.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508980+0000","last_change":"2024-09-16T01:00:26.357038+0000","last_active":"2024-09-16T01:00:39.508980+0000","last_peered":"2024-09-16T01:00:39.508980+0000","last_clean":"2024-09-16T01:00:39.508980+0000","last_became_active":"2024-09-16T01:00:26.356599+0000","last_became_peered":"2024-09-16T01:00:26.356599+0000","last_unstale":"2024-09-16T01:00:39.508980+0000","last_undegraded":"2024-09-16T01:00:39.508980+0000","last_fullsized":"2024-09-16T01:00:39.508980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.288180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.833185+0000","last_change":"2024-09-16T01:00:28.443408+0000","last_active":"2024-09-16T01:00:31.833185+0000","last_peered":"2024-09-16T01:00:31.833185+0000","last_clean":"2024-09-16T01:00:31.833185+0000","last_became_active":"2024-09-16T01:00:28.443016+0000","last_became_peered":"2024-09-16T01:00:28.443016+0000","last_unstale":"2024-09-16T01:00:31.833185+0000","last_undegraded":"2024-09-16T01:00:31.833185+0000","last_fullsized":"2024-09-16T01:00:31.833185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:29.801811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:28.585410+0000","last_change":"2024-09-16T01:00:27.056514+0000","last_active":"2024-09-16T01:01:28.585410+0000","last_peered":"2024-09-16T01:01:28.585410+0000","last_clean":"2024-09-16T01:01:28.585410+0000","last_became_active":"2024-09-16T01:00:27.056137+0000","last_became_peered":"2024-09-16T01:00:27.056137+0000","last_unstale":"2024-09-16T01:01:28.585410+0000","last_undegraded":"2024-09-16T01:01:28.585410+0000","last_fullsized":"2024-09-16T01:01:28.585410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:07.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446792+0000","last_change":"2024-09-16T01:00:28.445866+0000","last_active":"2024-09-16T01:00:29.446792+0000","last_peered":"2024-09-16T01:00:29.446792+0000","last_clean":"2024-09-16T01:00:29.446792+0000","last_became_active":"2024-09-16T01:00:28.445454+0000","last_became_peered":"2024-09-16T01:00:28.445454+0000","last_unstale":"2024-09-16T01:00:29.446792+0000","last_undegraded":"2024-09-16T01:00:29.446792+0000","last_fullsized":"2024-09-16T01:00:29.446792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:44.340565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446297+0000","last_change":"2024-09-16T00:59:14.381567+0000","last_active":"2024-09-16T01:00:29.446297+0000","last_peered":"2024-09-16T01:00:29.446297+0000","last_clean":"2024-09-16T01:00:29.446297+0000","last_became_active":"2024-09-16T00:59:14.381088+0000","last_became_peered":"2024-09-16T00:59:14.381088+0000","last_unstale":"2024-09-16T01:00:29.446297+0000","last_undegraded":"2024-09-16T01:00:29.446297+0000","last_fullsized":"2024-09-16T01:00:29.446297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_clean_scrub_stamp":"2024-09-16T00:55:49.599122+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:14.170832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.512169+0000","last_change":"2024-09-16T01:00:26.357699+0000","last_active":"2024-09-16T01:00:40.512169+0000","last_peered":"2024-09-16T01:00:40.512169+0000","last_clean":"2024-09-16T01:00:40.512169+0000","last_became_active":"2024-09-16T01:00:26.357186+0000","last_became_peered":"2024-09-16T01:00:26.357186+0000","last_unstale":"2024-09-16T01:00:40.512169+0000","last_undegraded":"2024-09-16T01:00:40.512169+0000","last_fullsized":"2024-09-16T01:00:40.512169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:48.026723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430360+0000","last_change":"2024-09-16T01:00:28.446677+0000","last_active":"2024-09-16T01:00:29.430360+0000","last_peered":"2024-09-16T01:00:29.430360+0000","last_clean":"2024-09-16T01:00:29.430360+0000","last_became_active":"2024-09-16T01:00:28.446337+0000","last_became_peered":"2024-09-16T01:00:28.446337+0000","last_unstale":"2024-09-16T01:00:29.430360+0000","last_undegraded":"2024-09-16T01:00:29.430360+0000","last_fullsized":"2024-09-16T01:00:29.430360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:45.890312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.491499+0000","last_change":"2024-09-16T01:00:26.360153+0000","last_active":"2024-09-16T01:00:37.491499+0000","last_peered":"2024-09-16T01:00:37.491499+0000","last_clean":"2024-09-16T01:00:37.491499+0000","last_became_active":"2024-09-16T01:00:26.359828+0000","last_became_peered":"2024-09-16T01:00:26.359828+0000","last_unstale":"2024-09-16T01:00:37.491499+0000","last_undegraded":"2024-09-16T01:00:37.491499+0000","last_fullsized":"2024-09-16T01:00:37.491499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:27.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445683+0000","last_change":"2024-09-16T01:00:28.446587+0000","last_active":"2024-09-16T01:00:29.445683+0000","last_peered":"2024-09-16T01:00:29.445683+0000","last_clean":"2024-09-16T01:00:29.445683+0000","last_became_active":"2024-09-16T01:00:28.446221+0000","last_became_peered":"2024-09-16T01:00:28.446221+0000","last_unstale":"2024-09-16T01:00:29.445683+0000","last_undegraded":"2024-09-16T01:00:29.445683+0000","last_fullsized":"2024-09-16T01:00:29.445683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:07.027765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:29.579950+0000","last_change":"2024-09-16T01:00:26.745384+0000","last_active":"2024-09-16T01:01:29.579950+0000","last_peered":"2024-09-16T01:01:29.579950+0000","last_clean":"2024-09-16T01:01:29.579950+0000","last_became_active":"2024-09-16T01:00:26.745056+0000","last_became_peered":"2024-09-16T01:00:26.745056+0000","last_unstale":"2024-09-16T01:01:29.579950+0000","last_undegraded":"2024-09-16T01:01:29.579950+0000","last_fullsized":"2024-09-16T01:01:29.579950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:18.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433772+0000","last_change":"2024-09-16T01:00:28.454156+0000","last_active":"2024-09-16T01:00:29.433772+0000","last_peered":"2024-09-16T01:00:29.433772+0000","last_clean":"2024-09-16T01:00:29.433772+0000","last_became_active":"2024-09-16T01:00:28.453798+0000","last_became_peered":"2024-09-16T01:00:28.453798+0000","last_unstale":"2024-09-16T01:00:29.433772+0000","last_undegraded":"2024-09-16T01:00:29.433772+0000","last_fullsized":"2024-09-16T01:00:29.433772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.617433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.581666+0000","last_change":"2024-09-16T01:00:26.356232+0000","last_active":"2024-09-16T01:01:30.581666+0000","last_peered":"2024-09-16T01:01:30.581666+0000","last_clean":"2024-09-16T01:01:30.581666+0000","last_became_active":"2024-09-16T01:00:26.355874+0000","last_became_peered":"2024-09-16T01:00:26.355874+0000","last_unstale":"2024-09-16T01:01:30.581666+0000","last_undegraded":"2024-09-16T01:01:30.581666+0000","last_fullsized":"2024-09-16T01:01:30.581666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:53.426341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447525+0000","last_change":"2024-09-16T01:00:28.453279+0000","last_active":"2024-09-16T01:00:29.447525+0000","last_peered":"2024-09-16T01:00:29.447525+0000","last_clean":"2024-09-16T01:00:29.447525+0000","last_became_active":"2024-09-16T01:00:28.452808+0000","last_became_peered":"2024-09-16T01:00:28.452808+0000","last_unstale":"2024-09-16T01:00:29.447525+0000","last_undegraded":"2024-09-16T01:00:29.447525+0000","last_fullsized":"2024-09-16T01:00:29.447525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:06.096145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446100+0000","last_change":"2024-09-16T01:00:26.745692+0000","last_active":"2024-09-16T01:00:29.446100+0000","last_peered":"2024-09-16T01:00:29.446100+0000","last_clean":"2024-09-16T01:00:29.446100+0000","last_became_active":"2024-09-16T01:00:26.745325+0000","last_became_peered":"2024-09-16T01:00:26.745325+0000","last_unstale":"2024-09-16T01:00:29.446100+0000","last_undegraded":"2024-09-16T01:00:29.446100+0000","last_fullsized":"2024-09-16T01:00:29.446100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:19.061145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.358735+0000","last_change":"2024-09-16T01:00:28.452501+0000","last_active":"2024-09-16T01:00:31.358735+0000","last_peered":"2024-09-16T01:00:31.358735+0000","last_clean":"2024-09-16T01:00:31.358735+0000","last_became_active":"2024-09-16T01:00:28.451938+0000","last_became_peered":"2024-09-16T01:00:28.451938+0000","last_unstale":"2024-09-16T01:00:31.358735+0000","last_undegraded":"2024-09-16T01:00:31.358735+0000","last_fullsized":"2024-09-16T01:00:31.358735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:12.762849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510447+0000","last_change":"2024-09-16T01:00:26.746438+0000","last_active":"2024-09-16T01:00:39.510447+0000","last_peered":"2024-09-16T01:00:39.510447+0000","last_clean":"2024-09-16T01:00:39.510447+0000","last_became_active":"2024-09-16T01:00:26.746067+0000","last_became_peered":"2024-09-16T01:00:26.746067+0000","last_unstale":"2024-09-16T01:00:39.510447+0000","last_undegraded":"2024-09-16T01:00:39.510447+0000","last_fullsized":"2024-09-16T01:00:39.510447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:10.792354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445879+0000","last_change":"2024-09-16T01:00:28.446067+0000","last_active":"2024-09-16T01:00:29.445879+0000","last_peered":"2024-09-16T01:00:29.445879+0000","last_clean":"2024-09-16T01:00:29.445879+0000","last_became_active":"2024-09-16T01:00:28.445669+0000","last_became_peered":"2024-09-16T01:00:28.445669+0000","last_unstale":"2024-09-16T01:00:29.445879+0000","last_undegraded":"2024-09-16T01:00:29.445879+0000","last_fullsized":"2024-09-16T01:00:29.445879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:30.172271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:53.445828+0000","last_change":"2024-09-16T01:00:26.351033+0000","last_active":"2024-09-16T01:00:53.445828+0000","last_peered":"2024-09-16T01:00:53.445828+0000","last_clean":"2024-09-16T01:00:53.445828+0000","last_became_active":"2024-09-16T01:00:26.350670+0000","last_became_peered":"2024-09-16T01:00:26.350670+0000","last_unstale":"2024-09-16T01:00:53.445828+0000","last_undegraded":"2024-09-16T01:00:53.445828+0000","last_fullsized":"2024-09-16T01:00:53.445828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:23.634635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430572+0000","last_change":"2024-09-16T01:00:28.445229+0000","last_active":"2024-09-16T01:00:29.430572+0000","last_peered":"2024-09-16T01:00:29.430572+0000","last_clean":"2024-09-16T01:00:29.430572+0000","last_became_active":"2024-09-16T01:00:28.444794+0000","last_became_peered":"2024-09-16T01:00:28.444794+0000","last_unstale":"2024-09-16T01:00:29.430572+0000","last_undegraded":"2024-09-16T01:00:29.430572+0000","last_fullsized":"2024-09-16T01:00:29.430572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:05:34.117777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509104+0000","last_change":"2024-09-16T01:00:27.056718+0000","last_active":"2024-09-16T01:00:39.509104+0000","last_peered":"2024-09-16T01:00:39.509104+0000","last_clean":"2024-09-16T01:00:39.509104+0000","last_became_active":"2024-09-16T01:00:27.056331+0000","last_became_peered":"2024-09-16T01:00:27.056331+0000","last_unstale":"2024-09-16T01:00:39.509104+0000","last_undegraded":"2024-09-16T01:00:39.509104+0000","last_fullsized":"2024-09-16T01:00:39.509104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:47.094865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.453630+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.453272+0000","last_became_peered":"2024-09-16T01:00:28.453272+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:44.722743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484007+0000","last_change":"2024-09-16T01:00:26.745355+0000","last_active":"2024-09-16T01:00:36.484007+0000","last_peered":"2024-09-16T01:00:36.484007+0000","last_clean":"2024-09-16T01:00:36.484007+0000","last_became_active":"2024-09-16T01:00:26.745042+0000","last_became_peered":"2024-09-16T01:00:26.745042+0000","last_unstale":"2024-09-16T01:00:36.484007+0000","last_undegraded":"2024-09-16T01:00:36.484007+0000","last_fullsized":"2024-09-16T01:00:36.484007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:29.934482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446606+0000","last_change":"2024-09-16T01:00:28.441231+0000","last_active":"2024-09-16T01:00:29.446606+0000","last_peered":"2024-09-16T01:00:29.446606+0000","last_clean":"2024-09-16T01:00:29.446606+0000","last_became_active":"2024-09-16T01:00:28.440849+0000","last_became_peered":"2024-09-16T01:00:28.440849+0000","last_unstale":"2024-09-16T01:00:29.446606+0000","last_undegraded":"2024-09-16T01:00:29.446606+0000","last_fullsized":"2024-09-16T01:00:29.446606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:09.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508071+0000","last_change":"2024-09-16T01:00:26.357171+0000","last_active":"2024-09-16T01:00:39.508071+0000","last_peered":"2024-09-16T01:00:39.508071+0000","last_clean":"2024-09-16T01:00:39.508071+0000","last_became_active":"2024-09-16T01:00:26.356843+0000","last_became_peered":"2024-09-16T01:00:26.356843+0000","last_unstale":"2024-09-16T01:00:39.508071+0000","last_undegraded":"2024-09-16T01:00:39.508071+0000","last_fullsized":"2024-09-16T01:00:39.508071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:38.576314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450981+0000","last_change":"2024-09-16T01:00:28.450917+0000","last_active":"2024-09-16T01:00:29.450981+0000","last_peered":"2024-09-16T01:00:29.450981+0000","last_clean":"2024-09-16T01:00:29.450981+0000","last_became_active":"2024-09-16T01:00:28.448978+0000","last_became_peered":"2024-09-16T01:00:28.448978+0000","last_unstale":"2024-09-16T01:00:29.450981+0000","last_undegraded":"2024-09-16T01:00:29.450981+0000","last_fullsized":"2024-09-16T01:00:29.450981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:30.270617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502175+0000","last_change":"2024-09-16T01:00:26.360356+0000","last_active":"2024-09-16T01:00:38.502175+0000","last_peered":"2024-09-16T01:00:38.502175+0000","last_clean":"2024-09-16T01:00:38.502175+0000","last_became_active":"2024-09-16T01:00:26.359647+0000","last_became_peered":"2024-09-16T01:00:26.359647+0000","last_unstale":"2024-09-16T01:00:38.502175+0000","last_undegraded":"2024-09-16T01:00:38.502175+0000","last_fullsized":"2024-09-16T01:00:38.502175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:47.857659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430392+0000","last_change":"2024-09-16T01:00:28.444726+0000","last_active":"2024-09-16T01:00:29.430392+0000","last_peered":"2024-09-16T01:00:29.430392+0000","last_clean":"2024-09-16T01:00:29.430392+0000","last_became_active":"2024-09-16T01:00:28.444418+0000","last_became_peered":"2024-09-16T01:00:28.444418+0000","last_unstale":"2024-09-16T01:00:29.430392+0000","last_undegraded":"2024-09-16T01:00:29.430392+0000","last_fullsized":"2024-09-16T01:00:29.430392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484905+0000","last_change":"2024-09-16T01:00:26.357369+0000","last_active":"2024-09-16T01:00:36.484905+0000","last_peered":"2024-09-16T01:00:36.484905+0000","last_clean":"2024-09-16T01:00:36.484905+0000","last_became_active":"2024-09-16T01:00:26.356253+0000","last_became_peered":"2024-09-16T01:00:26.356253+0000","last_unstale":"2024-09-16T01:00:36.484905+0000","last_undegraded":"2024-09-16T01:00:36.484905+0000","last_fullsized":"2024-09-16T01:00:36.484905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:03.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446325+0000","last_change":"2024-09-16T01:00:28.446488+0000","last_active":"2024-09-16T01:00:29.446325+0000","last_peered":"2024-09-16T01:00:29.446325+0000","last_clean":"2024-09-16T01:00:29.446325+0000","last_became_active":"2024-09-16T01:00:28.446004+0000","last_became_peered":"2024-09-16T01:00:28.446004+0000","last_unstale":"2024-09-16T01:00:29.446325+0000","last_undegraded":"2024-09-16T01:00:29.446325+0000","last_fullsized":"2024-09-16T01:00:29.446325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.923219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434044+0000","last_change":"2024-09-16T01:00:28.455484+0000","last_active":"2024-09-16T01:00:29.434044+0000","last_peered":"2024-09-16T01:00:29.434044+0000","last_clean":"2024-09-16T01:00:29.434044+0000","last_became_active":"2024-09-16T01:00:28.455142+0000","last_became_peered":"2024-09-16T01:00:28.455142+0000","last_unstale":"2024-09-16T01:00:29.434044+0000","last_undegraded":"2024-09-16T01:00:29.434044+0000","last_fullsized":"2024-09-16T01:00:29.434044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:50:19.274265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509963+0000","last_change":"2024-09-16T01:00:26.354531+0000","last_active":"2024-09-16T01:00:39.509963+0000","last_peered":"2024-09-16T01:00:39.509963+0000","last_clean":"2024-09-16T01:00:39.509963+0000","last_became_active":"2024-09-16T01:00:26.354207+0000","last_became_peered":"2024-09-16T01:00:26.354207+0000","last_unstale":"2024-09-16T01:00:39.509963+0000","last_undegraded":"2024-09-16T01:00:39.509963+0000","last_fullsized":"2024-09-16T01:00:39.509963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:20.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.431256+0000","last_change":"2024-09-16T01:00:28.439318+0000","last_active":"2024-09-16T01:00:29.431256+0000","last_peered":"2024-09-16T01:00:29.431256+0000","last_clean":"2024-09-16T01:00:29.431256+0000","last_became_active":"2024-09-16T01:00:28.437874+0000","last_became_peered":"2024-09-16T01:00:28.437874+0000","last_unstale":"2024-09-16T01:00:29.431256+0000","last_undegraded":"2024-09-16T01:00:29.431256+0000","last_fullsized":"2024-09-16T01:00:29.431256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:59.207551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.505737+0000","last_change":"2024-09-16T01:00:26.355952+0000","last_active":"2024-09-16T01:00:40.505737+0000","last_peered":"2024-09-16T01:00:40.505737+0000","last_clean":"2024-09-16T01:00:40.505737+0000","last_became_active":"2024-09-16T01:00:26.355600+0000","last_became_peered":"2024-09-16T01:00:26.355600+0000","last_unstale":"2024-09-16T01:00:40.505737+0000","last_undegraded":"2024-09-16T01:00:40.505737+0000","last_fullsized":"2024-09-16T01:00:40.505737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:29.294004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447285+0000","last_change":"2024-09-16T01:00:28.440130+0000","last_active":"2024-09-16T01:00:29.447285+0000","last_peered":"2024-09-16T01:00:29.447285+0000","last_clean":"2024-09-16T01:00:29.447285+0000","last_became_active":"2024-09-16T01:00:28.439805+0000","last_became_peered":"2024-09-16T01:00:28.439805+0000","last_unstale":"2024-09-16T01:00:29.447285+0000","last_undegraded":"2024-09-16T01:00:29.447285+0000","last_fullsized":"2024-09-16T01:00:29.447285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:38.977930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.841915+0000","last_change":"2024-09-16T01:00:26.745139+0000","last_active":"2024-09-16T01:00:29.841915+0000","last_peered":"2024-09-16T01:00:29.841915+0000","last_clean":"2024-09-16T01:00:29.841915+0000","last_became_active":"2024-09-16T01:00:26.744796+0000","last_became_peered":"2024-09-16T01:00:26.744796+0000","last_unstale":"2024-09-16T01:00:29.841915+0000","last_undegraded":"2024-09-16T01:00:29.841915+0000","last_fullsized":"2024-09-16T01:00:29.841915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:29.368451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.430479+0000","last_change":"2024-09-16T01:00:28.449380+0000","last_active":"2024-09-16T01:00:29.430479+0000","last_peered":"2024-09-16T01:00:29.430479+0000","last_clean":"2024-09-16T01:00:29.430479+0000","last_became_active":"2024-09-16T01:00:28.448826+0000","last_became_peered":"2024-09-16T01:00:28.448826+0000","last_unstale":"2024-09-16T01:00:29.430479+0000","last_undegraded":"2024-09-16T01:00:29.430479+0000","last_fullsized":"2024-09-16T01:00:29.430479+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:19.987506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.581053+0000","last_change":"2024-09-16T01:00:26.354148+0000","last_active":"2024-09-16T01:01:30.581053+0000","last_peered":"2024-09-16T01:01:30.581053+0000","last_clean":"2024-09-16T01:01:30.581053+0000","last_became_active":"2024-09-16T01:00:26.353477+0000","last_became_peered":"2024-09-16T01:00:26.353477+0000","last_unstale":"2024-09-16T01:01:30.581053+0000","last_undegraded":"2024-09-16T01:01:30.581053+0000","last_fullsized":"2024-09-16T01:01:30.581053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:44.715792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67758,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":553,"num_read_kb":352,"num_write":244,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215943,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":417671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1068464,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":417586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":1010892,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1009784,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":416750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":478608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":477995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":418657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34623,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:34.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:01:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T01:01:34.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:34.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:34 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 -- 172.21.15.17:0/1159370814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 msgr2=0x7fde00107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 --2- 172.21.15.17:0/1159370814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde00107b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fddec009930 tx=0x7fddec02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 -- 172.21.15.17:0/1159370814 shutdown_connections 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 --2- 172.21.15.17:0/1159370814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 0x7fde0010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 --2- 172.21.15.17:0/1159370814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde00107b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 --2- 172.21.15.17:0/1159370814 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 0x7fde00103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 -- 172.21.15.17:0/1159370814 >> 172.21.15.17:0/1159370814 conn(0x7fde000fc7d0 msgr2=0x7fde000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 -- 172.21.15.17:0/1159370814 shutdown_connections 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.070+0000 7fde06b84640 1 -- 172.21.15.17:0/1159370814 wait complete. 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 Processor -- start 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 -- start start 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 0x7fde001a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 0x7fde0019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde00111fc0 con 0x7fde001036e0 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fde00111e40 con 0x7fde00102d30 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde06b84640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde00112140 con 0x7fde001082a0 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fddfffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fddfffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43584/0 (socket says 172.21.15.17:43584) 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fddfffff640 1 -- 172.21.15.17:0/4080078739 learned_addr learned my addr 172.21.15.17:0/4080078739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.071+0000 7fde04920640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 0x7fde001a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fde05121640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 0x7fde0019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 -- 172.21.15.17:0/4080078739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 msgr2=0x7fde0019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 0x7fde0019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 -- 172.21.15.17:0/4080078739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 msgr2=0x7fde001a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 0x7fde001a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 -- 172.21.15.17:0/4080078739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0019acc0 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfffff640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddec031440 tx=0x7fddec003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec03f070 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddec031d60 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0019af50 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec035030 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.072+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde001a72a0 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.073+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde00103110 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.075+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fddec042070 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.076+0000 7fddfdffb640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 0x7fddf00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.076+0000 7fde04920640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 0x7fddf00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.076+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fddec0f0800 con 0x7fde001036e0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.076+0000 7fde04920640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 0x7fddf00a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005d00 tx=0x7fddf400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.079+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddec0bd3d0 con 0x7fde001036e0 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T01:01:35.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:35.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:34 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-16T01:01:35.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:01:35.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:35.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:34 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.258+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde00062630 con 0x7fddf00a3350 2024-09-16T01:01:35.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.265+0000 7fddfdffb640 1 -- 172.21.15.17:0/4080078739 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258890 (secure 0 0 0) 0x7fde00062630 con 0x7fddf00a3350 2024-09-16T01:01:35.268 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:35.269 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-16T01:01:35.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 msgr2=0x7fddf00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 0x7fddf00a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fddf4005d00 tx=0x7fddf400b410 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 msgr2=0x7fde001a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddec031440 tx=0x7fddec003cd0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 shutdown_connections 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fddf00a3350 0x7fddf00a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde001082a0 0x7fde0019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde001036e0 0x7fde001a0910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 --2- 172.21.15.17:0/4080078739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde00102d30 0x7fde001a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.268+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 >> 172.21.15.17:0/4080078739 conn(0x7fde000fc7d0 msgr2=0x7fde000fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.269+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 shutdown_connections 2024-09-16T01:01:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:35.269+0000 7fde06b84640 1 -- 172.21.15.17:0/4080078739 wait complete. 2024-09-16T01:01:35.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:35 smithi017 ceph-mon[31211]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:01:35.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:35.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:35.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:35 smithi017 ceph-mon[31211]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-16T01:01:34.930587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658360,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":694,"num_read_kb":471,"num_write":427,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376736,"kb_used_data":10836,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565088,"statfs":{"total":1151940427776,"available":1151554650112,"internally_reserved":0,"allocated":11096064,"data_stored":6994041,"data_compressed":108792,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002011"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451354+0000","last_change":"2024-09-16T01:00:28.449298+0000","last_active":"2024-09-16T01:00:29.451354+0000","last_peered":"2024-09-16T01:00:29.451354+0000","last_clean":"2024-09-16T01:00:29.451354+0000","last_became_active":"2024-09-16T01:00:28.448925+0000","last_became_peered":"2024-09-16T01:00:28.448925+0000","last_unstale":"2024-09-16T01:00:29.451354+0000","last_undegraded":"2024-09-16T01:00:29.451354+0000","last_fullsized":"2024-09-16T01:00:29.451354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:54.432714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.681920+0000","last_change":"2024-09-16T01:00:28.440068+0000","last_active":"2024-09-16T01:01:33.681920+0000","last_peered":"2024-09-16T01:01:33.681920+0000","last_clean":"2024-09-16T01:01:33.681920+0000","last_became_active":"2024-09-16T01:00:28.439730+0000","last_became_peered":"2024-09-16T01:00:28.439730+0000","last_unstale":"2024-09-16T01:01:33.681920+0000","last_undegraded":"2024-09-16T01:01:33.681920+0000","last_fullsized":"2024-09-16T01:01:33.681920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.021941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.681762+0000","last_change":"2024-09-16T01:00:28.451754+0000","last_active":"2024-09-16T01:01:33.681762+0000","last_peered":"2024-09-16T01:01:33.681762+0000","last_clean":"2024-09-16T01:01:33.681762+0000","last_became_active":"2024-09-16T01:00:28.451418+0000","last_became_peered":"2024-09-16T01:00:28.451418+0000","last_unstale":"2024-09-16T01:01:33.681762+0000","last_undegraded":"2024-09-16T01:01:33.681762+0000","last_fullsized":"2024-09-16T01:01:33.681762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:10.383137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446778+0000","last_change":"2024-09-16T01:00:28.451256+0000","last_active":"2024-09-16T01:00:29.446778+0000","last_peered":"2024-09-16T01:00:29.446778+0000","last_clean":"2024-09-16T01:00:29.446778+0000","last_became_active":"2024-09-16T01:00:28.450929+0000","last_became_peered":"2024-09-16T01:00:28.450929+0000","last_unstale":"2024-09-16T01:00:29.446778+0000","last_undegraded":"2024-09-16T01:00:29.446778+0000","last_fullsized":"2024-09-16T01:00:29.446778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:54:18.663351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446924+0000","last_change":"2024-09-16T01:00:28.436789+0000","last_active":"2024-09-16T01:00:29.446924+0000","last_peered":"2024-09-16T01:00:29.446924+0000","last_clean":"2024-09-16T01:00:29.446924+0000","last_became_active":"2024-09-16T01:00:28.436386+0000","last_became_peered":"2024-09-16T01:00:28.436386+0000","last_unstale":"2024-09-16T01:00:29.446924+0000","last_undegraded":"2024-09-16T01:00:29.446924+0000","last_fullsized":"2024-09-16T01:00:29.446924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:07.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446537+0000","last_change":"2024-09-16T01:00:28.449819+0000","last_active":"2024-09-16T01:00:29.446537+0000","last_peered":"2024-09-16T01:00:29.446537+0000","last_clean":"2024-09-16T01:00:29.446537+0000","last_became_active":"2024-09-16T01:00:28.449474+0000","last_became_peered":"2024-09-16T01:00:28.449474+0000","last_unstale":"2024-09-16T01:00:29.446537+0000","last_undegraded":"2024-09-16T01:00:29.446537+0000","last_fullsized":"2024-09-16T01:00:29.446537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:21.879279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447035+0000","last_change":"2024-09-16T01:00:28.442449+0000","last_active":"2024-09-16T01:00:29.447035+0000","last_peered":"2024-09-16T01:00:29.447035+0000","last_clean":"2024-09-16T01:00:29.447035+0000","last_became_active":"2024-09-16T01:00:28.442087+0000","last_became_peered":"2024-09-16T01:00:28.442087+0000","last_unstale":"2024-09-16T01:00:29.447035+0000","last_undegraded":"2024-09-16T01:00:29.447035+0000","last_fullsized":"2024-09-16T01:00:29.447035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:01.996570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.755891+0000","last_change":"2024-09-16T01:00:28.443923+0000","last_active":"2024-09-16T01:01:33.755891+0000","last_peered":"2024-09-16T01:01:33.755891+0000","last_clean":"2024-09-16T01:01:33.755891+0000","last_became_active":"2024-09-16T01:00:28.443598+0000","last_became_peered":"2024-09-16T01:00:28.443598+0000","last_unstale":"2024-09-16T01:01:33.755891+0000","last_undegraded":"2024-09-16T01:01:33.755891+0000","last_fullsized":"2024-09-16T01:01:33.755891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:55.479224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.685882+0000","last_change":"2024-09-16T01:00:28.451668+0000","last_active":"2024-09-16T01:01:33.685882+0000","last_peered":"2024-09-16T01:01:33.685882+0000","last_clean":"2024-09-16T01:01:33.685882+0000","last_became_active":"2024-09-16T01:00:28.451360+0000","last_became_peered":"2024-09-16T01:00:28.451360+0000","last_unstale":"2024-09-16T01:01:33.685882+0000","last_undegraded":"2024-09-16T01:01:33.685882+0000","last_fullsized":"2024-09-16T01:01:33.685882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:32.969507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446207+0000","last_change":"2024-09-16T01:00:28.450791+0000","last_active":"2024-09-16T01:00:29.446207+0000","last_peered":"2024-09-16T01:00:29.446207+0000","last_clean":"2024-09-16T01:00:29.446207+0000","last_became_active":"2024-09-16T01:00:28.450408+0000","last_became_peered":"2024-09-16T01:00:28.450408+0000","last_unstale":"2024-09-16T01:00:29.446207+0000","last_undegraded":"2024-09-16T01:00:29.446207+0000","last_fullsized":"2024-09-16T01:00:29.446207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:31.301796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446779+0000","last_change":"2024-09-16T01:00:28.446736+0000","last_active":"2024-09-16T01:00:29.446779+0000","last_peered":"2024-09-16T01:00:29.446779+0000","last_clean":"2024-09-16T01:00:29.446779+0000","last_became_active":"2024-09-16T01:00:28.446201+0000","last_became_peered":"2024-09-16T01:00:28.446201+0000","last_unstale":"2024-09-16T01:00:29.446779+0000","last_undegraded":"2024-09-16T01:00:29.446779+0000","last_fullsized":"2024-09-16T01:00:29.446779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:50.274171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447116+0000","last_change":"2024-09-16T01:00:28.452266+0000","last_active":"2024-09-16T01:00:29.447116+0000","last_peered":"2024-09-16T01:00:29.447116+0000","last_clean":"2024-09-16T01:00:29.447116+0000","last_became_active":"2024-09-16T01:00:28.451927+0000","last_became_peered":"2024-09-16T01:00:28.451927+0000","last_unstale":"2024-09-16T01:00:29.447116+0000","last_undegraded":"2024-09-16T01:00:29.447116+0000","last_fullsized":"2024-09-16T01:00:29.447116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:10.361046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446281+0000","last_change":"2024-09-16T01:00:28.440957+0000","last_active":"2024-09-16T01:00:29.446281+0000","last_peered":"2024-09-16T01:00:29.446281+0000","last_clean":"2024-09-16T01:00:29.446281+0000","last_became_active":"2024-09-16T01:00:28.440653+0000","last_became_peered":"2024-09-16T01:00:28.440653+0000","last_unstale":"2024-09-16T01:00:29.446281+0000","last_undegraded":"2024-09-16T01:00:29.446281+0000","last_fullsized":"2024-09-16T01:00:29.446281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:15.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.681709+0000","last_change":"2024-09-16T01:00:28.443914+0000","last_active":"2024-09-16T01:01:33.681709+0000","last_peered":"2024-09-16T01:01:33.681709+0000","last_clean":"2024-09-16T01:01:33.681709+0000","last_became_active":"2024-09-16T01:00:28.443600+0000","last_became_peered":"2024-09-16T01:00:28.443600+0000","last_unstale":"2024-09-16T01:01:33.681709+0000","last_undegraded":"2024-09-16T01:01:33.681709+0000","last_fullsized":"2024-09-16T01:01:33.681709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:35.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.681846+0000","last_change":"2024-09-16T01:00:28.449970+0000","last_active":"2024-09-16T01:01:33.681846+0000","last_peered":"2024-09-16T01:01:33.681846+0000","last_clean":"2024-09-16T01:01:33.681846+0000","last_became_active":"2024-09-16T01:00:28.449464+0000","last_became_peered":"2024-09-16T01:00:28.449464+0000","last_unstale":"2024-09-16T01:01:33.681846+0000","last_undegraded":"2024-09-16T01:01:33.681846+0000","last_fullsized":"2024-09-16T01:01:33.681846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:01.537338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.683617+0000","last_change":"2024-09-16T01:00:28.445004+0000","last_active":"2024-09-16T01:01:33.683617+0000","last_peered":"2024-09-16T01:01:33.683617+0000","last_clean":"2024-09-16T01:01:33.683617+0000","last_became_active":"2024-09-16T01:00:28.444503+0000","last_became_peered":"2024-09-16T01:00:28.444503+0000","last_unstale":"2024-09-16T01:01:33.683617+0000","last_undegraded":"2024-09-16T01:01:33.683617+0000","last_fullsized":"2024-09-16T01:01:33.683617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:05.330992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451229+0000","last_change":"2024-09-16T01:00:28.451975+0000","last_active":"2024-09-16T01:00:29.451229+0000","last_peered":"2024-09-16T01:00:29.451229+0000","last_clean":"2024-09-16T01:00:29.451229+0000","last_became_active":"2024-09-16T01:00:28.451582+0000","last_became_peered":"2024-09-16T01:00:28.451582+0000","last_unstale":"2024-09-16T01:00:29.451229+0000","last_undegraded":"2024-09-16T01:00:29.451229+0000","last_fullsized":"2024-09-16T01:00:29.451229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.032697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446326+0000","last_change":"2024-09-16T01:00:28.439491+0000","last_active":"2024-09-16T01:00:29.446326+0000","last_peered":"2024-09-16T01:00:29.446326+0000","last_clean":"2024-09-16T01:00:29.446326+0000","last_became_active":"2024-09-16T01:00:28.439130+0000","last_became_peered":"2024-09-16T01:00:28.439130+0000","last_unstale":"2024-09-16T01:00:29.446326+0000","last_undegraded":"2024-09-16T01:00:29.446326+0000","last_fullsized":"2024-09-16T01:00:29.446326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:33.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684046+0000","last_change":"2024-09-16T01:00:28.448537+0000","last_active":"2024-09-16T01:01:33.684046+0000","last_peered":"2024-09-16T01:01:33.684046+0000","last_clean":"2024-09-16T01:01:33.684046+0000","last_became_active":"2024-09-16T01:00:28.448146+0000","last_became_peered":"2024-09-16T01:00:28.448146+0000","last_unstale":"2024-09-16T01:01:33.684046+0000","last_undegraded":"2024-09-16T01:01:33.684046+0000","last_fullsized":"2024-09-16T01:01:33.684046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:58.466156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450747+0000","last_change":"2024-09-16T01:00:28.452877+0000","last_active":"2024-09-16T01:00:29.450747+0000","last_peered":"2024-09-16T01:00:29.450747+0000","last_clean":"2024-09-16T01:00:29.450747+0000","last_became_active":"2024-09-16T01:00:28.452542+0000","last_became_peered":"2024-09-16T01:00:28.452542+0000","last_unstale":"2024-09-16T01:00:29.450747+0000","last_undegraded":"2024-09-16T01:00:29.450747+0000","last_fullsized":"2024-09-16T01:00:29.450747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:56.337456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446432+0000","last_change":"2024-09-16T01:00:28.442157+0000","last_active":"2024-09-16T01:00:29.446432+0000","last_peered":"2024-09-16T01:00:29.446432+0000","last_clean":"2024-09-16T01:00:29.446432+0000","last_became_active":"2024-09-16T01:00:28.441852+0000","last_became_peered":"2024-09-16T01:00:28.441852+0000","last_unstale":"2024-09-16T01:00:29.446432+0000","last_undegraded":"2024-09-16T01:00:29.446432+0000","last_fullsized":"2024-09-16T01:00:29.446432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:36.503203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684199+0000","last_change":"2024-09-16T01:00:28.443734+0000","last_active":"2024-09-16T01:01:33.684199+0000","last_peered":"2024-09-16T01:01:33.684199+0000","last_clean":"2024-09-16T01:01:33.684199+0000","last_became_active":"2024-09-16T01:00:28.443287+0000","last_became_peered":"2024-09-16T01:00:28.443287+0000","last_unstale":"2024-09-16T01:01:33.684199+0000","last_undegraded":"2024-09-16T01:01:33.684199+0000","last_fullsized":"2024-09-16T01:01:33.684199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:12.920159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.755928+0000","last_change":"2024-09-16T01:00:28.448425+0000","last_active":"2024-09-16T01:01:33.755928+0000","last_peered":"2024-09-16T01:01:33.755928+0000","last_clean":"2024-09-16T01:01:33.755928+0000","last_became_active":"2024-09-16T01:00:28.448109+0000","last_became_peered":"2024-09-16T01:00:28.448109+0000","last_unstale":"2024-09-16T01:01:33.755928+0000","last_undegraded":"2024-09-16T01:01:33.755928+0000","last_fullsized":"2024-09-16T01:01:33.755928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:22.671812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434004+0000","last_change":"2024-09-16T01:00:28.446417+0000","last_active":"2024-09-16T01:00:29.434004+0000","last_peered":"2024-09-16T01:00:29.434004+0000","last_clean":"2024-09-16T01:00:29.434004+0000","last_became_active":"2024-09-16T01:00:28.445919+0000","last_became_peered":"2024-09-16T01:00:28.445919+0000","last_unstale":"2024-09-16T01:00:29.434004+0000","last_undegraded":"2024-09-16T01:00:29.434004+0000","last_fullsized":"2024-09-16T01:00:29.434004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:11.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756269+0000","last_change":"2024-09-16T01:00:28.451072+0000","last_active":"2024-09-16T01:01:33.756269+0000","last_peered":"2024-09-16T01:01:33.756269+0000","last_clean":"2024-09-16T01:01:33.756269+0000","last_became_active":"2024-09-16T01:00:28.450760+0000","last_became_peered":"2024-09-16T01:00:28.450760+0000","last_unstale":"2024-09-16T01:01:33.756269+0000","last_undegraded":"2024-09-16T01:01:33.756269+0000","last_fullsized":"2024-09-16T01:01:33.756269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:24.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684371+0000","last_change":"2024-09-16T01:00:28.445776+0000","last_active":"2024-09-16T01:01:33.684371+0000","last_peered":"2024-09-16T01:01:33.684371+0000","last_clean":"2024-09-16T01:01:33.684371+0000","last_became_active":"2024-09-16T01:00:28.445456+0000","last_became_peered":"2024-09-16T01:00:28.445456+0000","last_unstale":"2024-09-16T01:01:33.684371+0000","last_undegraded":"2024-09-16T01:01:33.684371+0000","last_fullsized":"2024-09-16T01:01:33.684371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:30.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451378+0000","last_change":"2024-09-16T01:00:28.447437+0000","last_active":"2024-09-16T01:00:29.451378+0000","last_peered":"2024-09-16T01:00:29.451378+0000","last_clean":"2024-09-16T01:00:29.451378+0000","last_became_active":"2024-09-16T01:00:28.447108+0000","last_became_peered":"2024-09-16T01:00:28.447108+0000","last_unstale":"2024-09-16T01:00:29.451378+0000","last_undegraded":"2024-09-16T01:00:29.451378+0000","last_fullsized":"2024-09-16T01:00:29.451378+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:12.484102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445726+0000","last_change":"2024-09-16T01:00:28.452750+0000","last_active":"2024-09-16T01:00:29.445726+0000","last_peered":"2024-09-16T01:00:29.445726+0000","last_clean":"2024-09-16T01:00:29.445726+0000","last_became_active":"2024-09-16T01:00:28.452382+0000","last_became_peered":"2024-09-16T01:00:28.452382+0000","last_unstale":"2024-09-16T01:00:29.445726+0000","last_undegraded":"2024-09-16T01:00:29.445726+0000","last_fullsized":"2024-09-16T01:00:29.445726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.127201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.681847+0000","last_change":"2024-09-16T01:00:28.450220+0000","last_active":"2024-09-16T01:01:33.681847+0000","last_peered":"2024-09-16T01:01:33.681847+0000","last_clean":"2024-09-16T01:01:33.681847+0000","last_became_active":"2024-09-16T01:00:28.449824+0000","last_became_peered":"2024-09-16T01:00:28.449824+0000","last_unstale":"2024-09-16T01:01:33.681847+0000","last_undegraded":"2024-09-16T01:01:33.681847+0000","last_fullsized":"2024-09-16T01:01:33.681847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:08.428729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.683694+0000","last_change":"2024-09-16T01:00:28.447282+0000","last_active":"2024-09-16T01:01:33.683694+0000","last_peered":"2024-09-16T01:01:33.683694+0000","last_clean":"2024-09-16T01:01:33.683694+0000","last_became_active":"2024-09-16T01:00:28.446839+0000","last_became_peered":"2024-09-16T01:00:28.446839+0000","last_unstale":"2024-09-16T01:01:33.683694+0000","last_undegraded":"2024-09-16T01:01:33.683694+0000","last_fullsized":"2024-09-16T01:01:33.683694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:33.594170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.683844+0000","last_change":"2024-09-16T01:00:28.454019+0000","last_active":"2024-09-16T01:01:33.683844+0000","last_peered":"2024-09-16T01:01:33.683844+0000","last_clean":"2024-09-16T01:01:33.683844+0000","last_became_active":"2024-09-16T01:00:28.453706+0000","last_became_peered":"2024-09-16T01:00:28.453706+0000","last_unstale":"2024-09-16T01:01:33.683844+0000","last_undegraded":"2024-09-16T01:01:33.683844+0000","last_fullsized":"2024-09-16T01:01:33.683844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:09.704344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450704+0000","last_change":"2024-09-16T01:00:28.449323+0000","last_active":"2024-09-16T01:00:29.450704+0000","last_peered":"2024-09-16T01:00:29.450704+0000","last_clean":"2024-09-16T01:00:29.450704+0000","last_became_active":"2024-09-16T01:00:28.448536+0000","last_became_peered":"2024-09-16T01:00:28.448536+0000","last_unstale":"2024-09-16T01:00:29.450704+0000","last_undegraded":"2024-09-16T01:00:29.450704+0000","last_fullsized":"2024-09-16T01:00:29.450704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:11.145663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446668+0000","last_change":"2024-09-16T01:00:28.440882+0000","last_active":"2024-09-16T01:00:29.446668+0000","last_peered":"2024-09-16T01:00:29.446668+0000","last_clean":"2024-09-16T01:00:29.446668+0000","last_became_active":"2024-09-16T01:00:28.440496+0000","last_became_peered":"2024-09-16T01:00:28.440496+0000","last_unstale":"2024-09-16T01:00:29.446668+0000","last_undegraded":"2024-09-16T01:00:29.446668+0000","last_fullsized":"2024-09-16T01:00:29.446668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:16.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:29.587328+0000","last_change":"2024-09-16T01:00:26.357785+0000","last_active":"2024-09-16T01:01:29.587328+0000","last_peered":"2024-09-16T01:01:29.587328+0000","last_clean":"2024-09-16T01:01:29.587328+0000","last_became_active":"2024-09-16T01:00:26.357450+0000","last_became_peered":"2024-09-16T01:00:26.357450+0000","last_unstale":"2024-09-16T01:01:29.587328+0000","last_undegraded":"2024-09-16T01:01:29.587328+0000","last_fullsized":"2024-09-16T01:01:29.587328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.778996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433774+0000","last_change":"2024-09-16T01:00:28.454416+0000","last_active":"2024-09-16T01:00:29.433774+0000","last_peered":"2024-09-16T01:00:29.433774+0000","last_clean":"2024-09-16T01:00:29.433774+0000","last_became_active":"2024-09-16T01:00:28.454117+0000","last_became_peered":"2024-09-16T01:00:28.454117+0000","last_unstale":"2024-09-16T01:00:29.433774+0000","last_undegraded":"2024-09-16T01:00:29.433774+0000","last_fullsized":"2024-09-16T01:00:29.433774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:32.487601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.503539+0000","last_change":"2024-09-16T01:00:26.359828+0000","last_active":"2024-09-16T01:00:38.503539+0000","last_peered":"2024-09-16T01:00:38.503539+0000","last_clean":"2024-09-16T01:00:38.503539+0000","last_became_active":"2024-09-16T01:00:26.359520+0000","last_became_peered":"2024-09-16T01:00:26.359520+0000","last_unstale":"2024-09-16T01:00:38.503539+0000","last_undegraded":"2024-09-16T01:00:38.503539+0000","last_fullsized":"2024-09-16T01:00:38.503539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:14.477791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.493792+0000","last_change":"2024-09-16T01:00:26.353227+0000","last_active":"2024-09-16T01:00:37.493792+0000","last_peered":"2024-09-16T01:00:37.493792+0000","last_clean":"2024-09-16T01:00:37.493792+0000","last_became_active":"2024-09-16T01:00:26.352869+0000","last_became_peered":"2024-09-16T01:00:26.352869+0000","last_unstale":"2024-09-16T01:00:37.493792+0000","last_undegraded":"2024-09-16T01:00:37.493792+0000","last_fullsized":"2024-09-16T01:00:37.493792+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:48.035596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.755964+0000","last_change":"2024-09-16T01:00:28.444766+0000","last_active":"2024-09-16T01:01:33.755964+0000","last_peered":"2024-09-16T01:01:33.755964+0000","last_clean":"2024-09-16T01:01:33.755964+0000","last_became_active":"2024-09-16T01:00:28.444450+0000","last_became_peered":"2024-09-16T01:00:28.444450+0000","last_unstale":"2024-09-16T01:01:33.755964+0000","last_undegraded":"2024-09-16T01:01:33.755964+0000","last_fullsized":"2024-09-16T01:01:33.755964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:07.610462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510477+0000","last_change":"2024-09-16T01:00:26.357087+0000","last_active":"2024-09-16T01:00:39.510477+0000","last_peered":"2024-09-16T01:00:39.510477+0000","last_clean":"2024-09-16T01:00:39.510477+0000","last_became_active":"2024-09-16T01:00:26.356758+0000","last_became_peered":"2024-09-16T01:00:26.356758+0000","last_unstale":"2024-09-16T01:00:39.510477+0000","last_undegraded":"2024-09-16T01:00:39.510477+0000","last_fullsized":"2024-09-16T01:00:39.510477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:55.525693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445379+0000","last_change":"2024-09-16T01:00:28.438715+0000","last_active":"2024-09-16T01:00:29.445379+0000","last_peered":"2024-09-16T01:00:29.445379+0000","last_clean":"2024-09-16T01:00:29.445379+0000","last_became_active":"2024-09-16T01:00:28.438380+0000","last_became_peered":"2024-09-16T01:00:28.438380+0000","last_unstale":"2024-09-16T01:00:29.445379+0000","last_undegraded":"2024-09-16T01:00:29.445379+0000","last_fullsized":"2024-09-16T01:00:29.445379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:34.860495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.587849+0000","last_change":"2024-09-16T01:00:26.359263+0000","last_active":"2024-09-16T01:01:30.587849+0000","last_peered":"2024-09-16T01:01:30.587849+0000","last_clean":"2024-09-16T01:01:30.587849+0000","last_became_active":"2024-09-16T01:00:26.358936+0000","last_became_peered":"2024-09-16T01:00:26.358936+0000","last_unstale":"2024-09-16T01:01:30.587849+0000","last_undegraded":"2024-09-16T01:01:30.587849+0000","last_fullsized":"2024-09-16T01:01:30.587849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:31.125243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.685535+0000","last_change":"2024-09-16T01:00:28.445330+0000","last_active":"2024-09-16T01:01:33.685535+0000","last_peered":"2024-09-16T01:01:33.685535+0000","last_clean":"2024-09-16T01:01:33.685535+0000","last_became_active":"2024-09-16T01:00:28.444913+0000","last_became_peered":"2024-09-16T01:00:28.444913+0000","last_unstale":"2024-09-16T01:01:33.685535+0000","last_undegraded":"2024-09-16T01:01:33.685535+0000","last_fullsized":"2024-09-16T01:01:33.685535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:16.583722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509989+0000","last_change":"2024-09-16T01:00:26.356972+0000","last_active":"2024-09-16T01:00:39.509989+0000","last_peered":"2024-09-16T01:00:39.509989+0000","last_clean":"2024-09-16T01:00:39.509989+0000","last_became_active":"2024-09-16T01:00:26.356525+0000","last_became_peered":"2024-09-16T01:00:26.356525+0000","last_unstale":"2024-09-16T01:00:39.509989+0000","last_undegraded":"2024-09-16T01:00:39.509989+0000","last_fullsized":"2024-09-16T01:00:39.509989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:42.908179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.682065+0000","last_change":"2024-09-16T01:00:28.449732+0000","last_active":"2024-09-16T01:01:33.682065+0000","last_peered":"2024-09-16T01:01:33.682065+0000","last_clean":"2024-09-16T01:01:33.682065+0000","last_became_active":"2024-09-16T01:00:28.449325+0000","last_became_peered":"2024-09-16T01:00:28.449325+0000","last_unstale":"2024-09-16T01:01:33.682065+0000","last_undegraded":"2024-09-16T01:01:33.682065+0000","last_fullsized":"2024-09-16T01:01:33.682065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:55.370952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:38.502667+0000","last_change":"2024-09-16T01:00:26.746513+0000","last_active":"2024-09-16T01:00:38.502667+0000","last_peered":"2024-09-16T01:00:38.502667+0000","last_clean":"2024-09-16T01:00:38.502667+0000","last_became_active":"2024-09-16T01:00:26.746114+0000","last_became_peered":"2024-09-16T01:00:26.746114+0000","last_unstale":"2024-09-16T01:00:38.502667+0000","last_undegraded":"2024-09-16T01:00:38.502667+0000","last_fullsized":"2024-09-16T01:00:38.502667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684527+0000","last_change":"2024-09-16T01:00:28.452854+0000","last_active":"2024-09-16T01:01:33.684527+0000","last_peered":"2024-09-16T01:01:33.684527+0000","last_clean":"2024-09-16T01:01:33.684527+0000","last_became_active":"2024-09-16T01:00:28.452548+0000","last_became_peered":"2024-09-16T01:00:28.452548+0000","last_unstale":"2024-09-16T01:01:33.684527+0000","last_undegraded":"2024-09-16T01:01:33.684527+0000","last_fullsized":"2024-09-16T01:01:33.684527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:12.527860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":159,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.587834+0000","last_change":"2024-09-16T01:00:26.361221+0000","last_active":"2024-09-16T01:01:30.587834+0000","last_peered":"2024-09-16T01:01:30.587834+0000","last_clean":"2024-09-16T01:01:30.587834+0000","last_became_active":"2024-09-16T01:00:26.360785+0000","last_became_peered":"2024-09-16T01:00:26.360785+0000","last_unstale":"2024-09-16T01:01:30.587834+0000","last_undegraded":"2024-09-16T01:01:30.587834+0000","last_fullsized":"2024-09-16T01:01:30.587834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:07.145342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":113,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447395+0000","last_change":"2024-09-16T01:00:28.443905+0000","last_active":"2024-09-16T01:00:29.447395+0000","last_peered":"2024-09-16T01:00:29.447395+0000","last_clean":"2024-09-16T01:00:29.447395+0000","last_became_active":"2024-09-16T01:00:28.442808+0000","last_became_peered":"2024-09-16T01:00:28.442808+0000","last_unstale":"2024-09-16T01:00:29.447395+0000","last_undegraded":"2024-09-16T01:00:29.447395+0000","last_fullsized":"2024-09-16T01:00:29.447395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684560+0000","last_change":"2024-09-16T01:00:26.358696+0000","last_active":"2024-09-16T01:01:33.684560+0000","last_peered":"2024-09-16T01:01:33.684560+0000","last_clean":"2024-09-16T01:01:33.684560+0000","last_became_active":"2024-09-16T01:00:26.358306+0000","last_became_peered":"2024-09-16T01:00:26.358306+0000","last_unstale":"2024-09-16T01:01:33.684560+0000","last_undegraded":"2024-09-16T01:01:33.684560+0000","last_fullsized":"2024-09-16T01:01:33.684560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:34.811501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445791+0000","last_change":"2024-09-16T01:00:28.439511+0000","last_active":"2024-09-16T01:00:29.445791+0000","last_peered":"2024-09-16T01:00:29.445791+0000","last_clean":"2024-09-16T01:00:29.445791+0000","last_became_active":"2024-09-16T01:00:28.439204+0000","last_became_peered":"2024-09-16T01:00:28.439204+0000","last_unstale":"2024-09-16T01:00:29.445791+0000","last_undegraded":"2024-09-16T01:00:29.445791+0000","last_fullsized":"2024-09-16T01:00:29.445791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:00.331186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510658+0000","last_change":"2024-09-16T01:00:26.357142+0000","last_active":"2024-09-16T01:00:39.510658+0000","last_peered":"2024-09-16T01:00:39.510658+0000","last_clean":"2024-09-16T01:00:39.510658+0000","last_became_active":"2024-09-16T01:00:26.356738+0000","last_became_peered":"2024-09-16T01:00:26.356738+0000","last_unstale":"2024-09-16T01:00:39.510658+0000","last_undegraded":"2024-09-16T01:00:39.510658+0000","last_fullsized":"2024-09-16T01:00:39.510658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:41.895356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446568+0000","last_change":"2024-09-16T01:00:28.449767+0000","last_active":"2024-09-16T01:00:29.446568+0000","last_peered":"2024-09-16T01:00:29.446568+0000","last_clean":"2024-09-16T01:00:29.446568+0000","last_became_active":"2024-09-16T01:00:28.449454+0000","last_became_peered":"2024-09-16T01:00:28.449454+0000","last_unstale":"2024-09-16T01:00:29.446568+0000","last_undegraded":"2024-09-16T01:00:29.446568+0000","last_fullsized":"2024-09-16T01:00:29.446568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:44.395194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:28.579110+0000","last_change":"2024-09-16T01:00:26.358441+0000","last_active":"2024-09-16T01:01:28.579110+0000","last_peered":"2024-09-16T01:01:28.579110+0000","last_clean":"2024-09-16T01:01:28.579110+0000","last_became_active":"2024-09-16T01:00:26.358110+0000","last_became_peered":"2024-09-16T01:00:26.358110+0000","last_unstale":"2024-09-16T01:01:28.579110+0000","last_undegraded":"2024-09-16T01:01:28.579110+0000","last_fullsized":"2024-09-16T01:01:28.579110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:22.352749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446963+0000","last_change":"2024-09-16T01:00:28.447408+0000","last_active":"2024-09-16T01:00:29.446963+0000","last_peered":"2024-09-16T01:00:29.446963+0000","last_clean":"2024-09-16T01:00:29.446963+0000","last_became_active":"2024-09-16T01:00:28.447089+0000","last_became_peered":"2024-09-16T01:00:28.447089+0000","last_unstale":"2024-09-16T01:00:29.446963+0000","last_undegraded":"2024-09-16T01:00:29.446963+0000","last_fullsized":"2024-09-16T01:00:29.446963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:40.081429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508119+0000","last_change":"2024-09-16T01:00:26.745619+0000","last_active":"2024-09-16T01:00:39.508119+0000","last_peered":"2024-09-16T01:00:39.508119+0000","last_clean":"2024-09-16T01:00:39.508119+0000","last_became_active":"2024-09-16T01:00:26.745265+0000","last_became_peered":"2024-09-16T01:00:26.745265+0000","last_unstale":"2024-09-16T01:00:39.508119+0000","last_undegraded":"2024-09-16T01:00:39.508119+0000","last_fullsized":"2024-09-16T01:00:39.508119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:54.254160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434189+0000","last_change":"2024-09-16T01:00:28.456065+0000","last_active":"2024-09-16T01:00:29.434189+0000","last_peered":"2024-09-16T01:00:29.434189+0000","last_clean":"2024-09-16T01:00:29.434189+0000","last_became_active":"2024-09-16T01:00:28.455692+0000","last_became_peered":"2024-09-16T01:00:28.455692+0000","last_unstale":"2024-09-16T01:00:29.434189+0000","last_undegraded":"2024-09-16T01:00:29.434189+0000","last_fullsized":"2024-09-16T01:00:29.434189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:14.782985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.489340+0000","last_change":"2024-09-16T01:00:26.354191+0000","last_active":"2024-09-16T01:00:39.489340+0000","last_peered":"2024-09-16T01:00:39.489340+0000","last_clean":"2024-09-16T01:00:39.489340+0000","last_became_active":"2024-09-16T01:00:26.353753+0000","last_became_peered":"2024-09-16T01:00:26.353753+0000","last_unstale":"2024-09-16T01:00:39.489340+0000","last_undegraded":"2024-09-16T01:00:39.489340+0000","last_fullsized":"2024-09-16T01:00:39.489340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:16.098449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.451025+0000","last_change":"2024-09-16T01:00:28.451056+0000","last_active":"2024-09-16T01:00:29.451025+0000","last_peered":"2024-09-16T01:00:29.451025+0000","last_clean":"2024-09-16T01:00:29.451025+0000","last_became_active":"2024-09-16T01:00:28.449801+0000","last_became_peered":"2024-09-16T01:00:28.449801+0000","last_unstale":"2024-09-16T01:00:29.451025+0000","last_undegraded":"2024-09-16T01:00:29.451025+0000","last_fullsized":"2024-09-16T01:00:29.451025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:06.207854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508582+0000","last_change":"2024-09-16T01:00:26.355975+0000","last_active":"2024-09-16T01:00:39.508582+0000","last_peered":"2024-09-16T01:00:39.508582+0000","last_clean":"2024-09-16T01:00:39.508582+0000","last_became_active":"2024-09-16T01:00:26.355629+0000","last_became_peered":"2024-09-16T01:00:26.355629+0000","last_unstale":"2024-09-16T01:00:39.508582+0000","last_undegraded":"2024-09-16T01:00:39.508582+0000","last_fullsized":"2024-09-16T01:00:39.508582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:06.812991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446815+0000","last_change":"2024-09-16T01:00:28.444387+0000","last_active":"2024-09-16T01:00:29.446815+0000","last_peered":"2024-09-16T01:00:29.446815+0000","last_clean":"2024-09-16T01:00:29.446815+0000","last_became_active":"2024-09-16T01:00:28.444076+0000","last_became_peered":"2024-09-16T01:00:28.444076+0000","last_unstale":"2024-09-16T01:00:29.446815+0000","last_undegraded":"2024-09-16T01:00:29.446815+0000","last_fullsized":"2024-09-16T01:00:29.446815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:50.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.508980+0000","last_change":"2024-09-16T01:00:26.357038+0000","last_active":"2024-09-16T01:00:39.508980+0000","last_peered":"2024-09-16T01:00:39.508980+0000","last_clean":"2024-09-16T01:00:39.508980+0000","last_became_active":"2024-09-16T01:00:26.356599+0000","last_became_peered":"2024-09-16T01:00:26.356599+0000","last_unstale":"2024-09-16T01:00:39.508980+0000","last_undegraded":"2024-09-16T01:00:39.508980+0000","last_fullsized":"2024-09-16T01:00:39.508980+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.288180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.833185+0000","last_change":"2024-09-16T01:00:28.443408+0000","last_active":"2024-09-16T01:00:31.833185+0000","last_peered":"2024-09-16T01:00:31.833185+0000","last_clean":"2024-09-16T01:00:31.833185+0000","last_became_active":"2024-09-16T01:00:28.443016+0000","last_became_peered":"2024-09-16T01:00:28.443016+0000","last_unstale":"2024-09-16T01:00:31.833185+0000","last_undegraded":"2024-09-16T01:00:31.833185+0000","last_fullsized":"2024-09-16T01:00:31.833185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:29.801811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684641+0000","last_change":"2024-09-16T01:00:27.056514+0000","last_active":"2024-09-16T01:01:33.684641+0000","last_peered":"2024-09-16T01:01:33.684641+0000","last_clean":"2024-09-16T01:01:33.684641+0000","last_became_active":"2024-09-16T01:00:27.056137+0000","last_became_peered":"2024-09-16T01:00:27.056137+0000","last_unstale":"2024-09-16T01:01:33.684641+0000","last_undegraded":"2024-09-16T01:01:33.684641+0000","last_fullsized":"2024-09-16T01:01:33.684641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:07.480345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446792+0000","last_change":"2024-09-16T01:00:28.445866+0000","last_active":"2024-09-16T01:00:29.446792+0000","last_peered":"2024-09-16T01:00:29.446792+0000","last_clean":"2024-09-16T01:00:29.446792+0000","last_became_active":"2024-09-16T01:00:28.445454+0000","last_became_peered":"2024-09-16T01:00:28.445454+0000","last_unstale":"2024-09-16T01:00:29.446792+0000","last_undegraded":"2024-09-16T01:00:29.446792+0000","last_fullsized":"2024-09-16T01:00:29.446792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:44.340565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446297+0000","last_change":"2024-09-16T00:59:14.381567+0000","last_active":"2024-09-16T01:00:29.446297+0000","last_peered":"2024-09-16T01:00:29.446297+0000","last_clean":"2024-09-16T01:00:29.446297+0000","last_became_active":"2024-09-16T00:59:14.381088+0000","last_became_peered":"2024-09-16T00:59:14.381088+0000","last_unstale":"2024-09-16T01:00:29.446297+0000","last_undegraded":"2024-09-16T01:00:29.446297+0000","last_fullsized":"2024-09-16T01:00:29.446297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:55:49.599122+0000","last_clean_scrub_stamp":"2024-09-16T00:55:49.599122+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:14.170832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.512169+0000","last_change":"2024-09-16T01:00:26.357699+0000","last_active":"2024-09-16T01:00:40.512169+0000","last_peered":"2024-09-16T01:00:40.512169+0000","last_clean":"2024-09-16T01:00:40.512169+0000","last_became_active":"2024-09-16T01:00:26.357186+0000","last_became_peered":"2024-09-16T01:00:26.357186+0000","last_unstale":"2024-09-16T01:00:40.512169+0000","last_undegraded":"2024-09-16T01:00:40.512169+0000","last_fullsized":"2024-09-16T01:00:40.512169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:48.026723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756069+0000","last_change":"2024-09-16T01:00:28.446677+0000","last_active":"2024-09-16T01:01:33.756069+0000","last_peered":"2024-09-16T01:01:33.756069+0000","last_clean":"2024-09-16T01:01:33.756069+0000","last_became_active":"2024-09-16T01:00:28.446337+0000","last_became_peered":"2024-09-16T01:00:28.446337+0000","last_unstale":"2024-09-16T01:01:33.756069+0000","last_undegraded":"2024-09-16T01:01:33.756069+0000","last_fullsized":"2024-09-16T01:01:33.756069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:45.890312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:37.491499+0000","last_change":"2024-09-16T01:00:26.360153+0000","last_active":"2024-09-16T01:00:37.491499+0000","last_peered":"2024-09-16T01:00:37.491499+0000","last_clean":"2024-09-16T01:00:37.491499+0000","last_became_active":"2024-09-16T01:00:26.359828+0000","last_became_peered":"2024-09-16T01:00:26.359828+0000","last_unstale":"2024-09-16T01:00:37.491499+0000","last_undegraded":"2024-09-16T01:00:37.491499+0000","last_fullsized":"2024-09-16T01:00:37.491499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:27.478655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445683+0000","last_change":"2024-09-16T01:00:28.446587+0000","last_active":"2024-09-16T01:00:29.445683+0000","last_peered":"2024-09-16T01:00:29.445683+0000","last_clean":"2024-09-16T01:00:29.445683+0000","last_became_active":"2024-09-16T01:00:28.446221+0000","last_became_peered":"2024-09-16T01:00:28.446221+0000","last_unstale":"2024-09-16T01:00:29.445683+0000","last_undegraded":"2024-09-16T01:00:29.445683+0000","last_fullsized":"2024-09-16T01:00:29.445683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:07.027765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:29.579950+0000","last_change":"2024-09-16T01:00:26.745384+0000","last_active":"2024-09-16T01:01:29.579950+0000","last_peered":"2024-09-16T01:01:29.579950+0000","last_clean":"2024-09-16T01:01:29.579950+0000","last_became_active":"2024-09-16T01:00:26.745056+0000","last_became_peered":"2024-09-16T01:00:26.745056+0000","last_unstale":"2024-09-16T01:01:29.579950+0000","last_undegraded":"2024-09-16T01:01:29.579950+0000","last_fullsized":"2024-09-16T01:01:29.579950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:18.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.433772+0000","last_change":"2024-09-16T01:00:28.454156+0000","last_active":"2024-09-16T01:00:29.433772+0000","last_peered":"2024-09-16T01:00:29.433772+0000","last_clean":"2024-09-16T01:00:29.433772+0000","last_became_active":"2024-09-16T01:00:28.453798+0000","last_became_peered":"2024-09-16T01:00:28.453798+0000","last_unstale":"2024-09-16T01:00:29.433772+0000","last_undegraded":"2024-09-16T01:00:29.433772+0000","last_fullsized":"2024-09-16T01:00:29.433772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.617433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.581666+0000","last_change":"2024-09-16T01:00:26.356232+0000","last_active":"2024-09-16T01:01:30.581666+0000","last_peered":"2024-09-16T01:01:30.581666+0000","last_clean":"2024-09-16T01:01:30.581666+0000","last_became_active":"2024-09-16T01:00:26.355874+0000","last_became_peered":"2024-09-16T01:00:26.355874+0000","last_unstale":"2024-09-16T01:01:30.581666+0000","last_undegraded":"2024-09-16T01:01:30.581666+0000","last_fullsized":"2024-09-16T01:01:30.581666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:53.426341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.447525+0000","last_change":"2024-09-16T01:00:28.453279+0000","last_active":"2024-09-16T01:00:29.447525+0000","last_peered":"2024-09-16T01:00:29.447525+0000","last_clean":"2024-09-16T01:00:29.447525+0000","last_became_active":"2024-09-16T01:00:28.452808+0000","last_became_peered":"2024-09-16T01:00:28.452808+0000","last_unstale":"2024-09-16T01:00:29.447525+0000","last_undegraded":"2024-09-16T01:00:29.447525+0000","last_fullsized":"2024-09-16T01:00:29.447525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:06.096145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446100+0000","last_change":"2024-09-16T01:00:26.745692+0000","last_active":"2024-09-16T01:00:29.446100+0000","last_peered":"2024-09-16T01:00:29.446100+0000","last_clean":"2024-09-16T01:00:29.446100+0000","last_became_active":"2024-09-16T01:00:26.745325+0000","last_became_peered":"2024-09-16T01:00:26.745325+0000","last_unstale":"2024-09-16T01:00:29.446100+0000","last_undegraded":"2024-09-16T01:00:29.446100+0000","last_fullsized":"2024-09-16T01:00:29.446100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:19.061145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:31.358735+0000","last_change":"2024-09-16T01:00:28.452501+0000","last_active":"2024-09-16T01:00:31.358735+0000","last_peered":"2024-09-16T01:00:31.358735+0000","last_clean":"2024-09-16T01:00:31.358735+0000","last_became_active":"2024-09-16T01:00:28.451938+0000","last_became_peered":"2024-09-16T01:00:28.451938+0000","last_unstale":"2024-09-16T01:00:31.358735+0000","last_undegraded":"2024-09-16T01:00:31.358735+0000","last_fullsized":"2024-09-16T01:00:31.358735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:12.762849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.510447+0000","last_change":"2024-09-16T01:00:26.746438+0000","last_active":"2024-09-16T01:00:39.510447+0000","last_peered":"2024-09-16T01:00:39.510447+0000","last_clean":"2024-09-16T01:00:39.510447+0000","last_became_active":"2024-09-16T01:00:26.746067+0000","last_became_peered":"2024-09-16T01:00:26.746067+0000","last_unstale":"2024-09-16T01:00:39.510447+0000","last_undegraded":"2024-09-16T01:00:39.510447+0000","last_fullsized":"2024-09-16T01:00:39.510447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:10.792354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.445879+0000","last_change":"2024-09-16T01:00:28.446067+0000","last_active":"2024-09-16T01:00:29.445879+0000","last_peered":"2024-09-16T01:00:29.445879+0000","last_clean":"2024-09-16T01:00:29.445879+0000","last_became_active":"2024-09-16T01:00:28.445669+0000","last_became_peered":"2024-09-16T01:00:28.445669+0000","last_unstale":"2024-09-16T01:00:29.445879+0000","last_undegraded":"2024-09-16T01:00:29.445879+0000","last_fullsized":"2024-09-16T01:00:29.445879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:30.172271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:53.445828+0000","last_change":"2024-09-16T01:00:26.351033+0000","last_active":"2024-09-16T01:00:53.445828+0000","last_peered":"2024-09-16T01:00:53.445828+0000","last_clean":"2024-09-16T01:00:53.445828+0000","last_became_active":"2024-09-16T01:00:26.350670+0000","last_became_peered":"2024-09-16T01:00:26.350670+0000","last_unstale":"2024-09-16T01:00:53.445828+0000","last_undegraded":"2024-09-16T01:00:53.445828+0000","last_fullsized":"2024-09-16T01:00:53.445828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:23.634635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756362+0000","last_change":"2024-09-16T01:00:28.445229+0000","last_active":"2024-09-16T01:01:33.756362+0000","last_peered":"2024-09-16T01:01:33.756362+0000","last_clean":"2024-09-16T01:01:33.756362+0000","last_became_active":"2024-09-16T01:00:28.444794+0000","last_became_peered":"2024-09-16T01:00:28.444794+0000","last_unstale":"2024-09-16T01:01:33.756362+0000","last_undegraded":"2024-09-16T01:01:33.756362+0000","last_fullsized":"2024-09-16T01:01:33.756362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:05:34.117777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509104+0000","last_change":"2024-09-16T01:00:27.056718+0000","last_active":"2024-09-16T01:00:39.509104+0000","last_peered":"2024-09-16T01:00:39.509104+0000","last_clean":"2024-09-16T01:00:39.509104+0000","last_became_active":"2024-09-16T01:00:27.056331+0000","last_became_peered":"2024-09-16T01:00:27.056331+0000","last_unstale":"2024-09-16T01:00:39.509104+0000","last_undegraded":"2024-09-16T01:00:39.509104+0000","last_fullsized":"2024-09-16T01:00:39.509104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:47.094865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.682064+0000","last_change":"2024-09-16T01:00:28.453630+0000","last_active":"2024-09-16T01:01:33.682064+0000","last_peered":"2024-09-16T01:01:33.682064+0000","last_clean":"2024-09-16T01:01:33.682064+0000","last_became_active":"2024-09-16T01:00:28.453272+0000","last_became_peered":"2024-09-16T01:00:28.453272+0000","last_unstale":"2024-09-16T01:01:33.682064+0000","last_undegraded":"2024-09-16T01:01:33.682064+0000","last_fullsized":"2024-09-16T01:01:33.682064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:44.722743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.683826+0000","last_change":"2024-09-16T01:00:26.745355+0000","last_active":"2024-09-16T01:01:33.683826+0000","last_peered":"2024-09-16T01:01:33.683826+0000","last_clean":"2024-09-16T01:01:33.683826+0000","last_became_active":"2024-09-16T01:00:26.745042+0000","last_became_peered":"2024-09-16T01:00:26.745042+0000","last_unstale":"2024-09-16T01:01:33.683826+0000","last_undegraded":"2024-09-16T01:01:33.683826+0000","last_fullsized":"2024-09-16T01:01:33.683826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:29.934482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446606+0000","last_change":"2024-09-16T01:00:28.441231+0000","last_active":"2024-09-16T01:00:29.446606+0000","last_peered":"2024-09-16T01:00:29.446606+0000","last_clean":"2024-09-16T01:00:29.446606+0000","last_became_active":"2024-09-16T01:00:28.440849+0000","last_became_peered":"2024-09-16T01:00:28.440849+0000","last_unstale":"2024-09-16T01:00:29.446606+0000","last_undegraded":"2024-09-16T01:00:29.446606+0000","last_fullsized":"2024-09-16T01:00:29.446606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:09.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756054+0000","last_change":"2024-09-16T01:00:26.357171+0000","last_active":"2024-09-16T01:01:33.756054+0000","last_peered":"2024-09-16T01:01:33.756054+0000","last_clean":"2024-09-16T01:01:33.756054+0000","last_became_active":"2024-09-16T01:00:26.356843+0000","last_became_peered":"2024-09-16T01:00:26.356843+0000","last_unstale":"2024-09-16T01:01:33.756054+0000","last_undegraded":"2024-09-16T01:01:33.756054+0000","last_fullsized":"2024-09-16T01:01:33.756054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:38.576314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.450981+0000","last_change":"2024-09-16T01:00:28.450917+0000","last_active":"2024-09-16T01:00:29.450981+0000","last_peered":"2024-09-16T01:00:29.450981+0000","last_clean":"2024-09-16T01:00:29.450981+0000","last_became_active":"2024-09-16T01:00:28.448978+0000","last_became_peered":"2024-09-16T01:00:28.448978+0000","last_unstale":"2024-09-16T01:00:29.450981+0000","last_undegraded":"2024-09-16T01:00:29.450981+0000","last_fullsized":"2024-09-16T01:00:29.450981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:30.270617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.683803+0000","last_change":"2024-09-16T01:00:26.360356+0000","last_active":"2024-09-16T01:01:33.683803+0000","last_peered":"2024-09-16T01:01:33.683803+0000","last_clean":"2024-09-16T01:01:33.683803+0000","last_became_active":"2024-09-16T01:00:26.359647+0000","last_became_peered":"2024-09-16T01:00:26.359647+0000","last_unstale":"2024-09-16T01:01:33.683803+0000","last_undegraded":"2024-09-16T01:01:33.683803+0000","last_fullsized":"2024-09-16T01:01:33.683803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:47.857659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756052+0000","last_change":"2024-09-16T01:00:28.444726+0000","last_active":"2024-09-16T01:01:33.756052+0000","last_peered":"2024-09-16T01:01:33.756052+0000","last_clean":"2024-09-16T01:01:33.756052+0000","last_became_active":"2024-09-16T01:00:28.444418+0000","last_became_peered":"2024-09-16T01:00:28.444418+0000","last_unstale":"2024-09-16T01:01:33.756052+0000","last_undegraded":"2024-09-16T01:01:33.756052+0000","last_fullsized":"2024-09-16T01:01:33.756052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:38.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:36.484905+0000","last_change":"2024-09-16T01:00:26.357369+0000","last_active":"2024-09-16T01:00:36.484905+0000","last_peered":"2024-09-16T01:00:36.484905+0000","last_clean":"2024-09-16T01:00:36.484905+0000","last_became_active":"2024-09-16T01:00:26.356253+0000","last_became_peered":"2024-09-16T01:00:26.356253+0000","last_unstale":"2024-09-16T01:00:36.484905+0000","last_undegraded":"2024-09-16T01:00:36.484905+0000","last_fullsized":"2024-09-16T01:00:36.484905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:03.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.446325+0000","last_change":"2024-09-16T01:00:28.446488+0000","last_active":"2024-09-16T01:00:29.446325+0000","last_peered":"2024-09-16T01:00:29.446325+0000","last_clean":"2024-09-16T01:00:29.446325+0000","last_became_active":"2024-09-16T01:00:28.446004+0000","last_became_peered":"2024-09-16T01:00:28.446004+0000","last_unstale":"2024-09-16T01:00:29.446325+0000","last_undegraded":"2024-09-16T01:00:29.446325+0000","last_fullsized":"2024-09-16T01:00:29.446325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:43.923219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:29.434044+0000","last_change":"2024-09-16T01:00:28.455484+0000","last_active":"2024-09-16T01:00:29.434044+0000","last_peered":"2024-09-16T01:00:29.434044+0000","last_clean":"2024-09-16T01:00:29.434044+0000","last_became_active":"2024-09-16T01:00:28.455142+0000","last_became_peered":"2024-09-16T01:00:28.455142+0000","last_unstale":"2024-09-16T01:00:29.434044+0000","last_undegraded":"2024-09-16T01:00:29.434044+0000","last_fullsized":"2024-09-16T01:00:29.434044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:50:19.274265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:39.509963+0000","last_change":"2024-09-16T01:00:26.354531+0000","last_active":"2024-09-16T01:00:39.509963+0000","last_peered":"2024-09-16T01:00:39.509963+0000","last_clean":"2024-09-16T01:00:39.509963+0000","last_became_active":"2024-09-16T01:00:26.354207+0000","last_became_peered":"2024-09-16T01:00:26.354207+0000","last_unstale":"2024-09-16T01:00:39.509963+0000","last_undegraded":"2024-09-16T01:00:39.509963+0000","last_fullsized":"2024-09-16T01:00:39.509963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:20.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.684417+0000","last_change":"2024-09-16T01:00:28.439318+0000","last_active":"2024-09-16T01:01:33.684417+0000","last_peered":"2024-09-16T01:01:33.684417+0000","last_clean":"2024-09-16T01:01:33.684417+0000","last_became_active":"2024-09-16T01:00:28.437874+0000","last_became_peered":"2024-09-16T01:00:28.437874+0000","last_unstale":"2024-09-16T01:01:33.684417+0000","last_undegraded":"2024-09-16T01:01:33.684417+0000","last_fullsized":"2024-09-16T01:01:33.684417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:59.207551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:00:40.505737+0000","last_change":"2024-09-16T01:00:26.355952+0000","last_active":"2024-09-16T01:00:40.505737+0000","last_peered":"2024-09-16T01:00:40.505737+0000","last_clean":"2024-09-16T01:00:40.505737+0000","last_became_active":"2024-09-16T01:00:26.355600+0000","last_became_peered":"2024-09-16T01:00:26.355600+0000","last_unstale":"2024-09-16T01:00:40.505737+0000","last_undegraded":"2024-09-16T01:00:40.505737+0000","last_fullsized":"2024-09-16T01:00:40.505737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:29.294004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.682026+0000","last_change":"2024-09-16T01:00:28.440130+0000","last_active":"2024-09-16T01:01:33.682026+0000","last_peered":"2024-09-16T01:01:33.682026+0000","last_clean":"2024-09-16T01:01:33.682026+0000","last_became_active":"2024-09-16T01:00:28.439805+0000","last_became_peered":"2024-09-16T01:00:28.439805+0000","last_unstale":"2024-09-16T01:01:33.682026+0000","last_undegraded":"2024-09-16T01:01:33.682026+0000","last_fullsized":"2024-09-16T01:01:33.682026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:38.977930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756341+0000","last_change":"2024-09-16T01:00:26.745139+0000","last_active":"2024-09-16T01:01:33.756341+0000","last_peered":"2024-09-16T01:01:33.756341+0000","last_clean":"2024-09-16T01:01:33.756341+0000","last_became_active":"2024-09-16T01:00:26.744796+0000","last_became_peered":"2024-09-16T01:00:26.744796+0000","last_unstale":"2024-09-16T01:01:33.756341+0000","last_undegraded":"2024-09-16T01:01:33.756341+0000","last_fullsized":"2024-09-16T01:01:33.756341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:29.368451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T01:01:33.756213+0000","last_change":"2024-09-16T01:00:28.449380+0000","last_active":"2024-09-16T01:01:33.756213+0000","last_peered":"2024-09-16T01:01:33.756213+0000","last_clean":"2024-09-16T01:01:33.756213+0000","last_became_active":"2024-09-16T01:00:28.448826+0000","last_became_peered":"2024-09-16T01:00:28.448826+0000","last_unstale":"2024-09-16T01:01:33.756213+0000","last_undegraded":"2024-09-16T01:01:33.756213+0000","last_fullsized":"2024-09-16T01:01:33.756213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:27.415988+0000","last_clean_scrub_stamp":"2024-09-16T01:00:27.415988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:19.987506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T01:01:30.581053+0000","last_change":"2024-09-16T01:00:26.354148+0000","last_active":"2024-09-16T01:01:30.581053+0000","last_peered":"2024-09-16T01:01:30.581053+0000","last_clean":"2024-09-16T01:01:30.581053+0000","last_became_active":"2024-09-16T01:00:26.353477+0000","last_became_peered":"2024-09-16T01:00:26.353477+0000","last_unstale":"2024-09-16T01:01:30.581053+0000","last_undegraded":"2024-09-16T01:01:30.581053+0000","last_fullsized":"2024-09-16T01:01:30.581053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:00:25.340500+0000","last_clean_scrub_stamp":"2024-09-16T01:00:25.340500+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:44.715792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67758,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":558,"num_read_kb":352,"num_write":244,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":203274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215943,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":417671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1068464,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":417586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":1010892,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1009784,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":417179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":909312,"data_stored":425393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":487251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":486638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":418657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34623,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:01:36.008 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:01:36.008 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T01:01:36.009 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T01:01:36.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T01:01:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:35 smithi088 ceph-mon[34093]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:01:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:35 smithi088 ceph-mon[34093]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:35 smithi154 ceph-mon[34759]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:01:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:35 smithi154 ceph-mon[34759]: from='mgr.14150 172.21.15.17:0/1047426101' entity='mgr.x' 2024-09-16T01:01:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 -- 172.21.15.17:0/2736355785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 msgr2=0x7f67e410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/2736355785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e410ea90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009900 tx=0x7f67dc02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 -- 172.21.15.17:0/2736355785 shutdown_connections 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/2736355785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e410ea90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/2736355785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 0x7f67e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/2736355785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 -- 172.21.15.17:0/2736355785 >> 172.21.15.17:0/2736355785 conn(0x7f67e40fd8c0 msgr2=0x7f67e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 -- 172.21.15.17:0/2736355785 shutdown_connections 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.885+0000 7f67e9e0a640 1 -- 172.21.15.17:0/2736355785 wait complete. 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.886+0000 7f67e9e0a640 1 Processor -- start 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.886+0000 7f67e9e0a640 1 -- start start 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.886+0000 7f67e9e0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e4198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.886+0000 7f67e9e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 0x7f67e4198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.886+0000 7f67e9e0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e9e0a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111e20 con 0x7f67e4106f10 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e9e0a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111ca0 con 0x7f67e4101de0 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e9e0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4111fa0 con 0x7f67e4102790 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43600/0 (socket says 172.21.15.17:43600) 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 -- 172.21.15.17:0/863936108 learned_addr learned my addr 172.21.15.17:0/863936108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e2ffd640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 0x7f67e4198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e37fe640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e4198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 -- 172.21.15.17:0/863936108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 msgr2=0x7f67e4198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 0x7f67e4198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 -- 172.21.15.17:0/863936108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 msgr2=0x7f67e4198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e4198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 -- 172.21.15.17:0/863936108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e419d1f0 con 0x7f67e4106f10 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e37fe640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e4198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e3fff640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009230 tx=0x7f67dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc03f030 con 0x7f67e4106f10 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e419d480 con 0x7f67e4106f10 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67dc003aa0 con 0x7f67e4106f10 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc035070 con 0x7f67e4106f10 2024-09-16T01:01:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.887+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41a4dc0 con 0x7f67e4106f10 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.889+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e41021c0 con 0x7f67e4106f10 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.890+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f67dc042030 con 0x7f67e4106f10 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.890+0000 7f67e0ff9640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 0x7f67cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.890+0000 7f67e37fe640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 0x7f67cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.890+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f67dc0efe70 con 0x7f67e4106f10 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.891+0000 7f67e37fe640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 0x7f67cc0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67d4007e70 tx=0x7f67d4007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:36.894+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67dc0bca40 con 0x7f67e4106f10 2024-09-16T01:01:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.110+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f67e410a0f0 con 0x7f67e4106f10 2024-09-16T01:01:37.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:36 smithi017 ceph-mon[31211]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:01:37.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:36 smithi017 ceph-mon[31211]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:37.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.111+0000 7f67e0ff9640 1 -- 172.21.15.17:0/863936108 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f67dc0bc340 con 0x7f67e4106f10 2024-09-16T01:01:37.112 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:01:37.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 msgr2=0x7f67cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:37.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 0x7f67cc0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67d4007e70 tx=0x7f67d4007850 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 msgr2=0x7f67e419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009230 tx=0x7f67dc004270 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 shutdown_connections 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f67cc0a32d0 0x7f67cc0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4106f10 0x7f67e419cb10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e4102790 0x7f67e4198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 --2- 172.21.15.17:0/863936108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67e4101de0 0x7f67e4198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 >> 172.21.15.17:0/863936108 conn(0x7f67e40fd8c0 msgr2=0x7f67e40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 shutdown_connections 2024-09-16T01:01:37.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:37.113+0000 7f67e9e0a640 1 -- 172.21.15.17:0/863936108 wait complete. 2024-09-16T01:01:37.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:36 smithi088 ceph-mon[34093]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:01:37.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:36 smithi088 ceph-mon[34093]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:36 smithi154 ceph-mon[34759]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:01:37.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:36 smithi154 ceph-mon[34759]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:01:37.810 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T01:01:37.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:37 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/863936108' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:01:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:37 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/863936108' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:01:38.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:37 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/863936108' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 -- 172.21.15.17:0/4014361114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 msgr2=0x7f0e6c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 --2- 172.21.15.17:0/4014361114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c10da40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009900 tx=0x7f0e6402a480 comp rx=0 tx=0).stop 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 -- 172.21.15.17:0/4014361114 shutdown_connections 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 --2- 172.21.15.17:0/4014361114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c10da40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 --2- 172.21.15.17:0/4014361114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 --2- 172.21.15.17:0/4014361114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 0x7f0e6c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 -- 172.21.15.17:0/4014361114 >> 172.21.15.17:0/4014361114 conn(0x7f0e6c0fc7d0 msgr2=0x7f0e6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 -- 172.21.15.17:0/4014361114 shutdown_connections 2024-09-16T01:01:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.635+0000 7f0e736dd640 1 -- 172.21.15.17:0/4014361114 wait complete. 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 Processor -- start 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 -- start start 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 0x7f0e6c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c111f50 con 0x7f0e6c102ef0 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c111dd0 con 0x7f0e6c102570 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e736dd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1120d0 con 0x7f0e6c100e20 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43614/0 (socket says 172.21.15.17:43614) 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 -- 172.21.15.17:0/1320882060 learned_addr learned my addr 172.21.15.17:0/1320882060 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71479640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 0x7f0e6c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e70c78640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 -- 172.21.15.17:0/1320882060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 msgr2=0x7f0e6c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 0x7f0e6c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 -- 172.21.15.17:0/1320882060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 msgr2=0x7f0e6c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e71c7a640 1 -- 172.21.15.17:0/1320882060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c19d2c0 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.636+0000 7f0e70c78640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e71c7a640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009230 tx=0x7f0e640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6403f030 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e64003800 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c19d550 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64035070 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.637+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c1a4e90 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.638+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c101200 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.639+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0e640039b0 con 0x7f0e6c102ef0 2024-09-16T01:01:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.640+0000 7f0e6a7fc640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 0x7f0e540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.640+0000 7f0e71479640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 0x7f0e540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.640+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0e640f03f0 con 0x7f0e6c102ef0 2024-09-16T01:01:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.640+0000 7f0e71479640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 0x7f0e540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0058c0 tx=0x7f0e5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.644+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e640bcf60 con 0x7f0e6c102ef0 2024-09-16T01:01:38.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.858+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e6c1a5060 con 0x7f0e6c102ef0 2024-09-16T01:01:38.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.859+0000 7f0e6a7fc640 1 -- 172.21.15.17:0/1320882060 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7f0e640bc860 con 0x7f0e6c102ef0 2024-09-16T01:01:38.860 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:38.860 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:01:38.860 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 msgr2=0x7f0e540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 0x7f0e540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0058c0 tx=0x7f0e5c00a2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 msgr2=0x7f0e6c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009230 tx=0x7f0e640042f0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 shutdown_connections 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f0e540a32d0 0x7f0e540a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e6c102ef0 0x7f0e6c19cbe0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e6c102570 0x7f0e6c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 --2- 172.21.15.17:0/1320882060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c100e20 0x7f0e6c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.861+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 >> 172.21.15.17:0/1320882060 conn(0x7f0e6c0fc7d0 msgr2=0x7f0e6c1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.862+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 shutdown_connections 2024-09-16T01:01:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:38.862+0000 7f0e736dd640 1 -- 172.21.15.17:0/1320882060 wait complete. 2024-09-16T01:01:39.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:38 smithi088 ceph-mon[34093]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 7.3 KiB/s, 0 objects/s recovering 2024-09-16T01:01:39.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:38 smithi154 ceph-mon[34759]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 7.3 KiB/s, 0 objects/s recovering 2024-09-16T01:01:39.186 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:38 smithi017 ceph-mon[31211]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 7.3 KiB/s, 0 objects/s recovering 2024-09-16T01:01:39.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:39 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1320882060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:40.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:39 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1320882060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:40.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:39 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1320882060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.283+0000 7fcad36e4640 1 -- 172.21.15.17:0/464434792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 msgr2=0x7fcacc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.283+0000 7fcad36e4640 1 --2- 172.21.15.17:0/464434792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc1067e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009900 tx=0x7fcabc02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 -- 172.21.15.17:0/464434792 shutdown_connections 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 --2- 172.21.15.17:0/464434792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 --2- 172.21.15.17:0/464434792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc1067e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 --2- 172.21.15.17:0/464434792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 0x7fcacc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 -- 172.21.15.17:0/464434792 >> 172.21.15.17:0/464434792 conn(0x7fcacc0fd8c0 msgr2=0x7fcacc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 -- 172.21.15.17:0/464434792 shutdown_connections 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 -- 172.21.15.17:0/464434792 wait complete. 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 Processor -- start 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.284+0000 7fcad36e4640 1 -- start start 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 0x7fcacc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc111e40 con 0x7fcacc102790 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc111cc0 con 0x7fcacc101de0 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc111fc0 con 0x7fcacc106f10 2024-09-16T01:01:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43636/0 (socket says 172.21.15.17:43636) 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 -- 172.21.15.17:0/196902821 learned_addr learned my addr 172.21.15.17:0/196902821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad1480640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 0x7fcacc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad1c81640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 -- 172.21.15.17:0/196902821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 msgr2=0x7fcacc19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 -- 172.21.15.17:0/196902821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 msgr2=0x7fcacc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 0x7fcacc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 -- 172.21.15.17:0/196902821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc19d2d0 con 0x7fcacc102790 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad1c81640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad0c7f640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006010 tx=0x7fcabc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc03f030 con 0x7fcacc102790 2024-09-16T01:01:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcabc0035f0 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc19d560 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.285+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc035070 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.286+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1a4ea0 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.287+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcacc1021c0 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.288+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcabc003b10 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.288+0000 7fcac27fc640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 0x7fcab80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.288+0000 7fcad1480640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 0x7fcab80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.289+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcabc0f08d0 con 0x7fcacc102790 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.289+0000 7fcad1480640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 0x7fcab80a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcac8005e10 tx=0x7fcac8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.291+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcabc0bd4a0 con 0x7fcacc102790 2024-09-16T01:01:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.507+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcacc10a0f0 con 0x7fcacc102790 2024-09-16T01:01:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.508+0000 7fcac27fc640 1 -- 172.21.15.17:0/196902821 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7fcabc0bcda0 con 0x7fcacc102790 2024-09-16T01:01:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:40.509 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:01:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:01:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 msgr2=0x7fcab80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 0x7fcab80a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcac8005e10 tx=0x7fcac8005da0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 msgr2=0x7fcacc198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006010 tx=0x7fcabc004270 comp rx=0 tx=0).stop 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 shutdown_connections 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fcab80a32d0 0x7fcab80a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc106f10 0x7fcacc19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102790 0x7fcacc198860 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 --2- 172.21.15.17:0/196902821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcacc101de0 0x7fcacc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 >> 172.21.15.17:0/196902821 conn(0x7fcacc0fd8c0 msgr2=0x7fcacc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 shutdown_connections 2024-09-16T01:01:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:40.510+0000 7fcad36e4640 1 -- 172.21.15.17:0/196902821 wait complete. 2024-09-16T01:01:40.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:40 smithi017 ceph-mon[31211]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:40.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:40 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/196902821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:41.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:40 smithi088 ceph-mon[34093]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:41.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:40 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/196902821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:40 smithi154 ceph-mon[34759]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:41.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:40 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/196902821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:41.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:01:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 -- 172.21.15.17:0/3647174050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 msgr2=0x7f48e010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 --2- 172.21.15.17:0/3647174050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e010eaa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009ca0 tx=0x7f48d802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 -- 172.21.15.17:0/3647174050 shutdown_connections 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 --2- 172.21.15.17:0/3647174050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e010eaa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 --2- 172.21.15.17:0/3647174050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e01027a0 0x7f48e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 --2- 172.21.15.17:0/3647174050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 0x7f48e01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 -- 172.21.15.17:0/3647174050 >> 172.21.15.17:0/3647174050 conn(0x7f48e00fd8b0 msgr2=0x7f48e00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 -- 172.21.15.17:0/3647174050 shutdown_connections 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.895+0000 7f48e77df640 1 -- 172.21.15.17:0/3647174050 wait complete. 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 Processor -- start 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 -- start start 2024-09-16T01:01:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 0x7f48e01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e01027a0 0x7f48e01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0111e30 con 0x7f48e0106f20 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0111cb0 con 0x7f48e0101df0 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e77df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0111fb0 con 0x7f48e01027a0 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e5d7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e5d7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47484/0 (socket says 172.21.15.17:47484) 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.896+0000 7f48e5d7c640 1 -- 172.21.15.17:0/3999424099 learned_addr learned my addr 172.21.15.17:0/3999424099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e557b640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 0x7f48e01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 -- 172.21.15.17:0/3999424099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e01027a0 msgr2=0x7f48e01987f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e01027a0 0x7f48e01987f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 -- 172.21.15.17:0/3999424099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 msgr2=0x7f48e01982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:41.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 0x7f48e01982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 -- 172.21.15.17:0/3999424099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e019d260 con 0x7f48e0106f20 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e5d7c640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009dc0 tx=0x7f48d8032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d804c020 con 0x7f48e0106f20 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f48d8048d00 con 0x7f48e0106f20 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e019d4f0 con 0x7f48e0106f20 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d80305c0 con 0x7f48e0106f20 2024-09-16T01:01:41.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.897+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e0074420 con 0x7f48e0106f20 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.898+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e01032d0 con 0x7f48e0106f20 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.900+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f48d804f020 con 0x7f48e0106f20 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.900+0000 7f48d67fc640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 0x7f48cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.900+0000 7f48e557b640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 0x7f48cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.900+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48d80f8fd0 con 0x7f48e0106f20 2024-09-16T01:01:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.901+0000 7f48e557b640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 0x7f48cc0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005fd0 tx=0x7f48dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:41.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:41.904+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48d8056020 con 0x7f48e0106f20 2024-09-16T01:01:42.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.081+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48e010a100 con 0x7f48e0106f20 2024-09-16T01:01:42.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.083+0000 7f48d67fc640 1 -- 172.21.15.17:0/3999424099 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22640 (secure 0 0 0) 0x7f48d80c5d50 con 0x7f48e0106f20 2024-09-16T01:01:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:42.084 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:01:34.675588+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 msgr2=0x7f48cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 0x7f48cc0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005fd0 tx=0x7f48dc005850 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 msgr2=0x7f48e019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009dc0 tx=0x7f48d8032ff0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 shutdown_connections 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f48cc0a32d0 0x7f48cc0a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e0106f20 0x7f48e019cb80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e01027a0 0x7f48e01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 --2- 172.21.15.17:0/3999424099 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48e0101df0 0x7f48e01982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 >> 172.21.15.17:0/3999424099 conn(0x7f48e00fd8b0 msgr2=0x7f48e00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 shutdown_connections 2024-09-16T01:01:42.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:42.086+0000 7f48e77df640 1 -- 172.21.15.17:0/3999424099 wait complete. 2024-09-16T01:01:42.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:43.042 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:43.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:42 smithi088 ceph-mon[34093]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:43.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:42 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3999424099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:43.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:42 smithi154 ceph-mon[34759]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:43.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:42 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3999424099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:43.162 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:42 smithi017 ceph-mon[31211]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s; 7.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:43.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:42 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3999424099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:01:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- 172.21.15.17:0/1152920557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc106f10 msgr2=0x7f68bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/1152920557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc106f10 0x7f68bc10ea90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009ca0 tx=0x7f68b402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- 172.21.15.17:0/1152920557 shutdown_connections 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/1152920557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc106f10 0x7f68bc10ea90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/1152920557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc102790 0x7f68bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/1152920557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc101de0 0x7f68bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- 172.21.15.17:0/1152920557 >> 172.21.15.17:0/1152920557 conn(0x7f68bc0fd8c0 msgr2=0x7f68bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- 172.21.15.17:0/1152920557 shutdown_connections 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- 172.21.15.17:0/1152920557 wait complete. 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 Processor -- start 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.497+0000 7f68c0e2d640 1 -- start start 2024-09-16T01:01:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc101de0 0x7f68bc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 0x7f68bc19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc111e20 con 0x7f68bc102790 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc111ca0 con 0x7f68bc106f10 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68c0e2d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc111fa0 con 0x7f68bc101de0 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47496/0 (socket says 172.21.15.17:47496) 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 -- 172.21.15.17:0/818639997 learned_addr learned my addr 172.21.15.17:0/818639997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68ba59c640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc101de0 0x7f68bc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68bad9d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 0x7f68bc19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 -- 172.21.15.17:0/818639997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc101de0 msgr2=0x7f68bc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc101de0 0x7f68bc19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 -- 172.21.15.17:0/818639997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 msgr2=0x7f68bc19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 0x7f68bc19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 -- 172.21.15.17:0/818639997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc19f4c0 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68bad9d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 0x7f68bc19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b3fff640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d770 tx=0x7f68a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.498+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4017070 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.499+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68a40054d0 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.499+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68bc19f7b0 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.499+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4004cf0 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.499+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68bc1a7090 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.500+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68bc1021c0 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.501+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f68a4004e90 con 0x7f68bc102790 2024-09-16T01:01:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.502+0000 7f68b37fe640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 0x7f68a80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.502+0000 7f68ba59c640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 0x7f68a80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.502+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f68a40cf7f0 con 0x7f68bc102790 2024-09-16T01:01:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.502+0000 7f68ba59c640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 0x7f68a80a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009bd0 tx=0x7f68ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.505+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68a409c440 con 0x7f68bc102790 2024-09-16T01:01:43.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.717+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68bc1a73c0 con 0x7f68bc102790 2024-09-16T01:01:43.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.717+0000 7f68b37fe640 1 -- 172.21.15.17:0/818639997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7f68a409bd40 con 0x7f68bc102790 2024-09-16T01:01:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:01:43.718 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:01:43.718 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 msgr2=0x7f68a80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 0x7f68a80a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009bd0 tx=0x7f68ac005f90 comp rx=0 tx=0).stop 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 msgr2=0x7f68bc19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d770 tx=0x7f68a400dc30 comp rx=0 tx=0).stop 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 shutdown_connections 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f68a80a3350 0x7f68a80a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68bc106f10 0x7f68bc19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68bc102790 0x7f68bc19aa50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 --2- 172.21.15.17:0/818639997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc101de0 0x7f68bc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 >> 172.21.15.17:0/818639997 conn(0x7f68bc0fd8c0 msgr2=0x7f68bc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 shutdown_connections 2024-09-16T01:01:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:43.720+0000 7f68c0e2d640 1 -- 172.21.15.17:0/818639997 wait complete. 2024-09-16T01:01:44.044 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:43 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/818639997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:44.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:43 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/818639997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:44.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:43 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/818639997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:44.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T01:00:29.073506+0000', 'modified': '2024-09-16T01:00:40.505799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24515, 'mds_1': 24503, 'mds_2': 24482, 'mds_3': 24472, 'mds_4': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14604': {'gid': 14604, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/2587837863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2587837863}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2587837863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/1776584751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 1776584751}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 1776584751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.88:6833/764220258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6832', 'nonce': 764220258}, {'type': 'v1', 'addr': '172.21.15.88:6833', 'nonce': 764220258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/3320793854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3320793854}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3320793854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/3615564777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 3615564777}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 3615564777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.88:6835/2889832205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 2889832205}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 2889832205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/1732406243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1732406243}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1732406243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.88:6837/51927101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 51927101}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 51927101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.17:6841/2275099611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 2275099611}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 2275099611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6839/2954076302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 2954076302}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 2954076302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24515, 'qdb_cluster': [24515, 24482, 24472, 24503, 24464]} 2024-09-16T01:01:44.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-16T01:01:44.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-16T01:01:44.675 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:44.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:44 smithi017 ceph-mon[31211]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 6.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 -- 172.21.15.17:0/3366268223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0102790 msgr2=0x7f6fe01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 --2- 172.21.15.17:0/3366268223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0102790 0x7f6fe01067e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009900 tx=0x7f6fc802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 -- 172.21.15.17:0/3366268223 shutdown_connections 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 --2- 172.21.15.17:0/3366268223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0106f10 0x7f6fe010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 --2- 172.21.15.17:0/3366268223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0102790 0x7f6fe01067e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 --2- 172.21.15.17:0/3366268223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0101de0 0x7f6fe01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 -- 172.21.15.17:0/3366268223 >> 172.21.15.17:0/3366268223 conn(0x7f6fe00fd8c0 msgr2=0x7f6fe00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 -- 172.21.15.17:0/3366268223 shutdown_connections 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.074+0000 7f6fe664c640 1 -- 172.21.15.17:0/3366268223 wait complete. 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 Processor -- start 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 -- start start 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0101de0 0x7f6fe0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0102790 0x7f6fe01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111e30 con 0x7f6fe0106f10 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.075+0000 7f6fe664c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111cb0 con 0x7f6fe0101de0 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe664c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0111fb0 con 0x7f6fe0102790 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47510/0 (socket says 172.21.15.17:47510) 2024-09-16T01:01:45.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 -- 172.21.15.17:0/2555450544 learned_addr learned my addr 172.21.15.17:0/2555450544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0102790 0x7f6fe01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fdffff640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0101de0 0x7f6fe0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 -- 172.21.15.17:0/2555450544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0102790 msgr2=0x7f6fe01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0102790 0x7f6fe01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 -- 172.21.15.17:0/2555450544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0101de0 msgr2=0x7f6fe0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0101de0 0x7f6fe0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 -- 172.21.15.17:0/2555450544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe019d430 con 0x7f6fe0106f10 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe4be9640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800eb10 tx=0x7f6fd800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fddffb640 1 -- 172.21.15.17:0/2555450544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8004b20 con 0x7f6fe0106f10 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fddffb640 1 -- 172.21.15.17:0/2555450544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd8004cc0 con 0x7f6fe0106f10 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe019d720 con 0x7f6fe0106f10 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fddffb640 1 -- 172.21.15.17:0/2555450544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8010690 con 0x7f6fe0106f10 2024-09-16T01:01:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.076+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe01a5000 con 0x7f6fe0106f10 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fddffb640 1 -- 172.21.15.17:0/2555450544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6fd8005020 con 0x7f6fe0106f10 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 Processor -- start 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 -- start start 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f4cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e22eb3090 con 0x556e22f4d2f0 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e22e5aa70 con 0x556e22f57bb0 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e22eaf050 con 0x556e22f4c9d0 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fddffb640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 0x7f6fcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.079+0000 7f6fdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47518/0 (socket says 172.21.15.17:47518) 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 -- 172.21.15.17:0/2790418841 learned_addr learned my addr 172.21.15.17:0/2790418841 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fe4be9640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 0x7f6fcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f4cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fddffb640 1 -- 172.21.15.17:0/2555450544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6fd80d0050 con 0x7f6fe0106f10 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 -- 172.21.15.17:0/2790418841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 msgr2=0x556e22f4cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f4cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 -- 172.21.15.17:0/2790418841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 msgr2=0x556e22f59fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f59fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 -- 172.21.15.17:0/2790418841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e22e67130 con 0x556e22f4d2f0 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fdffff640 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000dcb0 tx=0x7f6fd000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99952c1e3ab4c566 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fe4be9640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 0x7f6fcc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8098ef0 tx=0x7f6fd806c190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2790418841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011440 con 0x556e22f4d2f0 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2790418841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd0011a90 con 0x556e22f4d2f0 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.080+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2790418841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0010a00 con 0x556e22f4d2f0 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- 172.21.15.17:0/2790418841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 msgr2=0x556e22f57670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000dcb0 tx=0x7f6fd000f730 comp rx=0 tx=0).stop 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- 172.21.15.17:0/2790418841 shutdown_connections 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4d2f0 0x556e22f57670 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/2790418841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f4cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- 172.21.15.17:0/2790418841 >> 172.21.15.17:0/2790418841 conn(0x556e22f48f60 msgr2=0x556e22f49340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- 172.21.15.17:0/2790418841 shutdown_connections 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- 172.21.15.17:0/2790418841 wait complete. 2024-09-16T01:01:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.081+0000 7f6fe8a25740 1 -- start start 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 Processor -- start 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f54770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f57bb0 0x556e22f54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e22f5a780 con 0x556e22f4c9d0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e22e6df20 con 0x556e22f4d2f0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e22f5a900 con 0x556e22f57bb0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fe8a25740 10 client.0 _ll_register_callbacks cb 0x556e22e37030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47532/0 (socket says 172.21.15.17:47532) 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 -- 172.21.15.17:0/313704905 learned_addr learned my addr 172.21.15.17:0/313704905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f57bb0 0x556e22f54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fdffff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 -- 172.21.15.17:0/313704905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f57bb0 msgr2=0x556e22f54cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f57bb0 0x556e22f54cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 -- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 msgr2=0x556e22f54770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f54770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 -- 172.21.15.17:0/313704905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e22c242b0 con 0x556e22f4c9d0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009230 tx=0x7f6fc8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e90045587e52e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.082+0000 7f6fbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8035040 con 0x556e22f4c9d0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6fc8003cf0 con 0x556e22f4c9d0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fd0011a90 con 0x556e22f4c9d0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6fc8052050 con 0x556e22f4c9d0 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 10 client.14973 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e22f65fe0 con 0x556e22f4c9d0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fd0011a90 con 0x556e22f4c9d0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6fc803d450 con 0x556e22f4c9d0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 10 client.14973 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 10 client.14973 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 20 client.14973 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22f68580 0x556e22f699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 4 client.14973 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.083+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 --> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e22ec0600 con 0x556e22f68580 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.084+0000 7f6fdffff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22f68580 0x556e22f699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.084+0000 7f6fdffff640 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22f68580 0x556e22f699f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aca19dfb9a921b77 server_cookie=c4f12285526163f2 in_seq=0 out_seq=0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.084+0000 7f6fbf7fe640 10 client.14973 ms_handle_connect on v2:172.21.15.88:6834/2889832205 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/313704905 <== mds.4 v2:172.21.15.88:6834/2889832205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e22ec0600 con 0x556e22f68580 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fbf7fe640 10 client.14973 handle_command_reply: tid=0 2024-09-16T01:01:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 client.14973 shutdown 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 msgr2=0x556e22f57420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009230 tx=0x7f6fc8009260 comp rx=0 tx=0).stop 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 shutdown_connections 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22f68580 0x556e22f699f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f57bb0 0x556e22f54cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f54770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fbf7fe640 0 client.14973 ms_handle_reset on v2:172.21.15.88:6834/2889832205 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/313704905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f57420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 >> 172.21.15.17:0/313704905 conn(0x556e22f48f60 msgr2=0x556e22f4ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 shutdown_connections 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 1 -- 172.21.15.17:0/313704905 wait complete. 2024-09-16T01:01:45.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.085+0000 7f6fe8a25740 20 client.14973 trim_cache size 0 max 16384 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.103+0000 7f6fe8a25740 1 Processor -- start 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.103+0000 7f6fe8a25740 1 -- start start 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f49340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e22f67d30 con 0x556e22f57bb0 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e22f68400 con 0x556e22f4d2f0 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e22f68ad0 con 0x556e22f4c9d0 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47542/0 (socket says 172.21.15.17:47542) 2024-09-16T01:01:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 -- 172.21.15.17:0/865207360 learned_addr learned my addr 172.21.15.17:0/865207360 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fdffff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f49340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 -- 172.21.15.17:0/865207360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 msgr2=0x556e22f699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 -- 172.21.15.17:0/865207360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 msgr2=0x556e22f49340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f49340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 -- 172.21.15.17:0/865207360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e22f55290 con 0x556e22f57bb0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fdffff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f49340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8001eb0 tx=0x7f6fc802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b4cac1d80434de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd5ffb640 1 -- 172.21.15.17:0/865207360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8035070 con 0x556e22f57bb0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.104+0000 7f6fd5ffb640 1 -- 172.21.15.17:0/865207360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fc803d650 con 0x556e22f57bb0 2024-09-16T01:01:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fd5ffb640 1 -- 172.21.15.17:0/865207360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8041070 con 0x556e22f57bb0 2024-09-16T01:01:45.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- 172.21.15.17:0/865207360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 msgr2=0x556e22f53040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8001eb0 tx=0x7f6fc802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:45.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- 172.21.15.17:0/865207360 shutdown_connections 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f57bb0 0x556e22f53040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f4d2f0 0x556e22f49340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/865207360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4c9d0 0x556e22f699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- 172.21.15.17:0/865207360 >> 172.21.15.17:0/865207360 conn(0x556e22f48f60 msgr2=0x556e22f54730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- 172.21.15.17:0/865207360 shutdown_connections 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- 172.21.15.17:0/865207360 wait complete. 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.105+0000 7f6fe8a25740 1 -- start start 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 Processor -- start 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4d2f0 0x556e22f72520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e22f69870 con 0x556e22f4c9d0 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e22f691a0 con 0x556e22f57bb0 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e22f69f40 con 0x556e22f4d2f0 2024-09-16T01:01:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fe8a25740 10 client.0 _ll_register_callbacks cb 0x7f6fc8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47550/0 (socket says 172.21.15.17:47550) 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 -- 172.21.15.17:0/944548348 learned_addr learned my addr 172.21.15.17:0/944548348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fdffff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4d2f0 0x556e22f72520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 -- 172.21.15.17:0/944548348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4d2f0 msgr2=0x556e22f72520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4d2f0 0x556e22f72520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 -- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 msgr2=0x556e22f6d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f6d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.106+0000 7f6fd7fff640 1 -- 172.21.15.17:0/944548348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e22f4c800 con 0x556e22f4c9d0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fd7fff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fc802a9d0 tx=0x7f6fc8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d5e06f0faf7642 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8035070 con 0x556e22f4c9d0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fc803d650 con 0x556e22f4c9d0 2024-09-16T01:01:45.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6fc8003d00 con 0x556e22f4c9d0 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6fc8041040 con 0x556e22f4c9d0 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fe8a25740 10 client.14979 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e22fd2600 con 0x556e22f4c9d0 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6fc803d650 con 0x556e22f4c9d0 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6fc8056430 con 0x556e22f4c9d0 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fe8a25740 10 client.14979 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.107+0000 7f6fe8a25740 10 client.14979 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fe8a25740 20 client.14979 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22fd6d80 0x556e22fd5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fe8a25740 4 client.14979 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 --> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] -- command(tid 0: {"prefix": "status"}) -- 0x556e22ebab10 con 0x556e22fd6d80 2024-09-16T01:01:45.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fdffff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22fd6d80 0x556e22fd5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fdffff640 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22fd6d80 0x556e22fd5a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f3c06405e8d83e5 server_cookie=b910738e69e61db6 in_seq=0 out_seq=0 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fbf7fe640 10 client.14979 ms_handle_connect on v2:172.21.15.88:6834/2889832205 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fbf7fe640 1 -- 172.21.15.17:0/944548348 <== mds.4 v2:172.21.15.88:6834/2889832205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556e22ebab10 con 0x556e22fd6d80 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fbf7fe640 10 client.14979 handle_command_reply: tid=0 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.108+0000 7f6fe8a25740 1 client.14979 shutdown 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 msgr2=0x556e22f71fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fc802a9d0 tx=0x7f6fc8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 shutdown_connections 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x556e22fd6d80 0x556e22fd5a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e22f57bb0 0x556e22f6d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e22f4d2f0 0x556e22f72520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fbf7fe640 0 client.14979 ms_handle_reset on v2:172.21.15.88:6834/2889832205 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 --2- 172.21.15.17:0/944548348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e22f4c9d0 0x556e22f71fe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 >> 172.21.15.17:0/944548348 conn(0x556e22f48f60 msgr2=0x556e22f52f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 shutdown_connections 2024-09-16T01:01:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 1 -- 172.21.15.17:0/944548348 wait complete. 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe8a25740 20 client.14979 trim_cache size 0 max 16384 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24464, 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 65.608458721999995, 2024-09-16T01:01:45.115 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 105.586202206 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 msgr2=0x7f6fcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 0x7f6fcc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8098ef0 tx=0x7f6fd806c190 comp rx=0 tx=0).stop 2024-09-16T01:01:45.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 msgr2=0x7f6fe019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.109+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800eb10 tx=0x7f6fd800c2d0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 shutdown_connections 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6fcc0a32d0 0x7f6fcc0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fe0106f10 0x7f6fe019cd50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe0102790 0x7f6fe01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 --2- 172.21.15.17:0/2555450544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6fe0101de0 0x7f6fe0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 >> 172.21.15.17:0/2555450544 conn(0x7f6fe00fd8c0 msgr2=0x7f6fe00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 shutdown_connections 2024-09-16T01:01:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:45.110+0000 7f6fe664c640 1 -- 172.21.15.17:0/2555450544 wait complete. 2024-09-16T01:01:45.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:44 smithi088 ceph-mon[34093]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 6.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:45.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:44 smithi154 ceph-mon[34759]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 6.4 KiB/s, 1 objects/s recovering 2024-09-16T01:01:45.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:01:46.057 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.526+0000 7f6f92fe2640 1 -- 172.21.15.17:0/1238690243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 msgr2=0x7f6f8c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.526+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/1238690243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c107b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009930 tx=0x7f6f7402a420 comp rx=0 tx=0).stop 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.526+0000 7f6f92fe2640 1 -- 172.21.15.17:0/1238690243 shutdown_connections 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.526+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/1238690243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.526+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/1238690243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c107b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/1238690243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- 172.21.15.17:0/1238690243 >> 172.21.15.17:0/1238690243 conn(0x7f6f8c0fc7d0 msgr2=0x7f6f8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- 172.21.15.17:0/1238690243 shutdown_connections 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- 172.21.15.17:0/1238690243 wait complete. 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 Processor -- start 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- start start 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c111f10 con 0x7f6f8c1036e0 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c111d90 con 0x7f6f8c1082a0 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.527+0000 7f6f92fe2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c112090 con 0x7f6f8c102d30 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47572/0 (socket says 172.21.15.17:47572) 2024-09-16T01:01:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 -- 172.21.15.17:0/4106158327 learned_addr learned my addr 172.21.15.17:0/4106158327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f9157f640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 -- 172.21.15.17:0/4106158327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 msgr2=0x7f6f8c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 -- 172.21.15.17:0/4106158327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 msgr2=0x7f6f8c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 -- 172.21.15.17:0/4106158327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c19d440 con 0x7f6f8c1036e0 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f9157f640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f74031440 tx=0x7f6f74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f89ffb640 1 -- 172.21.15.17:0/4106158327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7403f030 con 0x7f6f8c1036e0 2024-09-16T01:01:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f89ffb640 1 -- 172.21.15.17:0/4106158327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f74003aa0 con 0x7f6f8c1036e0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f89ffb640 1 -- 172.21.15.17:0/4106158327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74035070 con 0x7f6f8c1036e0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.528+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c19d6d0 con 0x7f6f8c1036e0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.529+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c1a5010 con 0x7f6f8c1036e0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f89ffb640 1 -- 172.21.15.17:0/4106158327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6f74042030 con 0x7f6f8c1036e0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 Processor -- start 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 -- start start 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 0x5559f2fb5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559f2f1c090 con 0x5559f2fb61f0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5559f2ec3a70 con 0x5559f2fb58d0 2024-09-16T01:01:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f953bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559f2f18050 con 0x5559f2fc4fc0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f90d7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f89ffb640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 0x7f6f780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f90d7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47580/0 (socket says 172.21.15.17:47580) 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.531+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3492829083 learned_addr learned my addr 172.21.15.17:0/3492829083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f9157f640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 0x5559f2fb5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f89ffb640 1 -- 172.21.15.17:0/4106158327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6f740eff90 con 0x7f6f8c1036e0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f9157f640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 0x7f6f780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3492829083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 msgr2=0x5559f2fc73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3492829083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 msgr2=0x5559f2fb5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 0x5559f2fb5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3492829083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f2ed0130 con 0x5559f2fb61f0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f9157f640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 0x5559f2fb5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f84008f10 tx=0x7f6f8400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277bc9ee421dd498 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f82ffd640 1 -- 172.21.15.17:0/3492829083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400f830 con 0x5559f2fb61f0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f9157f640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 0x7f6f780a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005fd0 tx=0x7f6f7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f82ffd640 1 -- 172.21.15.17:0/3492829083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f84018480 con 0x5559f2fb61f0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.532+0000 7f6f82ffd640 1 -- 172.21.15.17:0/3492829083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400e5f0 con 0x5559f2fb61f0 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- 172.21.15.17:0/3492829083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 msgr2=0x5559f2fc4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f84008f10 tx=0x7f6f8400d710 comp rx=0 tx=0).stop 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- 172.21.15.17:0/3492829083 shutdown_connections 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc4a80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3492829083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb58d0 0x5559f2fb5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- 172.21.15.17:0/3492829083 >> 172.21.15.17:0/3492829083 conn(0x5559f2fb1f60 msgr2=0x5559f2fb2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- 172.21.15.17:0/3492829083 shutdown_connections 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- 172.21.15.17:0/3492829083 wait complete. 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 -- start start 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.533+0000 7f6f953bb740 1 Processor -- start 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb61f0 0x5559f2fc1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fc7bf0 con 0x5559f2fb58d0 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5559f2ed6f20 con 0x5559f2fc4fc0 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fc7d70 con 0x5559f2fb61f0 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f953bb740 10 client.0 _ll_register_callbacks cb 0x5559f2ea0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47588/0 (socket says 172.21.15.17:47588) 2024-09-16T01:01:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3361098801 learned_addr learned my addr 172.21.15.17:0/3361098801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb61f0 0x5559f2fc1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f9157f640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb61f0 msgr2=0x5559f2fc1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb61f0 0x5559f2fc1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3361098801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 msgr2=0x5559f2fc2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 -- 172.21.15.17:0/3361098801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f2c8d2b0 con 0x5559f2fb58d0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f84008ee0 tx=0x7f6f84005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84945a8a3d8234 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.534+0000 7f6f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84027060 con 0x5559f2fb58d0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6f84004c40 con 0x5559f2fb58d0 2024-09-16T01:01:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f84018480 con 0x5559f2fb58d0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f84004e40 con 0x5559f2fb58d0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 10 client.14991 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5559f2fd34f0 con 0x5559f2fb58d0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f84018480 con 0x5559f2fb58d0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6f84005330 con 0x5559f2fb58d0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 10 client.14991 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 10 client.14991 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 20 client.14991 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f2fd5710 0x5559f2fd6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 4 client.14991 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.535+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 --> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559f2f29600 con 0x5559f2fd5710 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.536+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f2fd5710 0x5559f2fd6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.536+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f2fd5710 0x5559f2fd6b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a339f44756c3a624 server_cookie=d1817b85d1a6ae20 in_seq=0 out_seq=0 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.536+0000 7f6f6bfff640 10 client.14991 ms_handle_connect on v2:172.21.15.154:6838/1732406243 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f6bfff640 1 -- 172.21.15.17:0/3361098801 <== mds.3 v2:172.21.15.154:6838/1732406243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559f2f29600 con 0x5559f2fd5710 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f6bfff640 10 client.14991 handle_command_reply: tid=0 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 client.14991 shutdown 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 msgr2=0x5559f2fc4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f84008ee0 tx=0x7f6f84005c80 comp rx=0 tx=0).stop 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 shutdown_connections 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f2fd5710 0x5559f2fd6b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fc2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb61f0 0x5559f2fc1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f6bfff640 0 client.14991 ms_handle_reset on v2:172.21.15.154:6838/1732406243 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 --2- 172.21.15.17:0/3361098801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb58d0 0x5559f2fc4880 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 >> 172.21.15.17:0/3361098801 conn(0x5559f2fb1f60 msgr2=0x5559f2fb7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 shutdown_connections 2024-09-16T01:01:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 1 -- 172.21.15.17:0/3361098801 wait complete. 2024-09-16T01:01:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.537+0000 7f6f953bb740 20 client.14991 trim_cache size 0 max 16384 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 Processor -- start 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 -- start start 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fd6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fbee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd4ec0 con 0x5559f2fb61f0 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd5590 con 0x5559f2fc4fc0 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.555+0000 7f6f953bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd5c60 con 0x5559f2fb58d0 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47602/0 (socket says 172.21.15.17:47602) 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 -- 172.21.15.17:0/2940462856 learned_addr learned my addr 172.21.15.17:0/2940462856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:46.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fd6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 -- 172.21.15.17:0/2940462856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 msgr2=0x5559f2fd6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fd6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 -- 172.21.15.17:0/2940462856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 msgr2=0x5559f2fbee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f9157f640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fbee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fbee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 -- 172.21.15.17:0/2940462856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f2fc0b80 con 0x5559f2fb61f0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fd6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f740eda20 tx=0x7f6f74040fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ce23ba97e07f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f827fc640 1 -- 172.21.15.17:0/2940462856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74049040 con 0x5559f2fb61f0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f827fc640 1 -- 172.21.15.17:0/2940462856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f740bc500 con 0x5559f2fb61f0 2024-09-16T01:01:46.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.556+0000 7f6f827fc640 1 -- 172.21.15.17:0/2940462856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7403bc60 con 0x5559f2fb61f0 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- 172.21.15.17:0/2940462856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 msgr2=0x5559f2fc04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f740eda20 tx=0x7f6f74040fb0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- 172.21.15.17:0/2940462856 shutdown_connections 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fc4fc0 0x5559f2fbee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fb61f0 0x5559f2fc04a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2940462856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fd6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- 172.21.15.17:0/2940462856 >> 172.21.15.17:0/2940462856 conn(0x5559f2fb1f60 msgr2=0x5559f2fbd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- 172.21.15.17:0/2940462856 shutdown_connections 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- 172.21.15.17:0/2940462856 wait complete. 2024-09-16T01:01:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 -- start start 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.557+0000 7f6f953bb740 1 Processor -- start 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fdf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb61f0 0x5559f2fd8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd6a00 con 0x5559f2fc4fc0 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd6330 con 0x5559f2fb61f0 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559f2fd70d0 con 0x5559f2fb58d0 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f953bb740 10 client.0 _ll_register_callbacks cb 0x7f6f84008d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47604/0 (socket says 172.21.15.17:47604) 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 -- 172.21.15.17:0/2430807797 learned_addr learned my addr 172.21.15.17:0/2430807797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fdf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f8bfff640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb61f0 0x5559f2fd8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 -- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 msgr2=0x5559f2fdf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fdf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 -- 172.21.15.17:0/2430807797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb61f0 msgr2=0x5559f2fd8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb61f0 0x5559f2fd8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 -- 172.21.15.17:0/2430807797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f2fd90d0 con 0x5559f2fc4fc0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f9157f640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00fa20 tx=0x7f6f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8526b3374c7f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.558+0000 7f6f6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c018040 con 0x5559f2fc4fc0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6f7c011de0 con 0x5559f2fc4fc0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f740bc500 con 0x5559f2fc4fc0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f7c005020 con 0x5559f2fc4fc0 2024-09-16T01:01:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 10 client.14997 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5559f2fddaf0 con 0x5559f2fc4fc0 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f740bc500 con 0x5559f2fc4fc0 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6f7c0213f0 con 0x5559f2fc4fc0 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 10 client.14997 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 10 client.14997 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 20 client.14997 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f3044730 0x5559f3043440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 4 client.14997 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.559+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 --> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] -- command(tid 0: {"prefix": "status"}) -- 0x5559f2f23b10 con 0x5559f3044730 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f3044730 0x5559f3043440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f90d7e640 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f3044730 0x5559f3043440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=620473479c4895f4 server_cookie=a46ddb7f3f162590 in_seq=0 out_seq=0 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f6bfff640 10 client.14997 ms_handle_connect on v2:172.21.15.154:6838/1732406243 2024-09-16T01:01:46.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f6bfff640 1 -- 172.21.15.17:0/2430807797 <== mds.3 v2:172.21.15.154:6838/1732406243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5559f2f23b10 con 0x5559f3044730 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f6bfff640 10 client.14997 handle_command_reply: tid=0 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 client.14997 shutdown 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 msgr2=0x5559f2fd8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00fa20 tx=0x7f6f7c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 shutdown_connections 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x5559f3044730 0x5559f3043440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559f2fc4fc0 0x5559f2fd8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5559f2fb61f0 0x5559f2fd8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 --2- 172.21.15.17:0/2430807797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559f2fb58d0 0x5559f2fdf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.560+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 >> 172.21.15.17:0/2430807797 conn(0x5559f2fb1f60 msgr2=0x5559f2fbd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f6bfff640 0 client.14997 ms_handle_reset on v2:172.21.15.154:6838/1732406243 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 shutdown_connections 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f953bb740 1 -- 172.21.15.17:0/2430807797 wait complete. 2024-09-16T01:01:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f953bb740 20 client.14997 trim_cache size 0 max 16384 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24472, 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 68.066513622000002, 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:01:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:01:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:01:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 96.896329093000006 2024-09-16T01:01:46.570 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:01:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 msgr2=0x7f6f780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 0x7f6f780a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c005fd0 tx=0x7f6f7c005850 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 msgr2=0x7f6f8c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f74031440 tx=0x7f6f74004270 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.561+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 shutdown_connections 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6f780a32d0 0x7f6f780a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f8c1082a0 0x7f6f8c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8c1036e0 0x7f6f8c1989d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 --2- 172.21.15.17:0/4106158327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f8c102d30 0x7f6f8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 >> 172.21.15.17:0/4106158327 conn(0x7f6f8c0fc7d0 msgr2=0x7f6f8c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 shutdown_connections 2024-09-16T01:01:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:46.562+0000 7f6f92fe2640 1 -- 172.21.15.17:0/4106158327 wait complete. 2024-09-16T01:01:47.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:46 smithi088 ceph-mon[34093]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-09-16T01:01:47.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:46 smithi154 ceph-mon[34759]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-09-16T01:01:47.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:46 smithi017 ceph-mon[31211]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-09-16T01:01:47.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-16T01:01:47.528 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 -- 172.21.15.17:0/415543782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 msgr2=0x7feecc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 --2- 172.21.15.17:0/415543782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc10ec40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feec4009930 tx=0x7feec402a420 comp rx=0 tx=0).stop 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 -- 172.21.15.17:0/415543782 shutdown_connections 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 --2- 172.21.15.17:0/415543782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc10ec40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 --2- 172.21.15.17:0/415543782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 --2- 172.21.15.17:0/415543782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 0x7feecc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 -- 172.21.15.17:0/415543782 >> 172.21.15.17:0/415543782 conn(0x7feecc0fc7d0 msgr2=0x7feecc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 -- 172.21.15.17:0/415543782 shutdown_connections 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 -- 172.21.15.17:0/415543782 wait complete. 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.997+0000 7feed3ddd640 1 Processor -- start 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 -- start start 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 0x7feecc198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feecc111fb0 con 0x7feecc1082a0 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feecc111e30 con 0x7feecc1036e0 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed3ddd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feecc112130 con 0x7feecc102d30 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47612/0 (socket says 172.21.15.17:47612) 2024-09-16T01:01:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 -- 172.21.15.17:0/487859879 learned_addr learned my addr 172.21.15.17:0/487859879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed1b79640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 0x7feecc198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed1378640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 -- 172.21.15.17:0/487859879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 msgr2=0x7feecc198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 0x7feecc198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 -- 172.21.15.17:0/487859879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 msgr2=0x7feecc198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 -- 172.21.15.17:0/487859879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc19d4c0 con 0x7feecc1082a0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed1378640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.998+0000 7feed237a640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feec4009900 tx=0x7feec4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.999+0000 7feecaffd640 1 -- 172.21.15.17:0/487859879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec403f030 con 0x7feecc1082a0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.999+0000 7feecaffd640 1 -- 172.21.15.17:0/487859879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec40035f0 con 0x7feecc1082a0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.999+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc19d750 con 0x7feecc1082a0 2024-09-16T01:01:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.999+0000 7feecaffd640 1 -- 172.21.15.17:0/487859879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4035070 con 0x7feecc1082a0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:47.999+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1a5090 con 0x7feecc1082a0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.001+0000 7feed61b6740 1 Processor -- start 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.001+0000 7feecaffd640 1 -- 172.21.15.17:0/487859879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feec4003b30 con 0x7feecc1082a0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.001+0000 7feed61b6740 1 -- start start 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e1469ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 0x555e146ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555e14601090 con 0x555e1469b1d0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x555e145a8a70 con 0x555e146a9fc0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed61b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555e145fd050 con 0x555e1469a8b0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47614/0 (socket says 172.21.15.17:47614) 2024-09-16T01:01:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 -- 172.21.15.17:0/1985541665 learned_addr learned my addr 172.21.15.17:0/1985541665 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1378640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e1469ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 -- 172.21.15.17:0/1985541665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 msgr2=0x555e1469ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e1469ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1378640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 0x555e146ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 -- 172.21.15.17:0/1985541665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 msgr2=0x555e146ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feecaffd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 0x7feeb40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 0x555e146ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 -- 172.21.15.17:0/1985541665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e145b5130 con 0x555e1469b1d0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1378640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 0x555e146ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed237a640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 0x7feeb40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feed1b79640 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fa0 tx=0x7feebc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f39cf0abbdcb95 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.002+0000 7feecaffd640 1 -- 172.21.15.17:0/487859879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feec40f0700 con 0x7feecc1082a0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feeb3fff640 1 -- 172.21.15.17:0/1985541665 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc01a070 con 0x555e1469b1d0 2024-09-16T01:01:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feeb3fff640 1 -- 172.21.15.17:0/1985541665 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feebc0158c0 con 0x555e1469b1d0 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feeb3fff640 1 -- 172.21.15.17:0/1985541665 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc00a900 con 0x555e1469b1d0 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 -- 172.21.15.17:0/1985541665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 msgr2=0x555e146a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed237a640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 0x7feeb40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feec40b9030 tx=0x7feec407f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fa0 tx=0x7feebc00c8b0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 -- 172.21.15.17:0/1985541665 shutdown_connections 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e146a9fc0 0x555e146ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a9a80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 --2- 172.21.15.17:0/1985541665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e1469ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.003+0000 7feed61b6740 1 -- 172.21.15.17:0/1985541665 >> 172.21.15.17:0/1985541665 conn(0x555e14696f60 msgr2=0x555e14697340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- 172.21.15.17:0/1985541665 shutdown_connections 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- 172.21.15.17:0/1985541665 wait complete. 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- start start 2024-09-16T01:01:48.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 Processor -- start 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469a8b0 0x555e146a9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555e146acb90 con 0x555e1469b1d0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x555e145bbf20 con 0x555e1469a8b0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555e146acd10 con 0x555e146a9fc0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.004+0000 7feed61b6740 10 client.0 _ll_register_callbacks cb 0x555e14585030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47624/0 (socket says 172.21.15.17:47624) 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 -- 172.21.15.17:0/365217056 learned_addr learned my addr 172.21.15.17:0/365217056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1378640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469a8b0 0x555e146a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1378640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 -- 172.21.15.17:0/365217056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 msgr2=0x555e146a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 -- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469a8b0 msgr2=0x555e146a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469a8b0 0x555e146a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 -- 172.21.15.17:0/365217056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e143722b0 con 0x555e1469b1d0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1378640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed1b79640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feebc004a80 tx=0x7feebc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554ca0985e55d3ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc01a040 con 0x555e1469b1d0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feebc0158c0 con 0x555e1469b1d0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feebc009be0 con 0x555e1469b1d0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feebc015d20 con 0x555e1469b1d0 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed61b6740 10 client.15009 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:48.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.005+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e146b84f0 con 0x555e1469b1d0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feebc0158c0 con 0x555e1469b1d0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7feebc0204e0 con 0x555e1469b1d0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 10 client.15009 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 10 client.15009 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 20 client.15009 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e146ba730 0x555e146bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 4 client.15009 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 --> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e1460e600 con 0x555e146ba730 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.006+0000 7feed1378640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e146ba730 0x555e146bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.007+0000 7feed1378640 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e146ba730 0x555e146bbba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97d25f9a09bdd7ca server_cookie=56be93459874822a in_seq=0 out_seq=0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.007+0000 7feeb17fa640 10 client.15009 ms_handle_connect on v2:172.21.15.88:6836/51927101 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.007+0000 7feeb17fa640 1 -- 172.21.15.17:0/365217056 <== mds.2 v2:172.21.15.88:6836/51927101 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e1460e600 con 0x555e146ba730 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feeb17fa640 10 client.15009 handle_command_reply: tid=0 2024-09-16T01:01:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 client.15009 shutdown 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 msgr2=0x555e146a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feebc004a80 tx=0x7feebc009b30 comp rx=0 tx=0).stop 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 shutdown_connections 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e146ba730 0x555e146bbba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469b1d0 0x555e146a6c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feeb17fa640 0 client.15009 ms_handle_reset on v2:172.21.15.88:6836/51927101 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 --2- 172.21.15.17:0/365217056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469a8b0 0x555e146a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 >> 172.21.15.17:0/365217056 conn(0x555e14696f60 msgr2=0x555e1469ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 shutdown_connections 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 1 -- 172.21.15.17:0/365217056 wait complete. 2024-09-16T01:01:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.008+0000 7feed61b6740 20 client.15009 trim_cache size 0 max 16384 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 Processor -- start 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 -- start start 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555e146b9ee0 con 0x555e1469a8b0 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x555e146ba5b0 con 0x555e1469b1d0 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed61b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555e146bac80 con 0x555e146a9fc0 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47634/0 (socket says 172.21.15.17:47634) 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 -- 172.21.15.17:0/1684318836 learned_addr learned my addr 172.21.15.17:0/1684318836 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:48.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1b79640 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 -- 172.21.15.17:0/1684318836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 msgr2=0x555e146a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 -- 172.21.15.17:0/1684318836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 msgr2=0x555e146ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.026+0000 7feed1378640 1 -- 172.21.15.17:0/1684318836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e146a51c0 con 0x555e1469a8b0 2024-09-16T01:01:48.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed1378640 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feec0000c00 tx=0x7feec000bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab5f84bd6ac1acd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feeb37fe640 1 -- 172.21.15.17:0/1684318836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0013ce0 con 0x555e1469a8b0 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feeb37fe640 1 -- 172.21.15.17:0/1684318836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec0013e80 con 0x555e1469a8b0 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feeb37fe640 1 -- 172.21.15.17:0/1684318836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0010d30 con 0x555e1469a8b0 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 -- 172.21.15.17:0/1684318836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 msgr2=0x555e146bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feec0000c00 tx=0x7feec000bc70 comp rx=0 tx=0).stop 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 -- 172.21.15.17:0/1684318836 shutdown_connections 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e146a9fc0 0x555e146a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 --2- 172.21.15.17:0/1684318836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e1469a8b0 0x555e146bb4d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.027+0000 7feed61b6740 1 -- 172.21.15.17:0/1684318836 >> 172.21.15.17:0/1684318836 conn(0x555e14696f60 msgr2=0x555e14691ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- 172.21.15.17:0/1684318836 shutdown_connections 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- 172.21.15.17:0/1684318836 wait complete. 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- start start 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 Processor -- start 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e146c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555e146bba20 con 0x555e146a9fc0 2024-09-16T01:01:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x555e146bb350 con 0x555e1469b1d0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555e146bc0f0 con 0x555e1469a8b0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed61b6740 10 client.0 _ll_register_callbacks cb 0x7feebc018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.028+0000 7feed1378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47642/0 (socket says 172.21.15.17:47642) 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 -- 172.21.15.17:0/523411963 learned_addr learned my addr 172.21.15.17:0/523411963 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1b79640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e146c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 -- 172.21.15.17:0/523411963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 msgr2=0x555e146c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e146c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 -- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 msgr2=0x555e146a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 -- 172.21.15.17:0/523411963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e146a47a0 con 0x555e146a9fc0 2024-09-16T01:01:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1b79640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed1378640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feec00058c0 tx=0x7feec0010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65aba53e392e2e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0010a10 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e14608b10 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feec00132e0 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feec00134e0 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed61b6740 10 client.15015 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.029+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555e14724ea0 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x555e14608b10 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7feec0026070 con 0x555e146a9fc0 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 10 client.15015 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 10 client.15015 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 20 client.15015 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:48.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e14729600 0x555e14728310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 4 client.15015 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 --> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] -- command(tid 0: {"prefix": "status"}) -- 0x555e145850e0 con 0x555e14729600 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed1b79640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e14729600 0x555e14728310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feeb17fa640 10 client.15015 ms_handle_connect on v2:172.21.15.88:6836/51927101 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.030+0000 7feed1b79640 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e14729600 0x555e14728310 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20ed5e387bd48942 server_cookie=e4f556573a1d3723 in_seq=0 out_seq=0 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feeb17fa640 1 -- 172.21.15.17:0/523411963 <== mds.2 v2:172.21.15.88:6836/51927101 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555e145850e0 con 0x555e14729600 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feeb17fa640 10 client.15015 handle_command_reply: tid=0 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 client.15015 shutdown 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 msgr2=0x555e146a3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feec00058c0 tx=0x7feec0010f50 comp rx=0 tx=0).stop 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 shutdown_connections 2024-09-16T01:01:48.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x555e14729600 0x555e14728310 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e146a9fc0 0x555e146a3f70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feeb17fa640 0 client.15015 ms_handle_reset on v2:172.21.15.88:6836/51927101 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x555e1469b1d0 0x555e146a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 --2- 172.21.15.17:0/523411963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555e1469a8b0 0x555e146c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 >> 172.21.15.17:0/523411963 conn(0x555e14696f60 msgr2=0x555e14696000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 shutdown_connections 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 1 -- 172.21.15.17:0/523411963 wait complete. 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.031+0000 7feed61b6740 20 client.15015 trim_cache size 0 max 16384 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:01:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24482, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 70.547797313999993, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 100.81096469800001 2024-09-16T01:01:48.038 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 msgr2=0x7feeb40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 0x7feeb40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feec40b9030 tx=0x7feec407f040 comp rx=0 tx=0).stop 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 msgr2=0x7feecc19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feec4009900 tx=0x7feec4004270 comp rx=0 tx=0).stop 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 shutdown_connections 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7feeb40a32d0 0x7feeb40a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feecc1082a0 0x7feecc19cde0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feecc1036e0 0x7feecc198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 --2- 172.21.15.17:0/487859879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feecc102d30 0x7feecc198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:48.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 >> 172.21.15.17:0/487859879 conn(0x7feecc0fc7d0 msgr2=0x7feecc105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:48.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 shutdown_connections 2024-09-16T01:01:48.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:48.032+0000 7feed3ddd640 1 -- 172.21.15.17:0/487859879 wait complete. 2024-09-16T01:01:48.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-16T01:01:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:49.136 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:48 smithi017 ceph-mon[31211]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-16T01:01:49.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:48 smithi088 ceph-mon[34093]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-16T01:01:49.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:48 smithi154 ceph-mon[34759]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 -- 172.21.15.17:0/1165708077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441036e0 msgr2=0x7f8744107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 --2- 172.21.15.17:0/1165708077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441036e0 0x7f8744107b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f872c009930 tx=0x7f872c02a420 comp rx=0 tx=0).stop 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 -- 172.21.15.17:0/1165708077 shutdown_connections 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 --2- 172.21.15.17:0/1165708077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87441082a0 0x7f874410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 --2- 172.21.15.17:0/1165708077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441036e0 0x7f8744107b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 --2- 172.21.15.17:0/1165708077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8744102d30 0x7f8744103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 -- 172.21.15.17:0/1165708077 >> 172.21.15.17:0/1165708077 conn(0x7f87440fc7d0 msgr2=0x7f87440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 -- 172.21.15.17:0/1165708077 shutdown_connections 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.455+0000 7f874af5c640 1 -- 172.21.15.17:0/1165708077 wait complete. 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 Processor -- start 2024-09-16T01:01:49.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 -- start start 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8744102d30 0x7f8744198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 0x7f87441989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8744111f50 con 0x7f87441082a0 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8744111dd0 con 0x7f87441036e0 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f874af5c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87441120d0 con 0x7f8744102d30 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47662/0 (socket says 172.21.15.17:47662) 2024-09-16T01:01:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 -- 172.21.15.17:0/3330498847 learned_addr learned my addr 172.21.15.17:0/3330498847 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f8743fff640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 0x7f87441989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f8748cf8640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8744102d30 0x7f8744198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 -- 172.21.15.17:0/3330498847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8744102d30 msgr2=0x7f8744198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8744102d30 0x7f8744198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 -- 172.21.15.17:0/3330498847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 msgr2=0x7f87441989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 0x7f87441989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.456+0000 7f87494f9640 1 -- 172.21.15.17:0/3330498847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874419d410 con 0x7f87441082a0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f8743fff640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 0x7f87441989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f87494f9640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cce0 tx=0x7f873c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f8741ffb640 1 -- 172.21.15.17:0/3330498847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c00f450 con 0x7f87441082a0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f8741ffb640 1 -- 172.21.15.17:0/3330498847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f873c00faa0 con 0x7f87441082a0 2024-09-16T01:01:49.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874419d700 con 0x7f87441082a0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f8741ffb640 1 -- 172.21.15.17:0/3330498847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c018b70 con 0x7f87441082a0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.457+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a4fe0 con 0x7f87441082a0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.459+0000 7f8741ffb640 1 -- 172.21.15.17:0/3330498847 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f873c018d10 con 0x7f87441082a0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 Processor -- start 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 -- start start 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8dcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b843090 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b7eaa70 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f874d335740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b83f050 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8741ffb640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 0x7f87300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8748cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8748cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47670/0 (socket says 172.21.15.17:47670) 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8748cf8640 1 -- 172.21.15.17:0/1327170327 learned_addr learned my addr 172.21.15.17:0/1327170327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f87494f9640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 0x7f87300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8743fff640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8dcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8743fff640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.460+0000 7f8741ffb640 1 -- 172.21.15.17:0/3330498847 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f873c0cff10 con 0x7f87441082a0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 -- 172.21.15.17:0/1327170327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 msgr2=0x55ea9b8e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 -- 172.21.15.17:0/1327170327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 msgr2=0x55ea9b8dcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8dcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 -- 172.21.15.17:0/1327170327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea9b7f7130 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8743fff640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:49.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f8748cf8640 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8734009c80 tx=0x7f87340117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254fe7a6aca3d333 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f87494f9640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 0x7f87300a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f873c09c0e0 tx=0x7f873c067210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f873affd640 1 -- 172.21.15.17:0/1327170327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734012450 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f873affd640 1 -- 172.21.15.17:0/1327170327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8734012aa0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.461+0000 7f873affd640 1 -- 172.21.15.17:0/1327170327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873400fb90 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- 172.21.15.17:0/1327170327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 msgr2=0x55ea9b8e7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8734009c80 tx=0x7f87340117b0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- 172.21.15.17:0/1327170327 shutdown_connections 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e7670 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 --2- 172.21.15.17:0/1327170327 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8dcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- 172.21.15.17:0/1327170327 >> 172.21.15.17:0/1327170327 conn(0x55ea9b8d8f60 msgr2=0x55ea9b8d9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- 172.21.15.17:0/1327170327 shutdown_connections 2024-09-16T01:01:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- 172.21.15.17:0/1327170327 wait complete. 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 -- start start 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.462+0000 7f874d335740 1 Processor -- start 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8e7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8ea780 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b7fdf20 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8ea900 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f874d335740 10 client.0 _ll_register_callbacks cb 0x55ea9b7c7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8743fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47678/0 (socket says 172.21.15.17:47678) 2024-09-16T01:01:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 -- 172.21.15.17:0/2487705241 learned_addr learned my addr 172.21.15.17:0/2487705241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8743fff640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 -- 172.21.15.17:0/2487705241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dc9d0 msgr2=0x55ea9b8e7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8e7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 -- 172.21.15.17:0/2487705241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 msgr2=0x55ea9b8e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 -- 172.21.15.17:0/2487705241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea9b5b42b0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8743fff640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8748cf8640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8734009530 tx=0x7f87340058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b96af32b5362c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.463+0000 7f8723fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734028020 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f87340052d0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8734012aa0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f87340054d0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 10 client.15027 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea9b8f5f90 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8734012aa0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8734003820 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 10 client.15027 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 10 client.15027 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 20 client.15027 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b8f8220 0x55ea9b8f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 4 client.15027 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 --> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea9b850600 con 0x55ea9b8f8220 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.464+0000 7f8743fff640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b8f8220 0x55ea9b8f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.465+0000 7f8743fff640 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b8f8220 0x55ea9b8f9690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f201ea546f7ac44d server_cookie=5b57ed69e5e942ef in_seq=0 out_seq=0 2024-09-16T01:01:49.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.465+0000 7f8723fff640 10 client.15027 ms_handle_connect on v2:172.21.15.17:6840/2275099611 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.465+0000 7f8723fff640 1 -- 172.21.15.17:0/2487705241 <== mds.1 v2:172.21.15.17:6840/2275099611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea9b850600 con 0x55ea9b8f8220 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.465+0000 7f8723fff640 10 client.15027 handle_command_reply: tid=0 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.465+0000 7f874d335740 1 client.15027 shutdown 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 msgr2=0x55ea9b8e4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8734009530 tx=0x7f87340058b0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 shutdown_connections 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b8f8220 0x55ea9b8f9690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8e4730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 --2- 172.21.15.17:0/2487705241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8e7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 >> 172.21.15.17:0/2487705241 conn(0x55ea9b8d8f60 msgr2=0x55ea9b8dec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f8723fff640 0 client.15027 ms_handle_reset on v2:172.21.15.17:6840/2275099611 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 shutdown_connections 2024-09-16T01:01:49.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 1 -- 172.21.15.17:0/2487705241 wait complete. 2024-09-16T01:01:49.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.466+0000 7f874d335740 20 client.15027 trim_cache size 0 max 16384 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 Processor -- start 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 -- start start 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8f8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f79d0 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f80a0 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f874d335740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f8770 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47686/0 (socket says 172.21.15.17:47686) 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 -- 172.21.15.17:0/3966755682 learned_addr learned my addr 172.21.15.17:0/3966755682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8748cf8640 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 -- 172.21.15.17:0/3966755682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 msgr2=0x55ea9b8f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 -- 172.21.15.17:0/3966755682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 msgr2=0x55ea9b8f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 -- 172.21.15.17:0/3966755682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea9b8dd120 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.484+0000 7f8743fff640 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87440697d0 tx=0x7f872c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e291b4f00dc14e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f873a7fc640 1 -- 172.21.15.17:0/3966755682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c035040 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f873a7fc640 1 -- 172.21.15.17:0/3966755682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f872c04f020 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f873a7fc640 1 -- 172.21.15.17:0/3966755682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0035f0 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 -- 172.21.15.17:0/3966755682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 msgr2=0x55ea9b8f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87440697d0 tx=0x7f872c009260 comp rx=0 tx=0).stop 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 -- 172.21.15.17:0/3966755682 shutdown_connections 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8f7b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b8f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 --2- 172.21.15.17:0/3966755682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b8f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 -- 172.21.15.17:0/3966755682 >> 172.21.15.17:0/3966755682 conn(0x55ea9b8d8f60 msgr2=0x55ea9b8dfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 -- 172.21.15.17:0/3966755682 shutdown_connections 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.485+0000 7f874d335740 1 -- 172.21.15.17:0/3966755682 wait complete. 2024-09-16T01:01:49.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 -- start start 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 Processor -- start 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b9021d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f9510 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f8e40 con 0x55ea9b8e7bb0 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea9b8f9be0 con 0x55ea9b8dd2f0 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f874d335740 10 client.0 _ll_register_callbacks cb 0x7f8734005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f8743fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f8743fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47698/0 (socket says 172.21.15.17:47698) 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f8743fff640 1 -- 172.21.15.17:0/1311115104 learned_addr learned my addr 172.21.15.17:0/1311115104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f8743fff640 1 -- 172.21.15.17:0/1311115104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 msgr2=0x55ea9b9021d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.486+0000 7f8743fff640 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b9021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8743fff640 1 -- 172.21.15.17:0/1311115104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 msgr2=0x55ea9b8ffae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8743fff640 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8743fff640 1 -- 172.21.15.17:0/1311115104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea9b9002e0 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8743fff640 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f872c009230 tx=0x7f872c031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dbc8a3cb34f4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c05a020 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f872c031fe0 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872c04f020 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f872c035040 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f874d335740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea9b9615a0 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f872c04f020 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f872c03a040 con 0x55ea9b8dc9d0 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.487+0000 7f874d335740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:49.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 10 client.15033 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 20 client.15033 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b965cd0 0x55ea9b9649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 4 client.15033 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 --> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] -- command(tid 0: {"prefix": "status"}) -- 0x55ea9b84ab10 con 0x55ea9b965cd0 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8748cf8640 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b965cd0 0x55ea9b9649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8723fff640 10 client.15033 ms_handle_connect on v2:172.21.15.17:6840/2275099611 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8748cf8640 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b965cd0 0x55ea9b9649e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f312c542de87cc3 server_cookie=fe45d5a43c86c602 in_seq=0 out_seq=0 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8723fff640 1 -- 172.21.15.17:0/1311115104 <== mds.1 v2:172.21.15.17:6840/2275099611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ea9b84ab10 con 0x55ea9b965cd0 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8723fff640 10 client.15033 handle_command_reply: tid=0 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 client.15033 shutdown 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 msgr2=0x55ea9b901c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f872c009230 tx=0x7f872c031930 comp rx=0 tx=0).stop 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 shutdown_connections 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea9b965cd0 0x55ea9b9649e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea9b8e7bb0 0x55ea9b8ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f8723fff640 0 client.15033 ms_handle_reset on v2:172.21.15.17:6840/2275099611 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea9b8dd2f0 0x55ea9b9021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 --2- 172.21.15.17:0/1311115104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea9b8dc9d0 0x55ea9b901c90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.488+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 >> 172.21.15.17:0/1311115104 conn(0x55ea9b8d8f60 msgr2=0x55ea9b8e5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 shutdown_connections 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874d335740 1 -- 172.21.15.17:0/1311115104 wait complete. 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874d335740 20 client.15033 trim_cache size 0 max 16384 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:01:49.495 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24503, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 73.014051374999994, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 93.712338641000002 2024-09-16T01:01:49.496 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 msgr2=0x7f87300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 0x7f87300a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f873c09c0e0 tx=0x7f873c067210 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 msgr2=0x7f874419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cce0 tx=0x7f873c00a620 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 shutdown_connections 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f87300a32d0 0x7f87300a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87441082a0 0x7f874419cd30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87441036e0 0x7f87441989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 --2- 172.21.15.17:0/3330498847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8744102d30 0x7f8744198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.489+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 >> 172.21.15.17:0/3330498847 conn(0x7f87440fc7d0 msgr2=0x7f8744105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:49.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.490+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 shutdown_connections 2024-09-16T01:01:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:49.490+0000 7f874af5c640 1 -- 172.21.15.17:0/3330498847 wait complete. 2024-09-16T01:01:50.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:01:50.507 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:50.883 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:50 smithi017 ceph-mon[31211]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 104 B/s, 0 objects/s recovering 2024-09-16T01:01:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.964+0000 7f55c818f640 1 -- 172.21.15.17:0/2408711401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0074590 msgr2=0x7f55c0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.964+0000 7f55c818f640 1 --2- 172.21.15.17:0/2408711401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0074590 0x7f55c0074970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009900 tx=0x7f55bc02a480 comp rx=0 tx=0).stop 2024-09-16T01:01:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 -- 172.21.15.17:0/2408711401 shutdown_connections 2024-09-16T01:01:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 --2- 172.21.15.17:0/2408711401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0112b90 0x7f55c0114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 --2- 172.21.15.17:0/2408711401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c0112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 --2- 172.21.15.17:0/2408711401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0074590 0x7f55c0074970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 -- 172.21.15.17:0/2408711401 >> 172.21.15.17:0/2408711401 conn(0x7f55c00fd8c0 msgr2=0x7f55c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 -- 172.21.15.17:0/2408711401 shutdown_connections 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 -- 172.21.15.17:0/2408711401 wait complete. 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 Processor -- start 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 -- start start 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.965+0000 7f55c818f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0074590 0x7f55c01a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c01a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f55c0118420 con 0x7f55c0112b90 2024-09-16T01:01:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55c01182a0 con 0x7f55c0074590 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55c01185a0 con 0x7f55c0074eb0 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32878/0 (socket says 172.21.15.17:32878) 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 -- 172.21.15.17:0/2372099876 learned_addr learned my addr 172.21.15.17:0/2372099876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0074590 0x7f55c01a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c572a640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c01a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 -- 172.21.15.17:0/2372099876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 msgr2=0x7f55c01a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c01a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 -- 172.21.15.17:0/2372099876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0074590 msgr2=0x7f55c01a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0074590 0x7f55c01a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 -- 172.21.15.17:0/2372099876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c019efb0 con 0x7f55c0112b90 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c572a640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c01a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c672c640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55b800cad0 tx=0x7f55b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55b6ffd640 1 -- 172.21.15.17:0/2372099876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b800ae20 con 0x7f55c0112b90 2024-09-16T01:01:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55b6ffd640 1 -- 172.21.15.17:0/2372099876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55b8003e40 con 0x7f55c0112b90 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c019f2a0 con 0x7f55c0112b90 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55b6ffd640 1 -- 172.21.15.17:0/2372099876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b800f6b0 con 0x7f55c0112b90 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.966+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c01ab4f0 con 0x7f55c0112b90 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.969+0000 7f55b6ffd640 1 -- 172.21.15.17:0/2372099876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f55b8004000 con 0x7f55c0112b90 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.969+0000 7f55ca568740 1 Processor -- start 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.969+0000 7f55ca568740 1 -- start start 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.969+0000 7f55ca568740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.969+0000 7f55ca568740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3fe82f0 0x562cc3ff2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55ca568740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3ff2bb0 0x562cc3ff4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55ca568740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562cc3f4e090 con 0x562cc3fe79d0 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55ca568740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562cc3ef5a70 con 0x562cc3fe82f0 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55ca568740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cc3f4a050 con 0x562cc3ff2bb0 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55b6ffd640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 0x7f55ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32888/0 (socket says 172.21.15.17:32888) 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 -- 172.21.15.17:0/3019692564 learned_addr learned my addr 172.21.15.17:0/3019692564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c672c640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 0x7f55ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3fe82f0 0x562cc3ff2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3ff2bb0 0x562cc3ff4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55b6ffd640 1 -- 172.21.15.17:0/2372099876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f55b80cfa80 con 0x7f55c0112b90 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 -- 172.21.15.17:0/3019692564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3ff2bb0 msgr2=0x562cc3ff4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3ff2bb0 0x562cc3ff4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 -- 172.21.15.17:0/3019692564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3fe82f0 msgr2=0x562cc3ff2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3fe82f0 0x562cc3ff2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 -- 172.21.15.17:0/3019692564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc3f02130 con 0x562cc3fe79d0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c672c640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 0x7f55ac0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55b80983b0 tx=0x7f55b806dd20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55c572a640 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009fd0 tx=0x7f55b00095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328580036b1982a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.970+0000 7f55abfff640 1 -- 172.21.15.17:0/3019692564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00134c0 con 0x562cc3fe79d0 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55abfff640 1 -- 172.21.15.17:0/3019692564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55b001b070 con 0x562cc3fe79d0 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55abfff640 1 -- 172.21.15.17:0/3019692564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0012750 con 0x562cc3fe79d0 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 -- 172.21.15.17:0/3019692564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 msgr2=0x562cc3fe7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009fd0 tx=0x7f55b00095f0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 -- 172.21.15.17:0/3019692564 shutdown_connections 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3ff2bb0 0x562cc3ff4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3fe82f0 0x562cc3ff2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 --2- 172.21.15.17:0/3019692564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3fe7db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 -- 172.21.15.17:0/3019692564 >> 172.21.15.17:0/3019692564 conn(0x562cc3fe3f60 msgr2=0x562cc3fe4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 -- 172.21.15.17:0/3019692564 shutdown_connections 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.971+0000 7f55ca568740 1 -- 172.21.15.17:0/3019692564 wait complete. 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 -- start start 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 Processor -- start 2024-09-16T01:01:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe82f0 0x562cc3fef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fefca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562cc3ff5780 con 0x562cc3fe79d0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562cc3f08f20 con 0x562cc3ff2bb0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cc3ff5900 con 0x562cc3fe82f0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55ca568740 10 client.0 _ll_register_callbacks cb 0x562cc3ed2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55c572a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55c572a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32902/0 (socket says 172.21.15.17:32902) 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55c572a640 1 -- 172.21.15.17:0/635462727 learned_addr learned my addr 172.21.15.17:0/635462727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.972+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe82f0 0x562cc3fef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fefca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 -- 172.21.15.17:0/635462727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe82f0 msgr2=0x562cc3fef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe82f0 0x562cc3fef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 -- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 msgr2=0x562cc3fefca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fefca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 -- 172.21.15.17:0/635462727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc3cbf2b0 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55c572a640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f55b0015020 tx=0x7f55b0009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07ac11bd44fe84f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b00054d0 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f55b00134c0 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b001b070 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55b00136c0 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55ca568740 10 client.15045 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562cc4001070 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.973+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55b001b070 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f55b000c070 con 0x562cc3fe79d0 2024-09-16T01:01:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 10 client.15045 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 20 client.15045 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 4 client.15045 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cc3f5b600 con 0x562cc4003220 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.974+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.975+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4004690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8f76006adb1f10 server_cookie=cf7a1c93f5ef6417 in_seq=0 out_seq=0 2024-09-16T01:01:50.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.975+0000 7f55a97fa640 10 client.15045 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.975+0000 7f55a97fa640 1 -- 172.21.15.17:0/635462727 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cc3f5b600 con 0x562cc4003220 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.975+0000 7f55a97fa640 10 client.15045 handle_command_reply: tid=0 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.975+0000 7f55ca568740 1 client.15045 shutdown 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 msgr2=0x562cc3ff2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f55b0015020 tx=0x7f55b0009550 comp rx=0 tx=0).stop 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 shutdown_connections 2024-09-16T01:01:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4004690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fefca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe82f0 0x562cc3fef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55a97fa640 0 client.15045 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 --2- 172.21.15.17:0/635462727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe79d0 0x562cc3ff2410 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 >> 172.21.15.17:0/635462727 conn(0x562cc3fe3f60 msgr2=0x562cc3fe9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 shutdown_connections 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 1 -- 172.21.15.17:0/635462727 wait complete. 2024-09-16T01:01:50.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.976+0000 7f55ca568740 20 client.15045 trim_cache size 0 max 16384 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 Processor -- start 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 -- start start 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562cc40029d0 con 0x562cc3fe82f0 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562cc40030a0 con 0x562cc3ff2bb0 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55ca568740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cc4003770 con 0x562cc3fe79d0 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32906/0 (socket says 172.21.15.17:32906) 2024-09-16T01:01:50.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2194118878 learned_addr learned my addr 172.21.15.17:0/2194118878 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c572a640 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2194118878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 msgr2=0x562cc4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2194118878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 msgr2=0x562cc3fee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2194118878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc3ff2780 con 0x562cc3fe82f0 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c572a640 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.994+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55bc02a9a0 tx=0x7f55bc005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dd1831354e2124 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ab7fe640 1 -- 172.21.15.17:0/2194118878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc04b070 con 0x562cc3fe82f0 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ab7fe640 1 -- 172.21.15.17:0/2194118878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55bc0054f0 con 0x562cc3fe82f0 2024-09-16T01:01:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ab7fe640 1 -- 172.21.15.17:0/2194118878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc035040 con 0x562cc3fe82f0 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 -- 172.21.15.17:0/2194118878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 msgr2=0x562cc3fee030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55bc02a9a0 tx=0x7f55bc005e60 comp rx=0 tx=0).stop 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 -- 172.21.15.17:0/2194118878 shutdown_connections 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc3fee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc3fee030 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 --2- 172.21.15.17:0/2194118878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 -- 172.21.15.17:0/2194118878 >> 172.21.15.17:0/2194118878 conn(0x562cc3fe3f60 msgr2=0x562cc3fdece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 -- 172.21.15.17:0/2194118878 shutdown_connections 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.995+0000 7f55ca568740 1 -- 172.21.15.17:0/2194118878 wait complete. 2024-09-16T01:01:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 -- start start 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 Processor -- start 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4007f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc406b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562cc4004510 con 0x562cc3fe82f0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562cc4003e40 con 0x562cc3ff2bb0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cc4004be0 con 0x562cc3fe79d0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55ca568740 10 client.0 _ll_register_callbacks cb 0x7f55bc005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55c5f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55c5f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32908/0 (socket says 172.21.15.17:32908) 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2609528915 learned_addr learned my addr 172.21.15.17:0/2609528915 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.996+0000 7f55c572a640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4007f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c572a640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2609528915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 msgr2=0x562cc4007f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4007f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 msgr2=0x562cc406b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc406b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 -- 172.21.15.17:0/2609528915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc406bee0 con 0x562cc3fe82f0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c572a640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc406b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55c5f2b640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009230 tx=0x7f55bc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67948d72f58d1b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc04b040 con 0x562cc3fe82f0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f55bc004750 con 0x562cc3fe82f0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55bc0054f0 con 0x562cc3fe82f0 2024-09-16T01:01:51.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55bc035040 con 0x562cc3fe82f0 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55ca568740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562cc406d1c0 con 0x562cc3fe82f0 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.997+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55bc0054f0 con 0x562cc3fe82f0 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f55bc04e030 con 0x562cc3fe82f0 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 10 client.15051 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 20 client.15051 populate_metadata read hostname 'smithi017' 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 4 client.15051 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "status"}) -- 0x562cc3f55b10 con 0x562cc4003220 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55c572a640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:51.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55c572a640 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4070590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7389b4d6dd5a09e8 server_cookie=57dd57e2a9f5f158 in_seq=0 out_seq=0 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.998+0000 7f55a97fa640 10 client.15051 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55a97fa640 1 -- 172.21.15.17:0/2609528915 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7f55b001b160 con 0x562cc4003220 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55a97fa640 10 client.15051 handle_command_reply: tid=0 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 client.15051 shutdown 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 msgr2=0x562cc4008470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009230 tx=0x7f55bc005fd0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 shutdown_connections 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562cc4003220 0x562cc4070590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562cc3ff2bb0 0x562cc406b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55a97fa640 0 client.15051 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cc3fe82f0 0x562cc4008470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 --2- 172.21.15.17:0/2609528915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cc3fe79d0 0x562cc4007f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 >> 172.21.15.17:0/2609528915 conn(0x562cc3fe3f60 msgr2=0x562cc3fedc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 shutdown_connections 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 1 -- 172.21.15.17:0/2609528915 wait complete. 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:50.999+0000 7f55ca568740 20 client.15051 trim_cache size 0 max 16384 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24515, 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:01:51.006 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 81.563016515000001, 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 92.491604421999995 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:01:51.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 msgr2=0x7f55ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 0x7f55ac0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55b80983b0 tx=0x7f55b806dd20 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 msgr2=0x7f55c019e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55b800cad0 tx=0x7f55b800cf90 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 shutdown_connections 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f55ac0a32d0 0x7f55ac0a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55c0112b90 0x7f55c019e810 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c0074eb0 0x7f55c01a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 --2- 172.21.15.17:0/2372099876 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c0074590 0x7f55c01a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 >> 172.21.15.17:0/2372099876 conn(0x7f55c00fd8c0 msgr2=0x7f55c00ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 shutdown_connections 2024-09-16T01:01:51.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:51.000+0000 7f55c818f640 1 -- 172.21.15.17:0/2372099876 wait complete. 2024-09-16T01:01:51.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:50 smithi088 ceph-mon[34093]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 104 B/s, 0 objects/s recovering 2024-09-16T01:01:51.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:50 smithi154 ceph-mon[34759]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 104 B/s, 0 objects/s recovering 2024-09-16T01:01:51.653 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T01:01:51.654 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:01:51.664 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:01:51.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T01:01:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 -- 172.21.15.17:0/885103506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c101c00 msgr2=0x7f270c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 --2- 172.21.15.17:0/885103506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c101c00 0x7f270c102000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2708009900 tx=0x7f270802a410 comp rx=0 tx=0).stop 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 -- 172.21.15.17:0/885103506 shutdown_connections 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 --2- 172.21.15.17:0/885103506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c1037c0 0x7f270c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 --2- 172.21.15.17:0/885103506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 0x7f270c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 --2- 172.21.15.17:0/885103506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c101c00 0x7f270c102000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 -- 172.21.15.17:0/885103506 >> 172.21.15.17:0/885103506 conn(0x7f270c0fd390 msgr2=0x7f270c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 -- 172.21.15.17:0/885103506 shutdown_connections 2024-09-16T01:01:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.375+0000 7f2714134640 1 -- 172.21.15.17:0/885103506 wait complete. 2024-09-16T01:01:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 Processor -- start 2024-09-16T01:01:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 -- start start 2024-09-16T01:01:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c101c00 0x7f270c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 0x7f270c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f270c10d790 con 0x7f270c1037c0 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f270c10d610 con 0x7f270c102e00 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f2714134640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f270c10d910 con 0x7f270c101c00 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f27126d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f27126d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32918/0 (socket says 172.21.15.17:32918) 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.376+0000 7f27126d1640 1 -- 172.21.15.17:0/105348924 learned_addr learned my addr 172.21.15.17:0/105348924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27116cf640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 0x7f270c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2711ed0640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c101c00 0x7f270c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 -- 172.21.15.17:0/105348924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c101c00 msgr2=0x7f270c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c101c00 0x7f270c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 -- 172.21.15.17:0/105348924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 msgr2=0x7f270c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 0x7f270c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 -- 172.21.15.17:0/105348924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c0753e0 con 0x7f270c1037c0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f27126d1640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f270400b970 tx=0x7f270400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704019070 con 0x7f270c1037c0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2704014440 con 0x7f270c1037c0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c1a1fc0 con 0x7f270c1037c0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27040075d0 con 0x7f270c1037c0 2024-09-16T01:01:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.377+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c1a2550 con 0x7f270c1037c0 2024-09-16T01:01:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.378+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270c109090 con 0x7f270c1037c0 2024-09-16T01:01:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.380+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f270401c070 con 0x7f270c1037c0 2024-09-16T01:01:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.381+0000 7f2702ffd640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 0x7f26f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.381+0000 7f2711ed0640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 0x7f26f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.381+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f27040cf330 con 0x7f270c1037c0 2024-09-16T01:01:52.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.382+0000 7f2711ed0640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 0x7f26f80a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2708004770 tx=0x7f2708000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:52.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.384+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f270409b960 con 0x7f270c1037c0 2024-09-16T01:01:52.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.577+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f270c062630 con 0x7f26f80a3350 2024-09-16T01:01:52.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.578+0000 7f2702ffd640 1 -- 172.21.15.17:0/105348924 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f270c062630 con 0x7f26f80a3350 2024-09-16T01:01:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-09-16T01:01:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-09-16T01:01:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-09-16T01:01:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 msgr2=0x7f26f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 0x7f26f80a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2708004770 tx=0x7f2708000bc0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 msgr2=0x7f270c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f270400b970 tx=0x7f270400be30 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 shutdown_connections 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f26f80a3350 0x7f26f80a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f270c1037c0 0x7f270c074b20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f270c102e00 0x7f270c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 --2- 172.21.15.17:0/105348924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270c101c00 0x7f270c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 >> 172.21.15.17:0/105348924 conn(0x7f270c0fd390 msgr2=0x7f270c106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 shutdown_connections 2024-09-16T01:01:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:52.581+0000 7f2714134640 1 -- 172.21.15.17:0/105348924 wait complete. 2024-09-16T01:01:52.896 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:52 smithi017 ceph-mon[31211]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:53.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:52 smithi088 ceph-mon[34093]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:53.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:52 smithi154 ceph-mon[34759]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:01:53.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T01:01:53.523 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:53.910 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:53 smithi017 ceph-mon[31211]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 -- 172.21.15.17:0/416542549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 msgr2=0x7ff6601073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 --2- 172.21.15.17:0/416542549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601073c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009900 tx=0x7ff64c02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 -- 172.21.15.17:0/416542549 shutdown_connections 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 --2- 172.21.15.17:0/416542549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff660107900 0x7ff660109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 --2- 172.21.15.17:0/416542549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601073c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 --2- 172.21.15.17:0/416542549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6601026a0 0x7ff660104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 -- 172.21.15.17:0/416542549 >> 172.21.15.17:0/416542549 conn(0x7ff6600fc2a0 msgr2=0x7ff6600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 -- 172.21.15.17:0/416542549 shutdown_connections 2024-09-16T01:01:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.991+0000 7ff66709c640 1 -- 172.21.15.17:0/416542549 wait complete. 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 Processor -- start 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 -- start start 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 0x7ff660197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 0x7ff66019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff66010d750 con 0x7ff660104fd0 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff66010d5d0 con 0x7ff660107900 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff66709c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff66010d8d0 con 0x7ff6601026a0 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32924/0 (socket says 172.21.15.17:32924) 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 -- 172.21.15.17:0/2506239702 learned_addr learned my addr 172.21.15.17:0/2506239702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff665639640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 0x7ff66019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff664e38640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 0x7ff660197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 -- 172.21.15.17:0/2506239702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 msgr2=0x7ff660197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 0x7ff660197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 -- 172.21.15.17:0/2506239702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 msgr2=0x7ff66019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 0x7ff66019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.992+0000 7ff65ffff640 1 -- 172.21.15.17:0/2506239702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66019faa0 con 0x7ff660104fd0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff665639640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 0x7ff66019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff664e38640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 0x7ff660197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff65ffff640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0314e0 tx=0x7ff64c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c03f030 con 0x7ff660104fd0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66019fd30 con 0x7ff660104fd0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff64c003cb0 con 0x7ff660104fd0 2024-09-16T01:01:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c035070 con 0x7ff660104fd0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.993+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6601a0200 con 0x7ff660104fd0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.994+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6600fdd90 con 0x7ff660104fd0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.995+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff64c042030 con 0x7ff660104fd0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.996+0000 7ff65dffb640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 0x7ff6500a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.996+0000 7ff664e38640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 0x7ff6500a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.996+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff64c0f0570 con 0x7ff660104fd0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:53.997+0000 7ff664e38640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 0x7ff6500a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff654009b40 tx=0x7ff654005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.000+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff64c0bd0e0 con 0x7ff660104fd0 2024-09-16T01:01:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:53 smithi088 ceph-mon[34093]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:54.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:53 smithi154 ceph-mon[34759]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:54.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.184+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff660062630 con 0x7ff6500a3300 2024-09-16T01:01:54.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.196+0000 7ff65dffb640 1 -- 172.21.15.17:0/2506239702 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7ff660062630 con 0x7ff6500a3300 2024-09-16T01:01:54.197 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (98s) 19s ago 98s 20.0M - 19.1.1-326-g8921c8ef f1455bd0219c a4ddbd17dd84 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi088 running (96s) 28s ago 95s 28.6M - 19.1.1-326-g8921c8ef f1455bd0219c 8e7c7aea3a1b 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi154 running (110s) 28s ago 109s 20.1M - 19.1.1-326-g8921c8ef f1455bd0219c bbb9ab961e04 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (117s) 19s ago 117s 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 118b4625910f 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi088 running (115s) 28s ago 114s 20.3M - 19.1.1-326-g8921c8ef f1455bd0219c 843658d0b44f 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi154 running (112s) 28s ago 112s 16.9M - 19.1.1-326-g8921c8ef f1455bd0219c 1c24ccf4800b 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (102s) 19s ago 101s 17.1M - 19.1.1-326-g8921c8ef f1455bd0219c f30a2f5b2577 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi088 running (107s) 28s ago 106s 18.0M - 19.1.1-326-g8921c8ef f1455bd0219c 0e8409b82a73 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi154 running (104s) 28s ago 104s 18.1M - 19.1.1-326-g8921c8ef f1455bd0219c cda17ad8e22b 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (2m) 19s ago 2m 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 01f36a7adce2 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi088 running (2m) 28s ago 2m 17.0M - 19.1.1-326-g8921c8ef f1455bd0219c 45fb5c3c7297 2024-09-16T01:01:54.198 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi154 running (2m) 28s ago 2m 16.7M - 19.1.1-326-g8921c8ef f1455bd0219c cec399b9ea1c 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (9m) 19s ago 9m 509M - 19.1.1-326-g8921c8ef f1455bd0219c 80323d07f892 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi088 *:8443,8765 running (7m) 28s ago 7m 444M - 19.1.1-326-g8921c8ef f1455bd0219c 22a34ba7637e 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi154 *:8443,8765 running (7m) 28s ago 7m 444M - 19.1.1-326-g8921c8ef f1455bd0219c f37f9b331249 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (9m) 19s ago 9m 50.6M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 40ded1da3164 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi088 running (7m) 28s ago 7m 43.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 410fd8b94557 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi154 running (7m) 28s ago 7m 39.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 3abb8e4badd3 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 19s ago 7m 45.4M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 79b76aed189a 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi088 running (6m) 28s ago 6m 58.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 4f360c15707e 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi154 running (6m) 28s ago 6m 48.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 5e7e53302228 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (5m) 19s ago 5m 53.5M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 4883c45b3114 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi088 running (5m) 28s ago 5m 43.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 47fd55a879e3 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi154 running (4m) 28s ago 4m 58.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c f16ee03d8eec 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (4m) 19s ago 4m 41.1M 4273M 19.1.1-326-g8921c8ef f1455bd0219c f7b9e0f11765 2024-09-16T01:01:54.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi088 running (4m) 28s ago 4m 56.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 46544aeb7ec5 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi154 running (3m) 28s ago 3m 52.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 520cc052561b 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 19s ago 3m 53.1M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 14925c37b8f6 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi088 running (2m) 28s ago 2m 53.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d06cb7027600 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi154 running (2m) 28s ago 2m 51.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c b32d784bee42 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 msgr2=0x7ff6500a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 0x7ff6500a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff654009b40 tx=0x7ff654005e50 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 msgr2=0x7ff6601983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0314e0 tx=0x7ff64c0042e0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 shutdown_connections 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff6500a3300 0x7ff6500a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff660107900 0x7ff66019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff660104fd0 0x7ff6601983b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 --2- 172.21.15.17:0/2506239702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6601026a0 0x7ff660197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 >> 172.21.15.17:0/2506239702 conn(0x7ff6600fc2a0 msgr2=0x7ff660102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 shutdown_connections 2024-09-16T01:01:54.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:54.198+0000 7ff66709c640 1 -- 172.21.15.17:0/2506239702 wait complete. 2024-09-16T01:01:54.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T01:01:54.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:54 smithi017 ceph-mon[31211]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:55.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:54 smithi088 ceph-mon[34093]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:55.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:54 smithi154 ceph-mon[34759]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:01:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 -- 172.21.15.17:0/563369316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 msgr2=0x7ff5e010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 --2- 172.21.15.17:0/563369316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e010a050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009ca0 tx=0x7ff5d802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 -- 172.21.15.17:0/563369316 shutdown_connections 2024-09-16T01:01:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 --2- 172.21.15.17:0/563369316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e010a050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 --2- 172.21.15.17:0/563369316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0102e00 0x7ff5e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 --2- 172.21.15.17:0/563369316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0101c00 0x7ff5e0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 -- 172.21.15.17:0/563369316 >> 172.21.15.17:0/563369316 conn(0x7ff5e00fd390 msgr2=0x7ff5e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 -- 172.21.15.17:0/563369316 shutdown_connections 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.608+0000 7ff5e7061640 1 -- 172.21.15.17:0/563369316 wait complete. 2024-09-16T01:01:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 Processor -- start 2024-09-16T01:01:55.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 -- start start 2024-09-16T01:01:55.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 0x7ff5e0197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:55.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 0x7ff5e01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:55.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:55.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d710 con 0x7ff5e01037c0 2024-09-16T01:01:55.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d590 con 0x7ff5e0101c00 2024-09-16T01:01:55.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e7061640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d890 con 0x7ff5e0102e00 2024-09-16T01:01:55.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e55fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e55fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32952/0 (socket says 172.21.15.17:32952) 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e55fe640 1 -- 172.21.15.17:0/4241113281 learned_addr learned my addr 172.21.15.17:0/4241113281 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.609+0000 7ff5e4dfd640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 0x7ff5e0197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5dffff640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 0x7ff5e01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 -- 172.21.15.17:0/4241113281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 msgr2=0x7ff5e01981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 0x7ff5e01981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 -- 172.21.15.17:0/4241113281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 msgr2=0x7ff5e0197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 0x7ff5e0197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 -- 172.21.15.17:0/4241113281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e019f8c0 con 0x7ff5e01037c0 2024-09-16T01:01:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5dffff640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 0x7ff5e01981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e4dfd640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 0x7ff5e0197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e55fe640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009dc0 tx=0x7ff5d8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8004040 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e019fb50 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d8004690 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d802f4c0 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.610+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01a0090 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.611+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e0108f30 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.613+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff5d8030650 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.613+0000 7ff5ddffb640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 0x7ff5d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.613+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff5d80f11b0 con 0x7ff5e01037c0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.613+0000 7ff5e4dfd640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 0x7ff5d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.614+0000 7ff5e4dfd640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 0x7ff5d00a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40058c0 tx=0x7ff5d4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:55.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.617+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5d804d3a0 con 0x7ff5e01037c0 2024-09-16T01:01:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.801+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff5e0062630 con 0x7ff5d00a32d0 2024-09-16T01:01:55.803 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:55 smithi017 ceph-mon[31211]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:55.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.808+0000 7ff5ddffb640 1 -- 172.21.15.17:0/4241113281 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff5e0062630 con 0x7ff5d00a32d0 2024-09-16T01:01:55.809 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T01:01:55.809 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 30s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi088=b;smithi088=e;smithi088=h;smithi088=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-09-16T01:01:55.809 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 30s ago 7m smithi017=x;smithi088=y;smithi154=z;count:3 2024-09-16T01:01:55.809 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 30s ago 7m smithi017:172.21.15.17=a;smithi088:172.21.15.88=b;smithi154:172.21.15.154=c;count:3 2024-09-16T01:01:55.810 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 30s ago - 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 msgr2=0x7ff5d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 0x7ff5d00a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40058c0 tx=0x7ff5d4005850 comp rx=0 tx=0).stop 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 msgr2=0x7ff5e019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009dc0 tx=0x7ff5d8003ba0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 shutdown_connections 2024-09-16T01:01:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff5d00a32d0 0x7ff5d00a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e01037c0 0x7ff5e019f250 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e0102e00 0x7ff5e01981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 --2- 172.21.15.17:0/4241113281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5e0101c00 0x7ff5e0197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 >> 172.21.15.17:0/4241113281 conn(0x7ff5e00fd390 msgr2=0x7ff5e0106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 shutdown_connections 2024-09-16T01:01:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:55.810+0000 7ff5e7061640 1 -- 172.21.15.17:0/4241113281 wait complete. 2024-09-16T01:01:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:55 smithi088 ceph-mon[34093]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:56.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:55 smithi154 ceph-mon[34759]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:56.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T01:01:56.777 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:57.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:56 smithi017 ceph-mon[31211]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:01:57.030 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:56 smithi017 ceph-mon[31211]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:56 smithi088 ceph-mon[34093]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:01:57.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:56 smithi088 ceph-mon[34093]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:56 smithi154 ceph-mon[34759]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:01:57.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:56 smithi154 ceph-mon[34759]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- 172.21.15.17:0/1127250671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8100ad0 msgr2=0x7f60a8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- 172.21.15.17:0/1127250671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8100ad0 0x7f60a8100ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009900 tx=0x7f60a402a410 comp rx=0 tx=0).stop 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- 172.21.15.17:0/1127250671 shutdown_connections 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- 172.21.15.17:0/1127250671 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8102690 0x7f60a8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- 172.21.15.17:0/1127250671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 0x7f60a8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- 172.21.15.17:0/1127250671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8100ad0 0x7f60a8100ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- 172.21.15.17:0/1127250671 >> 172.21.15.17:0/1127250671 conn(0x7f60a80fc280 msgr2=0x7f60a80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- 172.21.15.17:0/1127250671 shutdown_connections 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- 172.21.15.17:0/1127250671 wait complete. 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 Processor -- start 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 -- start start 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 0x7f60a8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.235+0000 7f60af782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 0x7f60a8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60a810d770 con 0x7f60a8102690 2024-09-16T01:01:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f60a810d5f0 con 0x7f60a8100ad0 2024-09-16T01:01:57.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60a810d8f0 con 0x7f60a8101cd0 2024-09-16T01:01:57.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32958/0 (socket says 172.21.15.17:32958) 2024-09-16T01:01:57.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 -- 172.21.15.17:0/1979744700 learned_addr learned my addr 172.21.15.17:0/1979744700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:57.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60ad51e640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 0x7f60a8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60acd1d640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 0x7f60a8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 -- 172.21.15.17:0/1979744700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 msgr2=0x7f60a8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 0x7f60a8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 -- 172.21.15.17:0/1979744700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 msgr2=0x7f60a8197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 0x7f60a8197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 -- 172.21.15.17:0/1979744700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a819fa80 con 0x7f60a8102690 2024-09-16T01:01:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60ad51e640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 0x7f60a8197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60add1f640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60a000cce0 tx=0x7f60a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a000f450 con 0x7f60a8102690 2024-09-16T01:01:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a819fd70 con 0x7f60a8102690 2024-09-16T01:01:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60a000faa0 con 0x7f60a8102690 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0018b70 con 0x7f60a8102690 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.236+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a81a02d0 con 0x7f60a8102690 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.237+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a8107f40 con 0x7f60a8102690 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.238+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f60a0018d10 con 0x7f60a8102690 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.239+0000 7f609e7fc640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 0x7f60940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.240+0000 7f60ad51e640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 0x7f60940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:57.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.240+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f60a00cff50 con 0x7f60a8102690 2024-09-16T01:01:57.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.240+0000 7f60ad51e640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 0x7f60940a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000c00 tx=0x7f60a4031d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:57.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.244+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60a0014030 con 0x7f60a8102690 2024-09-16T01:01:57.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.424+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f60a8062630 con 0x7f60940a3300 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.425+0000 7f609e7fc640 1 -- 172.21.15.17:0/1979744700 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f60a8062630 con 0x7f60940a3300 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stdout:smithi088 172.21.15.88 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stdout:smithi154 172.21.15.154 2024-09-16T01:01:57.427 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.427+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 msgr2=0x7f60940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.427+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 0x7f60940a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000c00 tx=0x7f60a4031d10 comp rx=0 tx=0).stop 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.427+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 msgr2=0x7f60a819f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.427+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60a000cce0 tx=0x7f60a000a620 comp rx=0 tx=0).stop 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 shutdown_connections 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f60940a3300 0x7f60940a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102690 0x7f60a819f410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a8101cd0 0x7f60a8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 --2- 172.21.15.17:0/1979744700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60a8100ad0 0x7f60a8197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 >> 172.21.15.17:0/1979744700 conn(0x7f60a80fc280 msgr2=0x7f60a8105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 shutdown_connections 2024-09-16T01:01:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:57.428+0000 7f60af782640 1 -- 172.21.15.17:0/1979744700 wait complete. 2024-09-16T01:01:58.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T01:01:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 -- 172.21.15.17:0/2893571618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234103210 msgr2=0x7fb234103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2893571618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234103210 0x7fb234103610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009900 tx=0x7fb22c02a410 comp rx=0 tx=0).stop 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 -- 172.21.15.17:0/2893571618 shutdown_connections 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2893571618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234100350 0x7fb23410a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2893571618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103be0 0x7fb2340ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2893571618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234103210 0x7fb234103610 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 -- 172.21.15.17:0/2893571618 >> 172.21.15.17:0/2893571618 conn(0x7fb2340fba40 msgr2=0x7fb2340fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 -- 172.21.15.17:0/2893571618 shutdown_connections 2024-09-16T01:01:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.844+0000 7fb23acf0640 1 -- 172.21.15.17:0/2893571618 wait complete. 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 Processor -- start 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 -- start start 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103210 0x7fb2341983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234103be0 0x7fb23419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb23410d790 con 0x7fb234100350 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb23410d610 con 0x7fb234103210 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb23acf0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb23410d910 con 0x7fb234103be0 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb238a8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb238a8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32974/0 (socket says 172.21.15.17:32974) 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.845+0000 7fb238a8c640 1 -- 172.21.15.17:0/2533304156 learned_addr learned my addr 172.21.15.17:0/2533304156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb233fff640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103210 0x7fb2341983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb23928d640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234103be0 0x7fb23419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 -- 172.21.15.17:0/2533304156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234103be0 msgr2=0x7fb23419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234103be0 0x7fb23419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 -- 172.21.15.17:0/2533304156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103210 msgr2=0x7fb2341983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103210 0x7fb2341983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 -- 172.21.15.17:0/2533304156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23419faa0 con 0x7fb234100350 2024-09-16T01:01:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb238a8c640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb22c004270 tx=0x7fb22c031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c03f030 con 0x7fb234100350 2024-09-16T01:01:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb22c003cb0 con 0x7fb234100350 2024-09-16T01:01:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035070 con 0x7fb234100350 2024-09-16T01:01:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23419fd30 con 0x7fb234100350 2024-09-16T01:01:58.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.846+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2341a01c0 con 0x7fb234100350 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.847+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb234109220 con 0x7fb234100350 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.848+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb22c042030 con 0x7fb234100350 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.849+0000 7fb231ffb640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 0x7fb2200a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.849+0000 7fb233fff640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 0x7fb2200a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.849+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb22c0f0140 con 0x7fb234100350 2024-09-16T01:01:58.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.850+0000 7fb233fff640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 0x7fb2200a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb21c005e10 tx=0x7fb21c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:58.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:58.853+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb22c0bccb0 con 0x7fb234100350 2024-09-16T01:01:59.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.039+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fb234062630 con 0x7fb2200a3300 2024-09-16T01:01:59.041 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:58 smithi017 ceph-mon[31211]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-16T01:01:59.041 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:01:58 smithi017 ceph-mon[31211]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.041+0000 7fb231ffb640 1 -- 172.21.15.17:0/2533304156 <== mgr.14150 v2:172.21.15.17:6800/333607551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fb234062630 con 0x7fb2200a3300 2024-09-16T01:01:59.042 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T01:01:59.042 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-16T01:01:59.042 INFO:teuthology.orchestra.run.smithi017.stdout:smithi088 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-16T01:01:59.042 INFO:teuthology.orchestra.run.smithi017.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-16T01:01:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 msgr2=0x7fb2200a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 0x7fb2200a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb21c005e10 tx=0x7fb21c005da0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 msgr2=0x7fb234197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb22c004270 tx=0x7fb22c031a30 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 shutdown_connections 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb2200a3300 0x7fb2200a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb234103be0 0x7fb23419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb234103210 0x7fb2341983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 --2- 172.21.15.17:0/2533304156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb234100350 0x7fb234197e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 >> 172.21.15.17:0/2533304156 conn(0x7fb2340fba40 msgr2=0x7fb2341063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 shutdown_connections 2024-09-16T01:01:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:01:59.043+0000 7fb23acf0640 1 -- 172.21.15.17:0/2533304156 wait complete. 2024-09-16T01:01:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:58 smithi088 ceph-mon[34093]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-16T01:01:59.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:01:58 smithi088 ceph-mon[34093]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:58 smithi154 ceph-mon[34759]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-16T01:01:59.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:01:58 smithi154 ceph-mon[34759]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:59.663 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:01:59.671 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:01:59.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T01:01:59.931 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.375+0000 7f5830328640 1 -- 172.21.15.17:0/944194347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828101cd0 msgr2=0x7f5828102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.375+0000 7f5830328640 1 --2- 172.21.15.17:0/944194347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828101cd0 0x7f5828102150 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5818009900 tx=0x7f581802a410 comp rx=0 tx=0).stop 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 -- 172.21.15.17:0/944194347 shutdown_connections 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 --2- 172.21.15.17:0/944194347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f5828108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 --2- 172.21.15.17:0/944194347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828101cd0 0x7f5828102150 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 --2- 172.21.15.17:0/944194347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828100ad0 0x7f5828100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 -- 172.21.15.17:0/944194347 >> 172.21.15.17:0/944194347 conn(0x7f58280fc280 msgr2=0x7f58280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 -- 172.21.15.17:0/944194347 shutdown_connections 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 -- 172.21.15.17:0/944194347 wait complete. 2024-09-16T01:02:00.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 Processor -- start 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.376+0000 7f5830328640 1 -- start start 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828101cd0 0x7f58281983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f582819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f582810d790 con 0x7f5828100ad0 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f582810d610 con 0x7f5828102690 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f5830328640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f582810d910 con 0x7f5828101cd0 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32992/0 (socket says 172.21.15.17:32992) 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 -- 172.21.15.17:0/2579534802 learned_addr learned my addr 172.21.15.17:0/2579534802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:00.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582d8c3640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828101cd0 0x7f58281983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e8c5640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f582819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 -- 172.21.15.17:0/2579534802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828101cd0 msgr2=0x7f58281983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828101cd0 0x7f58281983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 -- 172.21.15.17:0/2579534802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 msgr2=0x7f582819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f582819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 -- 172.21.15.17:0/2579534802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582819fad0 con 0x7f5828100ad0 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e8c5640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f582819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f582e0c4640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f582400b450 tx=0x7f582400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.377+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824015020 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.378+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5824011d40 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.378+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582819fdc0 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.378+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582400f340 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.378+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58281a0290 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.379+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5828107f10 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.380+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5824018020 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.380+0000 7f581f7fe640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 0x7f58140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.380+0000 7f582d8c3640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 0x7f58140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.380+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f58240cf470 con 0x7f5828100ad0 2024-09-16T01:02:00.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.381+0000 7f582d8c3640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 0x7f58140a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58281993c0 tx=0x7f58180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:00.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.385+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f582401f020 con 0x7f5828100ad0 2024-09-16T01:02:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.596+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5828062ef0 con 0x7f5828100ad0 2024-09-16T01:02:00.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.596+0000 7f581f7fe640 1 -- 172.21.15.17:0/2579534802 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3123 (secure 0 0 0) 0x7f582400d040 con 0x7f5828100ad0 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:e27 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-16T01:00:40:505815+0000 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-16T01:02:00.598 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 27 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-16T01:00:29.073506+0000 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-16T01:00:40.505799+0000 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-16T01:02:00.599 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 5 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2,3,4 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24515,1=24503,2=24482,3=24472,4=24464} 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-16T01:02:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 24515 members: 24515,24482,24472,24503,24464 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24515} state up:active seq 4 addr [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{0:24451} state up:standby-replay seq 1 addr [v2:172.21.15.154:6836/3615564777,v1:172.21.15.154:6837/3615564777] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{1:24503} state up:active seq 7 addr [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{1:24445} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/3320793854,v1:172.21.15.154:6835/3320793854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{2:24482} state up:active seq 9 addr [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{2:24443} state up:standby-replay seq 1 addr [v2:172.21.15.88:6832/764220258,v1:172.21.15.88:6833/764220258] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{3:24472} state up:active seq 9 addr [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{3:24412} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/1776584751,v1:172.21.15.154:6833/1776584751] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{4:24464} state up:active seq 11 addr [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{4:14604} state up:standby-replay seq 1 addr [v2:172.21.15.17:6838/2587837863,v1:172.21.15.17:6839/2587837863] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.17:6834/2859386479,v1:172.21.15.17:6835/2859386479] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.602 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14550} state up:standby seq 1 addr [v2:172.21.15.17:6836/2668055103,v1:172.21.15.17:6837/2668055103] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 msgr2=0x7f58140a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 0x7f58140a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58281993c0 tx=0x7f58180314a0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 msgr2=0x7f5828197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f582400b450 tx=0x7f582400b910 comp rx=0 tx=0).stop 2024-09-16T01:02:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 shutdown_connections 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f58140a3300 0x7f58140a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5828102690 0x7f582819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5828101cd0 0x7f58281983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 --2- 172.21.15.17:0/2579534802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5828100ad0 0x7f5828197ea0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 >> 172.21.15.17:0/2579534802 conn(0x7f58280fc280 msgr2=0x7f58281050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.599+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 shutdown_connections 2024-09-16T01:02:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:00.600+0000 7f5830328640 1 -- 172.21.15.17:0/2579534802 wait complete. 2024-09-16T01:02:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:00 smithi088 ceph-mon[34093]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-16T01:02:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:00 smithi088 ceph-mon[34093]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:00 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2579534802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:02:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:00 smithi154 ceph-mon[34759]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-16T01:02:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:00 smithi154 ceph-mon[34759]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:00 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2579534802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:02:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:00 smithi017 ceph-mon[31211]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-16T01:02:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:00 smithi017 ceph-mon[31211]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:00 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2579534802' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:02:01.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-16T01:02:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:02.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 -- 172.21.15.17:0/3804550569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 msgr2=0x7ff1301073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 --2- 172.21.15.17:0/3804550569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff1301073c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff124009900 tx=0x7ff12402a410 comp rx=0 tx=0).stop 2024-09-16T01:02:02.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 -- 172.21.15.17:0/3804550569 shutdown_connections 2024-09-16T01:02:02.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 --2- 172.21.15.17:0/3804550569 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff130107900 0x7ff130109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 --2- 172.21.15.17:0/3804550569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff1301073c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 --2- 172.21.15.17:0/3804550569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1301026a0 0x7ff130104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 -- 172.21.15.17:0/3804550569 >> 172.21.15.17:0/3804550569 conn(0x7ff1300fc2a0 msgr2=0x7ff1300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 -- 172.21.15.17:0/3804550569 shutdown_connections 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 -- 172.21.15.17:0/3804550569 wait complete. 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.076+0000 7ff136cba640 1 Processor -- start 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 -- start start 2024-09-16T01:02:02.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 0x7ff130197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff130107900 0x7ff13019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d7b0 con 0x7ff130104fd0 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d630 con 0x7ff1301026a0 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff136cba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d930 con 0x7ff130107900 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54862/0 (socket says 172.21.15.17:54862) 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 -- 172.21.15.17:0/236132034 learned_addr learned my addr 172.21.15.17:0/236132034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff135257640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff130107900 0x7ff13019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff134a56640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 0x7ff130197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 -- 172.21.15.17:0/236132034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff130107900 msgr2=0x7ff13019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff130107900 0x7ff13019f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 -- 172.21.15.17:0/236132034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 msgr2=0x7ff130197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 0x7ff130197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff12ffff640 1 -- 172.21.15.17:0/236132034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13019fb20 con 0x7ff130104fd0 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.077+0000 7ff134a56640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 0x7ff130197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:02.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff12ffff640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff1240314e0 tx=0x7ff1240042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12403f030 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff124003cb0 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13019fdb0 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124035070 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.078+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1301a02d0 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.079+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1300fdd90 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.080+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff124042030 con 0x7ff130104fd0 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.081+0000 7ff12dffb640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 0x7ff1180a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.081+0000 7ff134a56640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 0x7ff1180a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.081+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff1240f03f0 con 0x7ff130104fd0 2024-09-16T01:02:02.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.082+0000 7ff134a56640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 0x7ff1180a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff120009930 tx=0x7ff120008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.084+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1240bd080 con 0x7ff130104fd0 2024-09-16T01:02:02.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.262+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff13002d7c0 con 0x7ff130104fd0 2024-09-16T01:02:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.263+0000 7ff12dffb640 1 -- 172.21.15.17:0/236132034 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5255 (secure 0 0 0) 0x7ff1240bc980 con 0x7ff130104fd0 2024-09-16T01:02:02.264 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 82 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-16T00:52:47.071991+0000 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-16T01:01:34.675588+0000 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 26 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-16T01:02:02.265 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/1660486395,v1:172.21.15.17:6803/1660486395] [v2:172.21.15.17:6804/1660486395,v1:172.21.15.17:6805/1660486395] exists,up df210cfa-2f35-4f3b-b149-52700132d8f3 2024-09-16T01:02:02.266 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/2469077193,v1:172.21.15.88:6801/2469077193] [v2:172.21.15.88:6802/2469077193,v1:172.21.15.88:6803/2469077193] exists,up f2edb955-6522-41b5-955a-cc55dfcbc826 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/634195580,v1:172.21.15.154:6801/634195580] [v2:172.21.15.154:6802/634195580,v1:172.21.15.154:6803/634195580] exists,up 83ea9ade-f366-48d6-bccb-f83f659606c7 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/920279967,v1:172.21.15.17:6811/920279967] [v2:172.21.15.17:6812/920279967,v1:172.21.15.17:6813/920279967] exists,up 7e314fac-8a90-4825-9461-14e0385931bf 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6808/1483055508,v1:172.21.15.88:6809/1483055508] [v2:172.21.15.88:6810/1483055508,v1:172.21.15.88:6811/1483055508] exists,up 5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/995559400,v1:172.21.15.154:6809/995559400] [v2:172.21.15.154:6810/995559400,v1:172.21.15.154:6811/995559400] exists,up 88c11364-316e-4f0b-8e9a-e81777fc1c69 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/2722817993,v1:172.21.15.17:6819/2722817993] [v2:172.21.15.17:6820/2722817993,v1:172.21.15.17:6821/2722817993] exists,up cc10686b-395d-47c7-981e-096599f67648 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 48 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6816/1774608231,v1:172.21.15.88:6817/1774608231] [v2:172.21.15.88:6818/1774608231,v1:172.21.15.88:6819/1774608231] exists,up f9f171b1-68c5-4ab6-94c0-13647aa06ab1 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 55 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/307626373,v1:172.21.15.154:6817/307626373] [v2:172.21.15.154:6818/307626373,v1:172.21.15.154:6819/307626373] exists,up 9dc9ff0e-49eb-4681-a903-eb42ed1853ad 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/2711605096,v1:172.21.15.17:6827/2711605096] [v2:172.21.15.17:6828/2711605096,v1:172.21.15.17:6829/2711605096] exists,up 7cdac651-4624-4fac-95de-1cfce92a9be8 2024-09-16T01:02:02.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6824/40654334,v1:172.21.15.88:6825/40654334] [v2:172.21.15.88:6826/40654334,v1:172.21.15.88:6827/40654334] exists,up c69a732f-1e22-4163-9c9d-ed8bac4d6a52 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/2457783951,v1:172.21.15.154:6825/2457783951] [v2:172.21.15.154:6826/2457783951,v1:172.21.15.154:6827/2457783951] exists,up 19cb97fa-bfa5-4cee-8c01-9747633a2d8b 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.4 [2,11] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.14 [2,4] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.1c [8,11] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.1f [8,4] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1d [4,8] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.2c [4,9] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.33 [5,9] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.34 [4,9] 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2508292996 expires 2024-09-17T00:53:32.835388+0000 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/944475972 expires 2024-09-17T00:53:32.835388+0000 2024-09-16T01:02:02.268 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1760357677 expires 2024-09-17T00:53:32.835388+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3062290929 expires 2024-09-17T00:53:09.103759+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/930560743 expires 2024-09-17T00:53:09.103759+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/930560743 expires 2024-09-17T00:53:09.103759+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/4138203557 expires 2024-09-17T00:53:32.835388+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/944475972 expires 2024-09-17T00:53:32.835388+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2767834487 expires 2024-09-17T00:53:09.103759+0000 2024-09-16T01:02:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3770543874 expires 2024-09-17T00:53:09.103759+0000 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 msgr2=0x7ff1180a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 0x7ff1180a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff120009930 tx=0x7ff120008040 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 msgr2=0x7ff130198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff1240314e0 tx=0x7ff1240042e0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 shutdown_connections 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ff1180a3380 0x7ff1180a5840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff130107900 0x7ff13019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff130104fd0 0x7ff130198430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 --2- 172.21.15.17:0/236132034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1301026a0 0x7ff130197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 >> 172.21.15.17:0/236132034 conn(0x7ff1300fc2a0 msgr2=0x7ff130102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 shutdown_connections 2024-09-16T01:02:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:02.265+0000 7ff136cba640 1 -- 172.21.15.17:0/236132034 wait complete. 2024-09-16T01:02:03.013 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-16T01:02:03.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:02:03.048 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:02 smithi017 ceph-mon[31211]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:03.048 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:02 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/236132034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:02:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:02 smithi088 ceph-mon[34093]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:03.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:02 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/236132034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:02:03.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:02 smithi154 ceph-mon[34759]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-16T01:02:03.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:02 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/236132034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:02:03.282 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:03.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- 172.21.15.17:0/2988144853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00100e20 msgr2=0x7f2c00101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2988144853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00100e20 0x7f2c00101200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009900 tx=0x7f2bf402a480 comp rx=0 tx=0).stop 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- 172.21.15.17:0/2988144853 shutdown_connections 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2988144853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102ef0 0x7f2c0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2988144853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00102570 0x7f2c001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2988144853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00100e20 0x7f2c00101200 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- 172.21.15.17:0/2988144853 >> 172.21.15.17:0/2988144853 conn(0x7f2c000fc7d0 msgr2=0x7f2c000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- 172.21.15.17:0/2988144853 shutdown_connections 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- 172.21.15.17:0/2988144853 wait complete. 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 Processor -- start 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- start start 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 0x7f2c00198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 0x7f2c00198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00110e00 con 0x7f2c00102ef0 2024-09-16T01:02:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00110c80 con 0x7f2c00102570 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.751+0000 7f2c06a89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00110f80 con 0x7f2c00100e20 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54868/0 (socket says 172.21.15.17:54868) 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 -- 172.21.15.17:0/2324469311 learned_addr learned my addr 172.21.15.17:0/2324469311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c04825640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 0x7f2c00198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2bfffff640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 0x7f2c00198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 -- 172.21.15.17:0/2324469311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 msgr2=0x7f2c00198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 0x7f2c00198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 -- 172.21.15.17:0/2324469311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 msgr2=0x7f2c00198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 0x7f2c00198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 -- 172.21.15.17:0/2324469311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0019d300 con 0x7f2c00102ef0 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2bfffff640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 0x7f2c00198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c04825640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 0x7f2c00198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c05026640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800eaa0 tx=0x7f2bf800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800cdb0 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0019d5f0 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bf8005020 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.752+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80116d0 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.753+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c001a4ed0 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.753+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c00101200 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.755+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2bf80051d0 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.755+0000 7f2bfdffb640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 0x7f2bf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.755+0000 7f2c04825640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 0x7f2bf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.755+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2bf80cfd40 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.756+0000 7f2c04825640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 0x7f2bf00a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005ab0 tx=0x7f2bf4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.759+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bf8016030 con 0x7f2c00102ef0 2024-09-16T01:02:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.775+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2bf8098880 con 0x7f2c00102ef0 2024-09-16T01:02:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.982+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c001a50a0 con 0x7f2c00102ef0 2024-09-16T01:02:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.982+0000 7f2bfdffb640 1 -- 172.21.15.17:0/2324469311 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7f2bf809c910 con 0x7f2c00102ef0 2024-09-16T01:02:03.984 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:03.984 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:02:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:02:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 msgr2=0x7f2bf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 0x7f2bf00a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005ab0 tx=0x7f2bf4005a20 comp rx=0 tx=0).stop 2024-09-16T01:02:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 msgr2=0x7f2c0019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800eaa0 tx=0x7f2bf800ef60 comp rx=0 tx=0).stop 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 shutdown_connections 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f2bf00a32d0 0x7f2bf00a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c00102ef0 0x7f2c0019cc20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c00102570 0x7f2c00198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 --2- 172.21.15.17:0/2324469311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c00100e20 0x7f2c00198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 >> 172.21.15.17:0/2324469311 conn(0x7f2c000fc7d0 msgr2=0x7f2c00069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 shutdown_connections 2024-09-16T01:02:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:03.985+0000 7f2c06a89640 1 -- 172.21.15.17:0/2324469311 wait complete. 2024-09-16T01:02:04.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:02:04.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:04 smithi017 ceph-mon[31211]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:02:04.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:04 smithi017 ceph-mon[31211]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:02:04.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:04 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2324469311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:04 smithi088 ceph-mon[34093]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:02:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:04 smithi088 ceph-mon[34093]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:02:05.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:04 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2324469311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:04 smithi154 ceph-mon[34759]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-16T01:02:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:04 smithi154 ceph-mon[34759]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:02:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:04 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2324469311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 -- 172.21.15.17:0/3287916757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 msgr2=0x7f8c7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 --2- 172.21.15.17:0/3287916757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c1021c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009900 tx=0x7f8c6c02a410 comp rx=0 tx=0).stop 2024-09-16T01:02:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 -- 172.21.15.17:0/3287916757 shutdown_connections 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 --2- 172.21.15.17:0/3287916757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c106f10 0x7f8c7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 --2- 172.21.15.17:0/3287916757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c102790 0x7f8c7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 --2- 172.21.15.17:0/3287916757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c1021c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.426+0000 7f8c83115640 1 -- 172.21.15.17:0/3287916757 >> 172.21.15.17:0/3287916757 conn(0x7f8c7c0fd8c0 msgr2=0x7f8c7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 -- 172.21.15.17:0/3287916757 shutdown_connections 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 -- 172.21.15.17:0/3287916757 wait complete. 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 Processor -- start 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 -- start start 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c102790 0x7f8c7c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 0x7f8c7c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.427+0000 7f8c83115640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c111e40 con 0x7f8c7c101de0 2024-09-16T01:02:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c83115640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c111cc0 con 0x7f8c7c106f10 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c83115640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c111fc0 con 0x7f8c7c102790 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54890/0 (socket says 172.21.15.17:54890) 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 -- 172.21.15.17:0/3452356750 learned_addr learned my addr 172.21.15.17:0/3452356750 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c7bfff640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c102790 0x7f8c7c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c816b2640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 0x7f8c7c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 -- 172.21.15.17:0/3452356750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c102790 msgr2=0x7f8c7c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c102790 0x7f8c7c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 -- 172.21.15.17:0/3452356750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 msgr2=0x7f8c7c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 0x7f8c7c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 -- 172.21.15.17:0/3452356750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c19d2f0 con 0x7f8c7c101de0 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c816b2640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 0x7f8c7c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c80eb1640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006010 tx=0x7f8c6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c03f030 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c6c0035f0 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c19d580 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.428+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c035070 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.429+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c1a4ec0 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.430+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7c1021c0 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.431+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8c6c003b10 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.431+0000 7f8c79ffb640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 0x7f8c640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.431+0000 7f8c7bfff640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 0x7f8c640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.432+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8c6c0f03c0 con 0x7f8c7c101de0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.432+0000 7f8c7bfff640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 0x7f8c640a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0fdce0 tx=0x7f8c7000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.436+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c6c0bd0f0 con 0x7f8c7c101de0 2024-09-16T01:02:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.648+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c7c10a0f0 con 0x7f8c7c101de0 2024-09-16T01:02:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.648+0000 7f8c79ffb640 1 -- 172.21.15.17:0/3452356750 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11966 (secure 0 0 0) 0x7f8c6c0bc9f0 con 0x7f8c7c101de0 2024-09-16T01:02:05.650 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:05.650 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-16T01:00:40:505815+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:00:40.505799+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24482,24472,24503,24464]},"id":1}]} 2024-09-16T01:02:05.650 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-16T01:02:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 msgr2=0x7f8c640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 0x7f8c640a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0fdce0 tx=0x7f8c7000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 msgr2=0x7f8c7c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006010 tx=0x7f8c6c004270 comp rx=0 tx=0).stop 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 shutdown_connections 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f8c640a32c0 0x7f8c640a5780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7c106f10 0x7f8c7c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c7c102790 0x7f8c7c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 --2- 172.21.15.17:0/3452356750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c101de0 0x7f8c7c198340 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 >> 172.21.15.17:0/3452356750 conn(0x7f8c7c0fd8c0 msgr2=0x7f8c7c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 shutdown_connections 2024-09-16T01:02:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:05.651+0000 7f8c83115640 1 -- 172.21.15.17:0/3452356750 wait complete. 2024-09-16T01:02:05.967 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:05 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3452356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:05 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3452356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:05 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3452356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:02:06.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:02:06.668 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:06 smithi017 ceph-mon[31211]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-16T01:02:07.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:06 smithi088 ceph-mon[34093]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-16T01:02:07.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:06 smithi154 ceph-mon[34759]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 -- 172.21.15.17:0/2608898600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 msgr2=0x7f91c01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 --2- 172.21.15.17:0/2608898600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c01029b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009900 tx=0x7f91b002a480 comp rx=0 tx=0).stop 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 -- 172.21.15.17:0/2608898600 shutdown_connections 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 --2- 172.21.15.17:0/2608898600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0102ef0 0x7f91c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 --2- 172.21.15.17:0/2608898600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c01029b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 --2- 172.21.15.17:0/2608898600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0100e20 0x7f91c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 -- 172.21.15.17:0/2608898600 >> 172.21.15.17:0/2608898600 conn(0x7f91c00fc7d0 msgr2=0x7f91c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.179+0000 7f91c821e640 1 -- 172.21.15.17:0/2608898600 shutdown_connections 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 -- 172.21.15.17:0/2608898600 wait complete. 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 Processor -- start 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 -- start start 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 0x7f91c01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 0x7f91c019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0110e30 con 0x7f91c0102570 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0110cb0 con 0x7f91c0102ef0 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.180+0000 7f91c821e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0110fb0 con 0x7f91c0100e20 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54914/0 (socket says 172.21.15.17:54914) 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 -- 172.21.15.17:0/4209830632 learned_addr learned my addr 172.21.15.17:0/4209830632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c67bb640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 0x7f91c019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c5fba640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 0x7f91c01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 -- 172.21.15.17:0/4209830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 msgr2=0x7f91c01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 0x7f91c01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 -- 172.21.15.17:0/4209830632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 msgr2=0x7f91c019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 0x7f91c019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 -- 172.21.15.17:0/4209830632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c019d490 con 0x7f91c0102570 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c5fba640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 0x7f91c01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c67bb640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 0x7f91c019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91c57b9640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006010 tx=0x7f91b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.181+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b003f030 con 0x7f91c0102570 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.182+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c019d720 con 0x7f91c0102570 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.182+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91b0003cb0 con 0x7f91c0102570 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.182+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0035070 con 0x7f91c0102570 2024-09-16T01:02:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.182+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c01a5060 con 0x7f91c0102570 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.183+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c01021b0 con 0x7f91c0102570 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.184+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91b0042030 con 0x7f91c0102570 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.184+0000 7f91b6ffd640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 0x7f91ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.185+0000 7f91c5fba640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 0x7f91ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.185+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91b00efaf0 con 0x7f91c0102570 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.185+0000 7f91c5fba640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 0x7f91ac0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0058c0 tx=0x7f91bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.189+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91b00bc820 con 0x7f91c0102570 2024-09-16T01:02:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.365+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c010a0a0 con 0x7f91c0102570 2024-09-16T01:02:07.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.367+0000 7f91b6ffd640 1 -- 172.21.15.17:0/4209830632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22640 (secure 0 0 0) 0x7f91b00bc120 con 0x7f91c0102570 2024-09-16T01:02:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:02:07.369 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:01:34.675588+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:02:07.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 msgr2=0x7f91ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 0x7f91ac0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0058c0 tx=0x7f91bc005850 comp rx=0 tx=0).stop 2024-09-16T01:02:07.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 msgr2=0x7f91c0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:07.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006010 tx=0x7f91b00042f0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 shutdown_connections 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f91ac0a3240 0x7f91ac0a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c0102ef0 0x7f91c019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c0102570 0x7f91c0198a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 --2- 172.21.15.17:0/4209830632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0100e20 0x7f91c01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 >> 172.21.15.17:0/4209830632 conn(0x7f91c00fc7d0 msgr2=0x7f91c006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 shutdown_connections 2024-09-16T01:02:07.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:07.370+0000 7f91c821e640 1 -- 172.21.15.17:0/4209830632 wait complete. 2024-09-16T01:02:08.135 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:07 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4209830632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:02:08.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:07 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4209830632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:02:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:07 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4209830632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:02:08.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T01:00:29.073506+0000', 'modified': '2024-09-16T01:00:40.505799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24515, 'mds_1': 24503, 'mds_2': 24482, 'mds_3': 24472, 'mds_4': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14604': {'gid': 14604, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/2587837863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2587837863}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2587837863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/1776584751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 1776584751}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 1776584751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.88:6833/764220258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6832', 'nonce': 764220258}, {'type': 'v1', 'addr': '172.21.15.88:6833', 'nonce': 764220258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/3320793854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3320793854}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3320793854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/3615564777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 3615564777}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 3615564777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.88:6835/2889832205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 2889832205}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 2889832205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/1732406243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1732406243}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1732406243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.88:6837/51927101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 51927101}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 51927101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.17:6841/2275099611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 2275099611}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 2275099611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6839/2954076302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6838', 'nonce': 2954076302}, {'type': 'v1', 'addr': '172.21.15.88:6839', 'nonce': 2954076302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24515, 'qdb_cluster': [24515, 24482, 24472, 24503, 24464]} 2024-09-16T01:02:08.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-16T01:02:08.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.e status 2024-09-16T01:02:08.429 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:08.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:08 smithi017 ceph-mon[31211]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-16T01:02:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 -- 172.21.15.17:0/2227998699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408106f10 msgr2=0x7fd40810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/2227998699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408106f10 0x7fd40810ea90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd400009ca0 tx=0x7fd40002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 -- 172.21.15.17:0/2227998699 shutdown_connections 2024-09-16T01:02:08.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/2227998699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408106f10 0x7fd40810ea90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/2227998699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408102790 0x7fd4081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/2227998699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408101de0 0x7fd4081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 -- 172.21.15.17:0/2227998699 >> 172.21.15.17:0/2227998699 conn(0x7fd4080fd8c0 msgr2=0x7fd4080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 -- 172.21.15.17:0/2227998699 shutdown_connections 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.914+0000 7fd40c8ab640 1 -- 172.21.15.17:0/2227998699 wait complete. 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 Processor -- start 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 -- start start 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408101de0 0x7fd40819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 0x7fd40819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd408111e20 con 0x7fd408102790 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd408111ca0 con 0x7fd408101de0 2024-09-16T01:02:08.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd40c8ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd408111fa0 con 0x7fd408106f10 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54938/0 (socket says 172.21.15.17:54938) 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.915+0000 7fd3fffff640 1 -- 172.21.15.17:0/3493397896 learned_addr learned my addr 172.21.15.17:0/3493397896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd40659c640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408101de0 0x7fd40819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd406d9d640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 0x7fd40819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 -- 172.21.15.17:0/3493397896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 msgr2=0x7fd40819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 0x7fd40819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 -- 172.21.15.17:0/3493397896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408101de0 msgr2=0x7fd40819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408101de0 0x7fd40819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 -- 172.21.15.17:0/3493397896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40819f550 con 0x7fd408102790 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd406d9d640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 0x7fd40819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3fffff640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000e9f0 tx=0x7fd3f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3ff7fe640 1 -- 172.21.15.17:0/3493397896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000cd80 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3ff7fe640 1 -- 172.21.15.17:0/3493397896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3f00108e0 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd3ff7fe640 1 -- 172.21.15.17:0/3493397896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0018920 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40819f840 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.916+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4081a7120 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.918+0000 7fd3ff7fe640 1 -- 172.21.15.17:0/3493397896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd3f0010a90 con 0x7fd408102790 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 Processor -- start 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 -- start start 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558827628090 con 0x5588276c22f0 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5588275cfa70 con 0x5588276c19d0 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40ec84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558827624050 con 0x5588276ccbb0 2024-09-16T01:02:08.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54948/0 (socket says 172.21.15.17:54948) 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd40659c640 1 -- 172.21.15.17:0/184359878 learned_addr learned my addr 172.21.15.17:0/184359878 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd406d9d640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd3fffff640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.919+0000 7fd3ff7fe640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 0x7fd3f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 -- 172.21.15.17:0/184359878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 msgr2=0x5588276cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 -- 172.21.15.17:0/184359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 msgr2=0x5588276c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 -- 172.21.15.17:0/184359878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588275dc130 con 0x5588276c22f0 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd406d9d640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd406d9d640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 0x7fd3f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd3ff7fe640 1 -- 172.21.15.17:0/3493397896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3f00cfc40 con 0x7fd408102790 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd40659c640 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800bd10 tx=0x7fd3f80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e271742383527e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd3fcff9640 1 -- 172.21.15.17:0/184359878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8004030 con 0x5588276c22f0 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd406d9d640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 0x7fd3f40a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd400004af0 tx=0x7fd4000095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd3fcff9640 1 -- 172.21.15.17:0/184359878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3f80035f0 con 0x5588276c22f0 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.920+0000 7fd3fcff9640 1 -- 172.21.15.17:0/184359878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8011770 con 0x5588276c22f0 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- 172.21.15.17:0/184359878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 msgr2=0x5588276cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800bd10 tx=0x7fd3f80107a0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- 172.21.15.17:0/184359878 shutdown_connections 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276cc670 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 --2- 172.21.15.17:0/184359878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- 172.21.15.17:0/184359878 >> 172.21.15.17:0/184359878 conn(0x5588276bdf60 msgr2=0x5588276be340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- 172.21.15.17:0/184359878 shutdown_connections 2024-09-16T01:02:08.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- 172.21.15.17:0/184359878 wait complete. 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 -- start start 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.921+0000 7fd40ec84740 1 Processor -- start 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c22f0 0x5588276c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 0x5588276c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588276cf780 con 0x5588276c19d0 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5588275e2f20 con 0x5588276ccbb0 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5588276cf900 con 0x5588276c22f0 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40ec84740 10 client.0 _ll_register_callbacks cb 0x5588275ac030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54954/0 (socket says 172.21.15.17:54954) 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 -- 172.21.15.17:0/462952636 learned_addr learned my addr 172.21.15.17:0/462952636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd406d9d640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 0x5588276c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 -- 172.21.15.17:0/462952636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c22f0 msgr2=0x5588276c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd3fffff640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c22f0 0x5588276c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c22f0 0x5588276c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 -- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 msgr2=0x5588276c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 0x5588276c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 -- 172.21.15.17:0/462952636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588273992b0 con 0x5588276c19d0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd406d9d640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 0x5588276c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd40659c640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8005d00 tx=0x7fd3f8003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6931a588d03af8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd3edffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.922+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8029060 con 0x5588276c19d0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3f80039b0 con 0x5588276c19d0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f80035f0 con 0x5588276c19d0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd3f8003fc0 con 0x5588276c19d0 2024-09-16T01:02:08.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5588276db070 con 0x5588276c19d0 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3f80035f0 con 0x5588276c19d0 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd3f80046c0 con 0x5588276c19d0 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 10 client.15123 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 20 client.15123 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x5588276dd310 0x5588276de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 4 client.15123 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.923+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 --> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558827635600 con 0x5588276dd310 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.924+0000 7fd3fffff640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x5588276dd310 0x5588276de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.924+0000 7fd3edffb640 10 client.15123 ms_handle_connect on v2:172.21.15.88:6834/2889832205 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.924+0000 7fd3fffff640 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x5588276dd310 0x5588276de780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8fea9011a188f8b9 server_cookie=7330d210c79d2a51 in_seq=0 out_seq=0 2024-09-16T01:02:08.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd3edffb640 1 -- 172.21.15.17:0/462952636 <== mds.4 v2:172.21.15.88:6834/2889832205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558827635600 con 0x5588276dd310 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd3edffb640 10 client.15123 handle_command_reply: tid=0 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 client.15123 shutdown 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 msgr2=0x5588276cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8005d00 tx=0x7fd3f8003df0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 shutdown_connections 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x5588276dd310 0x5588276de780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276ccbb0 0x5588276c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c22f0 0x5588276c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd3edffb640 0 client.15123 ms_handle_reset on v2:172.21.15.88:6834/2889832205 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 --2- 172.21.15.17:0/462952636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c19d0 0x5588276cc420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 >> 172.21.15.17:0/462952636 conn(0x5588276bdf60 msgr2=0x5588276c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 shutdown_connections 2024-09-16T01:02:08.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 1 -- 172.21.15.17:0/462952636 wait complete. 2024-09-16T01:02:08.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.925+0000 7fd40ec84740 20 client.15123 trim_cache size 0 max 16384 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 Processor -- start 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 -- start start 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 0x5588276de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c22f0 0x5588276be340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588276dcac0 con 0x5588276ccbb0 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5588276dd190 con 0x5588276c22f0 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd40ec84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5588276dd860 con 0x5588276c19d0 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54958/0 (socket says 172.21.15.17:54958) 2024-09-16T01:02:08.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.944+0000 7fd406d9d640 1 -- 172.21.15.17:0/4096954981 learned_addr learned my addr 172.21.15.17:0/4096954981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd3fffff640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c22f0 0x5588276be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd40659c640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 0x5588276de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 -- 172.21.15.17:0/4096954981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 msgr2=0x5588276de780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 0x5588276de780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 -- 172.21.15.17:0/4096954981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c22f0 msgr2=0x5588276be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c22f0 0x5588276be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 -- 172.21.15.17:0/4096954981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588276cc790 con 0x5588276ccbb0 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd40659c640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 0x5588276de780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd406d9d640 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd400031ec0 tx=0x7fd400040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260b6473d3b2ce35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd3effff640 1 -- 172.21.15.17:0/4096954981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400052070 con 0x5588276ccbb0 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd3effff640 1 -- 172.21.15.17:0/4096954981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd400036040 con 0x5588276ccbb0 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.945+0000 7fd3effff640 1 -- 172.21.15.17:0/4096954981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400030ad0 con 0x5588276ccbb0 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- 172.21.15.17:0/4096954981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 msgr2=0x5588276c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd400031ec0 tx=0x7fd400040000 comp rx=0 tx=0).stop 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- 172.21.15.17:0/4096954981 shutdown_connections 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276ccbb0 0x5588276c69d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c22f0 0x5588276be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 --2- 172.21.15.17:0/4096954981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276c19d0 0x5588276de780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- 172.21.15.17:0/4096954981 >> 172.21.15.17:0/4096954981 conn(0x5588276bdf60 msgr2=0x5588276c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- 172.21.15.17:0/4096954981 shutdown_connections 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- 172.21.15.17:0/4096954981 wait complete. 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.946+0000 7fd40ec84740 1 -- start start 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 Processor -- start 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276e0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588276de600 con 0x5588276c22f0 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5588276ddf30 con 0x5588276c19d0 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5588276decd0 con 0x5588276ccbb0 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40ec84740 10 client.0 _ll_register_callbacks cb 0x7fd3f0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:08.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54960/0 (socket says 172.21.15.17:54960) 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd3fffff640 1 -- 172.21.15.17:0/842261684 learned_addr learned my addr 172.21.15.17:0/842261684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd40659c640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd406d9d640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.947+0000 7fd3fffff640 1 -- 172.21.15.17:0/842261684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 msgr2=0x5588276e0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3fffff640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276e0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3fffff640 1 -- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 msgr2=0x5588276e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3fffff640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3fffff640 1 -- 172.21.15.17:0/842261684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588276e0cb0 con 0x5588276c22f0 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd40659c640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd406d9d640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3fffff640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3f009c200 tx=0x7fd3f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a8cc90d77ac5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:08.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f009c270 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3f00988e0 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd400036040 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd3f00a0620 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd40ec84740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5588276e5790 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd400036040 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.948+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd3f00a0120 con 0x5588276c22f0 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 10 client.15129 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 20 client.15129 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x55882774c320 0x55882774b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 4 client.15129 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:02:08.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 --> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] -- command(tid 0: {"prefix": "status"}) -- 0x55882762fb10 con 0x55882774c320 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40659c640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x55882774c320 0x55882774b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40659c640 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x55882774c320 0x55882774b030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8b8451f90a3477a1 server_cookie=8481956b9ced8709 in_seq=0 out_seq=0 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd3edffb640 10 client.15129 ms_handle_connect on v2:172.21.15.88:6834/2889832205 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd3edffb640 1 -- 172.21.15.17:0/842261684 <== mds.4 v2:172.21.15.88:6834/2889832205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55882762fb10 con 0x55882774c320 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd3edffb640 10 client.15129 handle_command_reply: tid=0 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.949+0000 7fd40ec84740 1 client.15129 shutdown 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 msgr2=0x5588276e0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3f009c200 tx=0x7fd3f0000bc0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 shutdown_connections 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:6834/2889832205,v1:172.21.15.88:6835/2889832205] conn(0x55882774c320 0x55882774b030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588276ccbb0 0x5588276e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd3edffb640 0 client.15129 ms_handle_reset on v2:172.21.15.88:6834/2889832205 2024-09-16T01:02:08.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588276c22f0 0x5588276e0230 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 --2- 172.21.15.17:0/842261684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5588276c19d0 0x5588276e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 >> 172.21.15.17:0/842261684 conn(0x5588276bdf60 msgr2=0x5588276cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 shutdown_connections 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 1 -- 172.21.15.17:0/842261684 wait complete. 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.950+0000 7fd40ec84740 20 client.15129 trim_cache size 0 max 16384 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-09-16T01:02:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24464, 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 89.450561199000006, 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 129.42830457599999 2024-09-16T01:02:08.963 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 msgr2=0x7fd3f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 0x7fd3f40a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd400004af0 tx=0x7fd4000095c0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 msgr2=0x7fd40819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000e9f0 tx=0x7fd3f000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 shutdown_connections 2024-09-16T01:02:08.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fd3f40a3240 0x7fd3f40a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd408106f10 0x7fd40819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd408102790 0x7fd40819aae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 --2- 172.21.15.17:0/3493397896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd408101de0 0x7fd40819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 >> 172.21.15.17:0/3493397896 conn(0x7fd4080fd8c0 msgr2=0x7fd4080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 shutdown_connections 2024-09-16T01:02:08.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:08.951+0000 7fd40c8ab640 1 -- 172.21.15.17:0/3493397896 wait complete. 2024-09-16T01:02:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:08 smithi088 ceph-mon[34093]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-16T01:02:09.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:08 smithi154 ceph-mon[34759]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-16T01:02:09.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:02:09.896 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:10.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 -- 172.21.15.17:0/2827985819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 msgr2=0x7fdc9c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 --2- 172.21.15.17:0/2827985819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c100ee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009930 tx=0x7fdc9002a420 comp rx=0 tx=0).stop 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 -- 172.21.15.17:0/2827985819 shutdown_connections 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 --2- 172.21.15.17:0/2827985819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 0x7fdc9c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 --2- 172.21.15.17:0/2827985819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c100ee0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 --2- 172.21.15.17:0/2827985819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 -- 172.21.15.17:0/2827985819 >> 172.21.15.17:0/2827985819 conn(0x7fdc9c0fc7a0 msgr2=0x7fdc9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 -- 172.21.15.17:0/2827985819 shutdown_connections 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.379+0000 7fdca250c640 1 -- 172.21.15.17:0/2827985819 wait complete. 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 Processor -- start 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 -- start start 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 0x7fdc9c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c110d50 con 0x7fdc9c100a80 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c110bd0 con 0x7fdc9c106a80 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca250c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c110ed0 con 0x7fdc9c101420 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54976/0 (socket says 172.21.15.17:54976) 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 -- 172.21.15.17:0/847929602 learned_addr learned my addr 172.21.15.17:0/847929602 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 0x7fdc9c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 -- 172.21.15.17:0/847929602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 msgr2=0x7fdc9c197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 0x7fdc9c197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 -- 172.21.15.17:0/847929602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 msgr2=0x7fdc9c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdc9bfff640 1 -- 172.21.15.17:0/847929602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c19c2e0 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.380+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d950 tx=0x7fdc8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdc997fa640 1 -- 172.21.15.17:0/847929602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c017070 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdc997fa640 1 -- 172.21.15.17:0/847929602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc8c009c30 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c19c5d0 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdc997fa640 1 -- 172.21.15.17:0/847929602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00f620 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.381+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1a3eb0 con 0x7fdc9c100a80 2024-09-16T01:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.383+0000 7fdc997fa640 1 -- 172.21.15.17:0/847929602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc8c0109a0 con 0x7fdc9c100a80 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.383+0000 7fdca48e5740 1 Processor -- start 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.383+0000 7fdca48e5740 1 -- start start 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a2190 0x55fd5a2ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a208090 con 0x55fd5a2aedc0 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a1afa70 con 0x55fd5a2a2190 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca48e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a204050 con 0x55fd5a2a1870 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc997fa640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 0x7fdc840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54984/0 (socket says 172.21.15.17:54984) 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3470906415 learned_addr learned my addr 172.21.15.17:0/3470906415 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a2190 0x55fd5a2ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 0x7fdc840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3470906415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 msgr2=0x55fd5a2a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3470906415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a2190 msgr2=0x55fd5a2ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a2190 0x55fd5a2ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3470906415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5a1bc130 con 0x55fd5a2aedc0 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc997fa640 1 -- 172.21.15.17:0/847929602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc8c0cf570 con 0x7fdc9c100a80 2024-09-16T01:02:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.384+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009930 tx=0x7fdc90032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7c3a14cda1e7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 0x7fdc840a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009440 tx=0x7fdc940093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdc827fc640 1 -- 172.21.15.17:0/3470906415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9003f070 con 0x55fd5a2aedc0 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdc827fc640 1 -- 172.21.15.17:0/3470906415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc900316a0 con 0x55fd5a2aedc0 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdc827fc640 1 -- 172.21.15.17:0/3470906415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90035070 con 0x55fd5a2aedc0 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 -- 172.21.15.17:0/3470906415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 msgr2=0x55fd5a2b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009930 tx=0x7fdc90032cc0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 -- 172.21.15.17:0/3470906415 shutdown_connections 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2b11b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a2190 0x55fd5a2ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3470906415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 -- 172.21.15.17:0/3470906415 >> 172.21.15.17:0/3470906415 conn(0x55fd5a29df60 msgr2=0x55fd5a29e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.385+0000 7fdca48e5740 1 -- 172.21.15.17:0/3470906415 shutdown_connections 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 -- 172.21.15.17:0/3470906415 wait complete. 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 -- start start 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 Processor -- start 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2abf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2b1990 con 0x55fd5a2a2190 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a1c2f20 con 0x55fd5a2aedc0 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2b1b10 con 0x55fd5a2a1870 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdca48e5740 10 client.0 _ll_register_callbacks cb 0x55fd5a18c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54990/0 (socket says 172.21.15.17:54990) 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.386+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3609496698 learned_addr learned my addr 172.21.15.17:0/3609496698 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 msgr2=0x55fd5a2ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3609496698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 msgr2=0x55fd5a2abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3609496698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd59f792b0 con 0x55fd5a2a2190 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc9002a940 tx=0x7fdc900314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74162fd0e917102 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9004a020 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc900035f0 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc900316a0 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc9003f070 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdca48e5740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.387+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd5a2bd340 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc900316a0 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdc9003b870 con 0x55fd5a2a2190 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 20 client.15141 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a2bf490 0x55fd5a2c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 4 client.15141 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 --> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd5a215600 con 0x55fd5a2bf490 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a2bf490 0x55fd5a2c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdc7b7fe640 10 client.15141 ms_handle_connect on v2:172.21.15.154:6838/1732406243 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.388+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a2bf490 0x55fd5a2c0900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f30321dcd954f6 server_cookie=880e86b443236322 in_seq=0 out_seq=0 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3609496698 <== mds.3 v2:172.21.15.154:6838/1732406243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd5a215600 con 0x55fd5a2bf490 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdc7b7fe640 10 client.15141 handle_command_reply: tid=0 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 client.15141 shutdown 2024-09-16T01:02:10.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 msgr2=0x55fd5a2aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc9002a940 tx=0x7fdc900314a0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 shutdown_connections 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a2bf490 0x55fd5a2c0900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2aba00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3609496698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdc7b7fe640 0 client.15141 ms_handle_reset on v2:172.21.15.154:6838/1732406243 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.389+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 >> 172.21.15.17:0/3609496698 conn(0x55fd5a29df60 msgr2=0x55fd5a2a3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.390+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 shutdown_connections 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.390+0000 7fdca48e5740 1 -- 172.21.15.17:0/3609496698 wait complete. 2024-09-16T01:02:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.390+0000 7fdca48e5740 20 client.15141 trim_cache size 0 max 16384 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 Processor -- start 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 -- start start 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.408+0000 7fdca48e5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2bec40 con 0x55fd5a2a2190 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdca48e5740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2bf310 con 0x55fd5a2aedc0 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdca48e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2bf9e0 con 0x55fd5a2a1870 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55002/0 (socket says 172.21.15.17:55002) 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/354251682 learned_addr learned my addr 172.21.15.17:0/354251682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/354251682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 msgr2=0x55fd5a2bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/354251682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 msgr2=0x55fd5a2a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/354251682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5a2a1fc0 con 0x55fd5a2a2190 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003e040 tx=0x7fdc9002aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1206d994b89f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc81ffb640 1 -- 172.21.15.17:0/354251682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9004a070 con 0x55fd5a2a2190 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc81ffb640 1 -- 172.21.15.17:0/354251682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc900042d0 con 0x55fd5a2a2190 2024-09-16T01:02:10.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.409+0000 7fdc81ffb640 1 -- 172.21.15.17:0/354251682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90035040 con 0x55fd5a2a2190 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 -- 172.21.15.17:0/354251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 msgr2=0x55fd5a2a6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003e040 tx=0x7fdc9002aa60 comp rx=0 tx=0).stop 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 -- 172.21.15.17:0/354251682 shutdown_connections 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2aedc0 0x55fd5a2a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2a6f30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 --2- 172.21.15.17:0/354251682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2a1870 0x55fd5a2bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 -- 172.21.15.17:0/354251682 >> 172.21.15.17:0/354251682 conn(0x55fd5a29df60 msgr2=0x55fd5a2a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 -- 172.21.15.17:0/354251682 shutdown_connections 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.410+0000 7fdca48e5740 1 -- 172.21.15.17:0/354251682 wait complete. 2024-09-16T01:02:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 -- start start 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 Processor -- start 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a1870 0x55fd5a2c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2aedc0 0x55fd5a327b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2c0780 con 0x55fd5a2a2190 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2c00b0 con 0x55fd5a2a1870 2024-09-16T01:02:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd5a2c0e50 con 0x55fd5a2aedc0 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca48e5740 10 client.0 _ll_register_callbacks cb 0x7fdc8c09b970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55016/0 (socket says 172.21.15.17:55016) 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3254070277 learned_addr learned my addr 172.21.15.17:0/3254070277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a1870 0x55fd5a2c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdca0aa9640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2aedc0 0x55fd5a327b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2aedc0 msgr2=0x55fd5a327b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2aedc0 0x55fd5a327b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3254070277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a1870 msgr2=0x55fd5a2c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.411+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a1870 0x55fd5a2c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc9b7fe640 1 -- 172.21.15.17:0/3254070277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5a328150 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc9b7fe640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003bde0 tx=0x7fdc9003bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6173f79284d30c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9004a070 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc900042d0 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdc90031c70 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc90035040 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdca48e5740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd5a329450 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc900042d0 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdc90058040 con 0x55fd5a2a2190 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.412+0000 7fdca48e5740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdca48e5740 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdca48e5740 20 client.15147 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a32db10 0x55fd5a32c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdca48e5740 4 client.15147 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 --> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] -- command(tid 0: {"prefix": "status"}) -- 0x55fd5a20fb10 con 0x55fd5a32db10 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a32db10 0x55fd5a32c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdc9bfff640 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a32db10 0x55fd5a32c820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d92b89e30e2873de server_cookie=1ace1d13b87600ee in_seq=0 out_seq=0 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.413+0000 7fdc7b7fe640 10 client.15147 ms_handle_connect on v2:172.21.15.154:6838/1732406243 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdc7b7fe640 1 -- 172.21.15.17:0/3254070277 <== mds.3 v2:172.21.15.154:6838/1732406243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fd5a20fb10 con 0x55fd5a32db10 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdc7b7fe640 10 client.15147 handle_command_reply: tid=0 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 client.15147 shutdown 2024-09-16T01:02:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 msgr2=0x55fd5a2c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003bde0 tx=0x7fdc9003bba0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 shutdown_connections 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:6838/1732406243,v1:172.21.15.154:6839/1732406243] conn(0x55fd5a32db10 0x55fd5a32c820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdc7b7fe640 0 client.15147 ms_handle_reset on v2:172.21.15.154:6838/1732406243 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd5a2aedc0 0x55fd5a327b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd5a2a2190 0x55fd5a2c25a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 --2- 172.21.15.17:0/3254070277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fd5a2a1870 0x55fd5a2c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 >> 172.21.15.17:0/3254070277 conn(0x55fd5a29df60 msgr2=0x55fd5a2a7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 shutdown_connections 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 1 -- 172.21.15.17:0/3254070277 wait complete. 2024-09-16T01:02:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.414+0000 7fdca48e5740 20 client.15147 trim_cache size 0 max 16384 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24472, 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 91.920938884999998, 2024-09-16T01:02:10.423 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:02:10.424 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:02:10.424 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:02:10.424 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 120.75075517000001 2024-09-16T01:02:10.424 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 msgr2=0x7fdc840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 0x7fdc840a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009440 tx=0x7fdc940093d0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 msgr2=0x7fdc9c197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00d950 tx=0x7fdc8c00de10 comp rx=0 tx=0).stop 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 shutdown_connections 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fdc840a32c0 0x7fdc840a5780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc9c106a80 0x7fdc9c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc9c101420 0x7fdc9c197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 --2- 172.21.15.17:0/847929602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc9c100a80 0x7fdc9c197330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:10.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 >> 172.21.15.17:0/847929602 conn(0x7fdc9c0fc7a0 msgr2=0x7fdc9c0fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:10.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 shutdown_connections 2024-09-16T01:02:10.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:10.415+0000 7fdca250c640 1 -- 172.21.15.17:0/847929602 wait complete. 2024-09-16T01:02:11.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:10 smithi017 ceph-mon[31211]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:11.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-16T01:02:11.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:10 smithi088 ceph-mon[34093]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:11.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:10 smithi154 ceph-mon[34759]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:11.394 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 -- 172.21.15.17:0/3187393471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1188102d40 msgr2=0x7f1188103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 --2- 172.21.15.17:0/3187393471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1188102d40 0x7f1188103120 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1178009900 tx=0x7f117802a480 comp rx=0 tx=0).stop 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 -- 172.21.15.17:0/3187393471 shutdown_connections 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 --2- 172.21.15.17:0/3187393471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f118810c170 0x7f118810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 --2- 172.21.15.17:0/3187393471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188103660 0x7f118810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 --2- 172.21.15.17:0/3187393471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1188102d40 0x7f1188103120 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 -- 172.21.15.17:0/3187393471 >> 172.21.15.17:0/3187393471 conn(0x7f11880fc7a0 msgr2=0x7f11880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 -- 172.21.15.17:0/3187393471 shutdown_connections 2024-09-16T01:02:11.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.864+0000 7f118dec7640 1 -- 172.21.15.17:0/3187393471 wait complete. 2024-09-16T01:02:11.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 Processor -- start 2024-09-16T01:02:11.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 -- start start 2024-09-16T01:02:11.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188102d40 0x7f118819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1188103660 0x7f118819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1188111e60 con 0x7f118810c170 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1188111ce0 con 0x7f1188103660 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f118dec7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1188111fe0 con 0x7f1188102d40 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f1187fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f1187fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59654/0 (socket says 172.21.15.17:59654) 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.865+0000 7f1187fff640 1 -- 172.21.15.17:0/752659370 learned_addr learned my addr 172.21.15.17:0/752659370 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1186ffd640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1188103660 0x7f118819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f11877fe640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188102d40 0x7f118819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 -- 172.21.15.17:0/752659370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188102d40 msgr2=0x7f118819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188102d40 0x7f118819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 -- 172.21.15.17:0/752659370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1188103660 msgr2=0x7f118819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1188103660 0x7f118819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 -- 172.21.15.17:0/752659370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118819f5d0 con 0x7f118810c170 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1187fff640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f118000cad0 tx=0x7f118000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1184ff9640 1 -- 172.21.15.17:0/752659370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118000ae20 con 0x7f118810c170 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1184ff9640 1 -- 172.21.15.17:0/752659370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1180005020 con 0x7f118810c170 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118819f8c0 con 0x7f118810c170 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f1184ff9640 1 -- 172.21.15.17:0/752659370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118000f6b0 con 0x7f118810c170 2024-09-16T01:02:11.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.866+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11881a71a0 con 0x7f118810c170 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 Processor -- start 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f1184ff9640 1 -- 172.21.15.17:0/752659370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f118000f850 con 0x7f118810c170 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 -- start start 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c30eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3054090 con 0x55a9c30f8bb0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a9c2ffba70 con 0x55a9c30ed9d0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11902a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3050050 con 0x55a9c30ee2f0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59666/0 (socket says 172.21.15.17:59666) 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f1186ffd640 1 -- 172.21.15.17:0/3874809111 learned_addr learned my addr 172.21.15.17:0/3874809111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c30eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.869+0000 7f11877fe640 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1184ff9640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 0x7f11700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 -- 172.21.15.17:0/3874809111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 msgr2=0x55a9c30f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 -- 172.21.15.17:0/3874809111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 msgr2=0x55a9c30eddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c30eddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 -- 172.21.15.17:0/3874809111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c3008130 con 0x55a9c30f8bb0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1187fff640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 0x7f11700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f117c006aa0 tx=0x7f117c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1354b517ef6855 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f1184ff9640 1 -- 172.21.15.17:0/752659370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f11800cf9c0 con 0x7f118810c170 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f116dffb640 1 -- 172.21.15.17:0/3874809111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c015760 con 0x55a9c30f8bb0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f116dffb640 1 -- 172.21.15.17:0/3874809111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f117c01d070 con 0x55a9c30f8bb0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.870+0000 7f116dffb640 1 -- 172.21.15.17:0/3874809111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c018a20 con 0x55a9c30f8bb0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- 172.21.15.17:0/3874809111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 msgr2=0x55a9c30fafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f1187fff640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 0x7f11700a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f118000caa0 tx=0x7f1180047040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f117c006aa0 tx=0x7f117c009500 comp rx=0 tx=0).stop 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- 172.21.15.17:0/3874809111 shutdown_connections 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30fafa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 --2- 172.21.15.17:0/3874809111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c30eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- 172.21.15.17:0/3874809111 >> 172.21.15.17:0/3874809111 conn(0x55a9c30e9f60 msgr2=0x55a9c30ea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- 172.21.15.17:0/3874809111 shutdown_connections 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- 172.21.15.17:0/3874809111 wait complete. 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 -- start start 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.871+0000 7f11902a0740 1 Processor -- start 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a9c30fb780 con 0x55a9c30ed9d0 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a9c300ef20 con 0x55a9c30f8bb0 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a9c30fb900 con 0x55a9c30ee2f0 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11902a0740 10 client.0 _ll_register_callbacks cb 0x55a9c2fd8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59672/0 (socket says 172.21.15.17:59672) 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 -- 172.21.15.17:0/1490657318 learned_addr learned my addr 172.21.15.17:0/1490657318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11877fe640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 -- 172.21.15.17:0/1490657318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 msgr2=0x55a9c30f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 -- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 msgr2=0x55a9c30f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 -- 172.21.15.17:0/1490657318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c2dc52b0 con 0x55a9c30ed9d0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f11877fe640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1186ffd640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f117c006b90 tx=0x7f117c009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f437a77712eeb8a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.872+0000 7f1166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c026020 con 0x55a9c30ed9d0 2024-09-16T01:02:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f117c015d70 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117c01d070 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f117c018450 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 10 client.15159 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9c3107100 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f117c01d070 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f117c022810 con 0x55a9c30ed9d0 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 10 client.15159 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 10 client.15159 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 20 client.15159 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c3109280 0x55a9c310a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 4 client.15159 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.873+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 --> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9c3061600 con 0x55a9c3109280 2024-09-16T01:02:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.874+0000 7f11877fe640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c3109280 0x55a9c310a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.874+0000 7f11877fe640 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c3109280 0x55a9c310a6f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6852d8528cde5a0 server_cookie=fbc73e39bc737f2a in_seq=0 out_seq=0 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.874+0000 7f1166ffd640 10 client.15159 ms_handle_connect on v2:172.21.15.88:6836/51927101 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f1166ffd640 1 -- 172.21.15.17:0/1490657318 <== mds.2 v2:172.21.15.88:6836/51927101 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9c3061600 con 0x55a9c3109280 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f1166ffd640 10 client.15159 handle_command_reply: tid=0 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 client.15159 shutdown 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 msgr2=0x55a9c30f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f117c006b90 tx=0x7f117c009d60 comp rx=0 tx=0).stop 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 shutdown_connections 2024-09-16T01:02:11.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c3109280 0x55a9c310a6f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 --2- 172.21.15.17:0/1490657318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c30f84c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 >> 172.21.15.17:0/1490657318 conn(0x55a9c30e9f60 msgr2=0x55a9c30efc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f1166ffd640 0 client.15159 ms_handle_reset on v2:172.21.15.88:6836/51927101 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 shutdown_connections 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 1 -- 172.21.15.17:0/1490657318 wait complete. 2024-09-16T01:02:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.875+0000 7f11902a0740 20 client.15159 trim_cache size 0 max 16384 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 Processor -- start 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 -- start start 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c310a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3108a30 con 0x55a9c30f8bb0 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3109100 con 0x55a9c30ed9d0 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f11902a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a9c31097d0 con 0x55a9c30ee2f0 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.893+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59684/0 (socket says 172.21.15.17:59684) 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 -- 172.21.15.17:0/3207741173 learned_addr learned my addr 172.21.15.17:0/3207741173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:11.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c310a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f11877fe640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 -- 172.21.15.17:0/3207741173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 msgr2=0x55a9c30f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 -- 172.21.15.17:0/3207741173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 msgr2=0x55a9c310a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c310a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 -- 172.21.15.17:0/3207741173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c30f80e0 con 0x55a9c30f8bb0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f11877fe640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f1186ffd640 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f117c006fd0 tx=0x7f117c017510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d544dce4e2f47472 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f116d7fa640 1 -- 172.21.15.17:0/3207741173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c026040 con 0x55a9c30f8bb0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f116d7fa640 1 -- 172.21.15.17:0/3207741173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f117c01d030 con 0x55a9c30f8bb0 2024-09-16T01:02:11.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.894+0000 7f116d7fa640 1 -- 172.21.15.17:0/3207741173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c0189d0 con 0x55a9c30f8bb0 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- 172.21.15.17:0/3207741173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 msgr2=0x55a9c30f0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f117c006fd0 tx=0x7f117c017510 comp rx=0 tx=0).stop 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- 172.21.15.17:0/3207741173 shutdown_connections 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30f8bb0 0x55a9c30f0cd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c30f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 --2- 172.21.15.17:0/3207741173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30ed9d0 0x55a9c310a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- 172.21.15.17:0/3207741173 >> 172.21.15.17:0/3207741173 conn(0x55a9c30e9f60 msgr2=0x55a9c30f05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- 172.21.15.17:0/3207741173 shutdown_connections 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- 172.21.15.17:0/3207741173 wait complete. 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 -- start start 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.895+0000 7f11902a0740 1 Processor -- start 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c310c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c3171980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a9c310a570 con 0x55a9c30ed9d0 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3109ea0 con 0x55a9c30f8bb0 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a9c310ac40 con 0x55a9c30ee2f0 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11902a0740 10 client.0 _ll_register_callbacks cb 0x7f117c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59698/0 (socket says 172.21.15.17:59698) 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 -- 172.21.15.17:0/544819969 learned_addr learned my addr 172.21.15.17:0/544819969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11877fe640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c310c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c3171980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 -- 172.21.15.17:0/544819969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 msgr2=0x55a9c310c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c310c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 -- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 msgr2=0x55a9c3171980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c3171980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 -- 172.21.15.17:0/544819969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c3171ec0 con 0x55a9c30ed9d0 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f11877fe640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c310c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1186ffd640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f117c004810 tx=0x7f117c009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61a56dd1e140175 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.896+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c03d070 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117c01d030 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f117c0229c0 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f117c026040 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9c31730d0 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f117c01d030 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f117c016970 con 0x55a9c30ed9d0 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 10 client.15165 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 20 client.15165 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c31779a0 0x55a9c31766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 4 client.15165 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 --> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] -- command(tid 0: {"prefix": "status"}) -- 0x55a9c305bb10 con 0x55a9c31779a0 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.897+0000 7f11877fe640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c31779a0 0x55a9c31766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11877fe640 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c31779a0 0x55a9c31766b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=96fbb48a722775f3 server_cookie=5759a75ba08f9325 in_seq=0 out_seq=0 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f1166ffd640 10 client.15165 ms_handle_connect on v2:172.21.15.88:6836/51927101 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f1166ffd640 1 -- 172.21.15.17:0/544819969 <== mds.2 v2:172.21.15.88:6836/51927101 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a9c305bb10 con 0x55a9c31779a0 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f1166ffd640 10 client.15165 handle_command_reply: tid=0 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 client.15165 shutdown 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 msgr2=0x55a9c310be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f117c004810 tx=0x7f117c009d60 comp rx=0 tx=0).stop 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 shutdown_connections 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:6836/51927101,v1:172.21.15.88:6837/51927101] conn(0x55a9c31779a0 0x55a9c31766b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a9c30f8bb0 0x55a9c3171980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9c30ee2f0 0x55a9c310c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 --2- 172.21.15.17:0/544819969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a9c30ed9d0 0x55a9c310be10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 >> 172.21.15.17:0/544819969 conn(0x55a9c30e9f60 msgr2=0x55a9c30f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.898+0000 7f1166ffd640 0 client.15165 ms_handle_reset on v2:172.21.15.88:6836/51927101 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 shutdown_connections 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f11902a0740 1 -- 172.21.15.17:0/544819969 wait complete. 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f11902a0740 20 client.15165 trim_cache size 0 max 16384 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-16T01:02:11.906 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24482, 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.416263478000005, 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 124.679430462 2024-09-16T01:02:11.907 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 msgr2=0x7f11700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 0x7f11700a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f118000caa0 tx=0x7f1180047040 comp rx=0 tx=0).stop 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 msgr2=0x7f118819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f118000cad0 tx=0x7f118000cf90 comp rx=0 tx=0).stop 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 shutdown_connections 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f11700a3240 0x7f11700a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f118810c170 0x7f118819eef0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1188103660 0x7f118819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 --2- 172.21.15.17:0/752659370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1188102d40 0x7f118819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 >> 172.21.15.17:0/752659370 conn(0x7f11880fc7a0 msgr2=0x7f1188101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 shutdown_connections 2024-09-16T01:02:11.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:11.899+0000 7f118dec7640 1 -- 172.21.15.17:0/752659370 wait complete. 2024-09-16T01:02:12.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-16T01:02:12.924 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:12 smithi017 ceph-mon[31211]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:02:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:12 smithi088 ceph-mon[34093]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:02:13.156 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:12 smithi154 ceph-mon[34759]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-16T01:02:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 -- 172.21.15.17:0/4098491355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 msgr2=0x7f6668110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 --2- 172.21.15.17:0/4098491355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f6668110810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6660009ca0 tx=0x7f666002a950 comp rx=0 tx=0).stop 2024-09-16T01:02:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 -- 172.21.15.17:0/4098491355 shutdown_connections 2024-09-16T01:02:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 --2- 172.21.15.17:0/4098491355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f6668110810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 --2- 172.21.15.17:0/4098491355 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6668074ee0 0x7f666810dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 --2- 172.21.15.17:0/4098491355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66680745c0 0x7f66680749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 -- 172.21.15.17:0/4098491355 >> 172.21.15.17:0/4098491355 conn(0x7f66680fd8c0 msgr2=0x7f66680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 -- 172.21.15.17:0/4098491355 shutdown_connections 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.382+0000 7f666d454640 1 -- 172.21.15.17:0/4098491355 wait complete. 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 Processor -- start 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 -- start start 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66680745c0 0x7f666819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 0x7f666819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6668114000 con 0x7f666810e420 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6668113e80 con 0x7f66680745c0 2024-09-16T01:02:13.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f666d454640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6668114180 con 0x7f6668074ee0 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f66677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f66677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59722/0 (socket says 172.21.15.17:59722) 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f66677fe640 1 -- 172.21.15.17:0/3690768809 learned_addr learned my addr 172.21.15.17:0/3690768809 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f6666ffd640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66680745c0 0x7f666819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.383+0000 7f665ffff640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 0x7f666819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 -- 172.21.15.17:0/3690768809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 msgr2=0x7f666819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 0x7f666819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 -- 172.21.15.17:0/3690768809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66680745c0 msgr2=0x7f666819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66680745c0 0x7f666819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 -- 172.21.15.17:0/3690768809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666819f530 con 0x7f666810e420 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f665ffff640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 0x7f666819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f66677fe640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f666002ae70 tx=0x7f666002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f6664ff9640 1 -- 172.21.15.17:0/3690768809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660034040 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f6664ff9640 1 -- 172.21.15.17:0/3690768809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66600308f0 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666819f7c0 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f6664ff9640 1 -- 172.21.15.17:0/3690768809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66600047c0 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.384+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681a7100 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.386+0000 7f6664ff9640 1 -- 172.21.15.17:0/3690768809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6660037020 con 0x7f666810e420 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 Processor -- start 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 -- start start 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e79d0 0x55ea332e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e82f0 0x55ea332f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea3324e090 con 0x55ea332f2bb0 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea331f5a70 con 0x55ea332e79d0 2024-09-16T01:02:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f666f82d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea3324a050 con 0x55ea332e82f0 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f6664ff9640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 0x7f66540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59734/0 (socket says 172.21.15.17:59734) 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f665ffff640 1 -- 172.21.15.17:0/352586405 learned_addr learned my addr 172.21.15.17:0/352586405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f6666ffd640 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e82f0 0x55ea332f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f66677fe640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 0x7f66540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.387+0000 7f665ffff640 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e79d0 0x55ea332e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f6664ff9640 1 -- 172.21.15.17:0/3690768809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f66600f0850 con 0x7f666810e420 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 -- 172.21.15.17:0/352586405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e82f0 msgr2=0x55ea332f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e82f0 0x55ea332f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 -- 172.21.15.17:0/352586405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e79d0 msgr2=0x55ea332e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e79d0 0x55ea332e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 -- 172.21.15.17:0/352586405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea33202130 con 0x55ea332f2bb0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f66677fe640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 0x7f66540a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66600b92e0 tx=0x7f666008fd00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665ffff640 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6650012840 tx=0x7f665000d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a871d21def6ed0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665d7fa640 1 -- 172.21.15.17:0/352586405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000aa60 con 0x55ea332f2bb0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665d7fa640 1 -- 172.21.15.17:0/352586405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66500054d0 con 0x55ea332f2bb0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.388+0000 7f665d7fa640 1 -- 172.21.15.17:0/352586405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650004b20 con 0x55ea332f2bb0 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- 172.21.15.17:0/352586405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 msgr2=0x55ea332f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6650012840 tx=0x7f665000d3e0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- 172.21.15.17:0/352586405 shutdown_connections 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332f2bb0 0x55ea332f4fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e82f0 0x55ea332f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 --2- 172.21.15.17:0/352586405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e79d0 0x55ea332e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- 172.21.15.17:0/352586405 >> 172.21.15.17:0/352586405 conn(0x55ea332e3f60 msgr2=0x55ea332e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- 172.21.15.17:0/352586405 shutdown_connections 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- 172.21.15.17:0/352586405 wait complete. 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 -- start start 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.389+0000 7f666f82d740 1 Processor -- start 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332f2bb0 0x55ea332efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea332f5780 con 0x55ea332e79d0 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea33208f20 con 0x55ea332e82f0 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea332f5900 con 0x55ea332f2bb0 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f666f82d740 10 client.0 _ll_register_callbacks cb 0x55ea331d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59744/0 (socket says 172.21.15.17:59744) 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 -- 172.21.15.17:0/2997904684 learned_addr learned my addr 172.21.15.17:0/2997904684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:13.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f6666ffd640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332f2bb0 0x55ea332efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 -- 172.21.15.17:0/2997904684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332f2bb0 msgr2=0x55ea332efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332f2bb0 0x55ea332efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 -- 172.21.15.17:0/2997904684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 msgr2=0x55ea332ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 -- 172.21.15.17:0/2997904684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea32fbf2b0 con 0x55ea332e79d0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f6666ffd640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f665ffff640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6650012810 tx=0x7f6650005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81591ac3fcb31f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.390+0000 7f664e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650026040 con 0x55ea332e79d0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f665000a860 con 0x55ea332e79d0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66500054d0 con 0x55ea332e79d0 2024-09-16T01:02:13.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6650031050 con 0x55ea332e79d0 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 10 client.15177 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea333010a0 con 0x55ea332e79d0 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66500054d0 con 0x55ea332e79d0 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f665001d430 con 0x55ea332e79d0 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 10 client.15177 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 10 client.15177 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 20 client.15177 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea33303440 0x55ea333048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 4 client.15177 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.391+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 --> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea3325b600 con 0x55ea33303440 2024-09-16T01:02:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f6666ffd640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea33303440 0x55ea333048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f664e7fc640 10 client.15177 ms_handle_connect on v2:172.21.15.17:6840/2275099611 2024-09-16T01:02:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f6666ffd640 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea33303440 0x55ea333048b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6eff6658c76e8dc server_cookie=112f765d414a62cf in_seq=0 out_seq=0 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f664e7fc640 1 -- 172.21.15.17:0/2997904684 <== mds.1 v2:172.21.15.17:6840/2275099611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea3325b600 con 0x55ea33303440 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f664e7fc640 10 client.15177 handle_command_reply: tid=0 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.392+0000 7f666f82d740 1 client.15177 shutdown 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 msgr2=0x55ea332f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6650012810 tx=0x7f6650005850 comp rx=0 tx=0).stop 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 shutdown_connections 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea33303440 0x55ea333048b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332f2bb0 0x55ea332efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 --2- 172.21.15.17:0/2997904684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e79d0 0x55ea332f2460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f664e7fc640 0 client.15177 ms_handle_reset on v2:172.21.15.17:6840/2275099611 2024-09-16T01:02:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 >> 172.21.15.17:0/2997904684 conn(0x55ea332e3f60 msgr2=0x55ea332e9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 shutdown_connections 2024-09-16T01:02:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 1 -- 172.21.15.17:0/2997904684 wait complete. 2024-09-16T01:02:13.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.393+0000 7f666f82d740 20 client.15177 trim_cache size 0 max 16384 2024-09-16T01:02:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 Processor -- start 2024-09-16T01:02:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 -- start start 2024-09-16T01:02:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea33303b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea33302bf0 con 0x55ea332e3f60 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea333032c0 con 0x55ea332e82f0 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f666f82d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea33303990 con 0x55ea332e79d0 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59756/0 (socket says 172.21.15.17:59756) 2024-09-16T01:02:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f665ffff640 1 -- 172.21.15.17:0/279575189 learned_addr learned my addr 172.21.15.17:0/279575189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f6666ffd640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea33303b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.411+0000 7f665ffff640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 -- 172.21.15.17:0/279575189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 msgr2=0x55ea33303b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea33303b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 -- 172.21.15.17:0/279575189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 msgr2=0x55ea332e2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332e2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 -- 172.21.15.17:0/279575189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea332edd00 con 0x55ea332e3f60 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f6666ffd640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea33303b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665ffff640 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6650006010 tx=0x7f6650005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ad8bf260ca4e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665cff9640 1 -- 172.21.15.17:0/279575189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650021070 con 0x55ea332e3f60 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665cff9640 1 -- 172.21.15.17:0/279575189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f665001da70 con 0x55ea332e3f60 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.412+0000 7f665cff9640 1 -- 172.21.15.17:0/279575189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650005490 con 0x55ea332e3f60 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- 172.21.15.17:0/279575189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 msgr2=0x55ea33302d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6650006010 tx=0x7f6650005be0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- 172.21.15.17:0/279575189 shutdown_connections 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea332e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea33303b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 --2- 172.21.15.17:0/279575189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea33302d70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- 172.21.15.17:0/279575189 >> 172.21.15.17:0/279575189 conn(0x55ea33302810 msgr2=0x55ea332e27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- 172.21.15.17:0/279575189 shutdown_connections 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- 172.21.15.17:0/279575189 wait complete. 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 -- start start 2024-09-16T01:02:13.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.413+0000 7f666f82d740 1 Processor -- start 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea3330d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea33308140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea33304730 con 0x55ea332e3f60 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ea33304060 con 0x55ea332e82f0 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea33304e00 con 0x55ea332e79d0 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f666f82d740 10 client.0 _ll_register_callbacks cb 0x7f665000de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59758/0 (socket says 172.21.15.17:59758) 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 -- 172.21.15.17:0/4260727170 learned_addr learned my addr 172.21.15.17:0/4260727170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f6666ffd640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea3330d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 -- 172.21.15.17:0/4260727170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 msgr2=0x55ea3330d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea3330d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 -- 172.21.15.17:0/4260727170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 msgr2=0x55ea33308140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea33308140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 -- 172.21.15.17:0/4260727170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea33308940 con 0x55ea332e3f60 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f6666ffd640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea3330d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f665ffff640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f665000d420 tx=0x7f665000d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bae48ed7389c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f664e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650021070 con 0x55ea332e3f60 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.414+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6650005230 con 0x55ea332e3f60 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f665001da70 con 0x55ea332e3f60 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6650012040 con 0x55ea332e3f60 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea3336d660 con 0x55ea332e3f60 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f665001da70 con 0x55ea332e3f60 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f665004c080 con 0x55ea332e3f60 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 10 client.15183 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 20 client.15183 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:13.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea332f2bb0 0x55ea33370ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 4 client.15183 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 --> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] -- command(tid 0: {"prefix": "status"}) -- 0x55ea33255b10 con 0x55ea332f2bb0 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.415+0000 7f6666ffd640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea332f2bb0 0x55ea33370ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f6666ffd640 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea332f2bb0 0x55ea33370ce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ff4206d492b233c server_cookie=1ef0bf83a398498c in_seq=0 out_seq=0 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f664e7fc640 10 client.15183 ms_handle_connect on v2:172.21.15.17:6840/2275099611 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f664e7fc640 1 -- 172.21.15.17:0/4260727170 <== mds.1 v2:172.21.15.17:6840/2275099611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ea33255b10 con 0x55ea332f2bb0 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f664e7fc640 10 client.15183 handle_command_reply: tid=0 2024-09-16T01:02:13.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 client.15183 shutdown 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 msgr2=0x55ea3330cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f665000d420 tx=0x7f665000d860 comp rx=0 tx=0).stop 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 shutdown_connections 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:6840/2275099611,v1:172.21.15.17:6841/2275099611] conn(0x55ea332f2bb0 0x55ea33370ce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ea332e82f0 0x55ea33308140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea332e79d0 0x55ea3330d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f664e7fc640 0 client.15183 ms_handle_reset on v2:172.21.15.17:6840/2275099611 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 --2- 172.21.15.17:0/4260727170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea332e3f60 0x55ea3330cd10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 >> 172.21.15.17:0/4260727170 conn(0x55ea33302810 msgr2=0x55ea332e3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 shutdown_connections 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 1 -- 172.21.15.17:0/4260727170 wait complete. 2024-09-16T01:02:13.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.416+0000 7f666f82d740 20 client.15183 trim_cache size 0 max 16384 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24503, 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 96.941779335000007, 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:02:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 117.640069134 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 msgr2=0x7f66540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 0x7f66540a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66600b92e0 tx=0x7f666008fd00 comp rx=0 tx=0).stop 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 msgr2=0x7f666819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:13.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f666002ae70 tx=0x7f666002f5d0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 shutdown_connections 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f66540a32c0 0x7f66540a5780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f666810e420 0x7f666819ee50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6668074ee0 0x7f666819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 --2- 172.21.15.17:0/3690768809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66680745c0 0x7f666819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.417+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 >> 172.21.15.17:0/3690768809 conn(0x7f66680fd8c0 msgr2=0x7f66680fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.418+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 shutdown_connections 2024-09-16T01:02:13.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:13.418+0000 7f666d454640 1 -- 172.21.15.17:0/3690768809 wait complete. 2024-09-16T01:02:14.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:02:14.489 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:14.926 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:14 smithi017 ceph-mon[31211]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 -- 172.21.15.17:0/695722340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8106f10 msgr2=0x7ffae810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 --2- 172.21.15.17:0/695722340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8106f10 0x7ffae810ea90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009ca0 tx=0x7ffae002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 -- 172.21.15.17:0/695722340 shutdown_connections 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 --2- 172.21.15.17:0/695722340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8106f10 0x7ffae810ea90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 --2- 172.21.15.17:0/695722340 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 --2- 172.21.15.17:0/695722340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8101de0 0x7ffae81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 -- 172.21.15.17:0/695722340 >> 172.21.15.17:0/695722340 conn(0x7ffae80fd8c0 msgr2=0x7ffae80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 -- 172.21.15.17:0/695722340 shutdown_connections 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.924+0000 7ffaef470640 1 -- 172.21.15.17:0/695722340 wait complete. 2024-09-16T01:02:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 Processor -- start 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 -- start start 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8106f10 0x7ffae8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8111e20 con 0x7ffae8101de0 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8111ca0 con 0x7ffae8102790 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaef470640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8111fa0 con 0x7ffae8106f10 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaed20c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaed20c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59786/0 (socket says 172.21.15.17:59786) 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaed20c640 1 -- 172.21.15.17:0/730897190 learned_addr learned my addr 172.21.15.17:0/730897190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.925+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8106f10 0x7ffae8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 -- 172.21.15.17:0/730897190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8106f10 msgr2=0x7ffae8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8106f10 0x7ffae8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 -- 172.21.15.17:0/730897190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 msgr2=0x7ffae8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 -- 172.21.15.17:0/730897190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae81a6810 con 0x7ffae8101de0 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaed20c640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c970 tx=0x7ffae400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffade7fc640 1 -- 172.21.15.17:0/730897190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4007bb0 con 0x7ffae8101de0 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae81a6b00 con 0x7ffae8101de0 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffade7fc640 1 -- 172.21.15.17:0/730897190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae4007d50 con 0x7ffae8101de0 2024-09-16T01:02:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffade7fc640 1 -- 172.21.15.17:0/730897190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae400f450 con 0x7ffae8101de0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.926+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae81a6ff0 con 0x7ffae8101de0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffade7fc640 1 -- 172.21.15.17:0/730897190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffae4004f20 con 0x7ffae8101de0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 Processor -- start 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 -- start start 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e672f0 0x55a7d0e71670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e73fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0dcd090 con 0x55a7d0e669d0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0d74a70 con 0x55a7d0e71bb0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaf1849740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0dc9050 con 0x55a7d0e672f0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaeda0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaeda0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59788/0 (socket says 172.21.15.17:59788) 2024-09-16T01:02:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaeda0d640 1 -- 172.21.15.17:0/2461236045 learned_addr learned my addr 172.21.15.17:0/2461236045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e73fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.929+0000 7ffaed20c640 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e672f0 0x55a7d0e71670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 -- 172.21.15.17:0/2461236045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e672f0 msgr2=0x55a7d0e71670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e672f0 0x55a7d0e71670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 -- 172.21.15.17:0/2461236045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 msgr2=0x55a7d0e73fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e73fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 -- 172.21.15.17:0/2461236045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7d0d81130 con 0x55a7d0e669d0 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffade7fc640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 0x7ffad40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffae0035000 tx=0x7ffae0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e86254f17dee8db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffaed20c640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 0x7ffad40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffad37fe640 1 -- 172.21.15.17:0/2461236045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0031450 con 0x55a7d0e669d0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffade7fc640 1 -- 172.21.15.17:0/730897190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffae40cf630 con 0x7ffae8101de0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffad37fe640 1 -- 172.21.15.17:0/2461236045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae0036030 con 0x55a7d0e669d0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.930+0000 7ffad37fe640 1 -- 172.21.15.17:0/2461236045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0004570 con 0x55a7d0e669d0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- 172.21.15.17:0/2461236045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 msgr2=0x55a7d0e66db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffae0035000 tx=0x7ffae0009a20 comp rx=0 tx=0).stop 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaed20c640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 0x7ffad40a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffae40a4340 tx=0x7ffae40d2da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- 172.21.15.17:0/2461236045 shutdown_connections 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e73fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e672f0 0x55a7d0e71670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 --2- 172.21.15.17:0/2461236045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e669d0 0x55a7d0e66db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- 172.21.15.17:0/2461236045 >> 172.21.15.17:0/2461236045 conn(0x55a7d0e62f60 msgr2=0x55a7d0e63340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- 172.21.15.17:0/2461236045 shutdown_connections 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- 172.21.15.17:0/2461236045 wait complete. 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 -- start start 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.931+0000 7ffaf1849740 1 Processor -- start 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e71390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e672f0 0x55a7d0e6e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e74600 con 0x55a7d0e71bb0 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0d87f20 con 0x55a7d0e672f0 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e74780 con 0x55a7d0e669d0 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaf1849740 10 client.0 _ll_register_callbacks cb 0x55a7d0d51030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59796/0 (socket says 172.21.15.17:59796) 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 -- 172.21.15.17:0/481468160 learned_addr learned my addr 172.21.15.17:0/481468160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e672f0 0x55a7d0e6e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e71390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 -- 172.21.15.17:0/481468160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 msgr2=0x55a7d0e71390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e71390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 -- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e672f0 msgr2=0x55a7d0e6e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e672f0 0x55a7d0e6e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 -- 172.21.15.17:0/481468160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7d0b3e2b0 con 0x55a7d0e71bb0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009620 tx=0x7ffae0004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea31c7692b7e2f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.932+0000 7ffad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0058060 con 0x55a7d0e71bb0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffae0003970 con 0x55a7d0e71bb0 2024-09-16T01:02:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae0036030 con 0x55a7d0e71bb0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffae0003b70 con 0x55a7d0e71bb0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 10 client.15195 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a7d0e74600 con 0x55a7d0e71bb0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae0036030 con 0x55a7d0e71bb0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffae0050070 con 0x55a7d0e71bb0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 10 client.15195 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 10 client.15195 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 20 client.15195 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0e82100 0x55a7d0e83570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 4 client.15195 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.933+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7d0dda600 con 0x55a7d0e82100 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.934+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0e82100 0x55a7d0e83570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.934+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0e82100 0x55a7d0e83570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=547dbc1dc39d17f0 server_cookie=db5de9247776838e in_seq=0 out_seq=0 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.934+0000 7ffad0ff9640 10 client.15195 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffad0ff9640 1 -- 172.21.15.17:0/481468160 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7d0dda600 con 0x55a7d0e82100 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffad0ff9640 10 client.15195 handle_command_reply: tid=0 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 client.15195 shutdown 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 msgr2=0x55a7d0e6ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009620 tx=0x7ffae0004150 comp rx=0 tx=0).stop 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 shutdown_connections 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0e82100 0x55a7d0e83570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6ec20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e672f0 0x55a7d0e6e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 --2- 172.21.15.17:0/481468160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e71390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffad0ff9640 0 client.15195 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 >> 172.21.15.17:0/481468160 conn(0x55a7d0e62f60 msgr2=0x55a7d0e68c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 shutdown_connections 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 1 -- 172.21.15.17:0/481468160 wait complete. 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.935+0000 7ffaf1849740 20 client.15195 trim_cache size 0 max 16384 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 Processor -- start 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 -- start start 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 0x55a7d0e827d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e818b0 con 0x55a7d0e672f0 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e81f80 con 0x55a7d0e669d0 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.953+0000 7ffaf1849740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e82650 con 0x55a7d0e71bb0 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59806/0 (socket says 172.21.15.17:59806) 2024-09-16T01:02:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 -- 172.21.15.17:0/3403708544 learned_addr learned my addr 172.21.15.17:0/3403708544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 0x55a7d0e827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 -- 172.21.15.17:0/3403708544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e71bb0 msgr2=0x55a7d0e6cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 -- 172.21.15.17:0/3403708544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 msgr2=0x55a7d0e827d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 0x55a7d0e827d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 -- 172.21.15.17:0/3403708544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7d0e63b60 con 0x55a7d0e672f0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 0x55a7d0e827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005d00 tx=0x7ffad800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75b3d55d0c5d831 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffad2ffd640 1 -- 172.21.15.17:0/3403708544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8010b60 con 0x55a7d0e672f0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffad2ffd640 1 -- 172.21.15.17:0/3403708544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffad80054d0 con 0x55a7d0e672f0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.954+0000 7ffad2ffd640 1 -- 172.21.15.17:0/3403708544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8004db0 con 0x55a7d0e672f0 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- 172.21.15.17:0/3403708544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 msgr2=0x55a7d0e5dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005d00 tx=0x7ffad800b410 comp rx=0 tx=0).stop 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- 172.21.15.17:0/3403708544 shutdown_connections 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e6cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e5dce0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 --2- 172.21.15.17:0/3403708544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e669d0 0x55a7d0e827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- 172.21.15.17:0/3403708544 >> 172.21.15.17:0/3403708544 conn(0x55a7d0e62f60 msgr2=0x55a7d0e6e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- 172.21.15.17:0/3403708544 shutdown_connections 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- 172.21.15.17:0/3403708544 wait complete. 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 -- start start 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.955+0000 7ffaf1849740 1 Processor -- start 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e8bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e85d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e833f0 con 0x55a7d0e672f0 2024-09-16T01:02:14.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e82d20 con 0x55a7d0e71bb0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7d0e83ac0 con 0x55a7d0e669d0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaf1849740 10 client.0 _ll_register_callbacks cb 0x7ffae0009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59812/0 (socket says 172.21.15.17:59812) 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 -- 172.21.15.17:0/1321571002 learned_addr learned my addr 172.21.15.17:0/1321571002 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e85d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e8bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 -- 172.21.15.17:0/1321571002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 msgr2=0x55a7d0e8bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e8bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 -- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 msgr2=0x55a7d0e85d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e85d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeca0b640 1 -- 172.21.15.17:0/1321571002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7d0e86240 con 0x55a7d0e672f0 2024-09-16T01:02:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.956+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e8bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaeca0b640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005e00 tx=0x7ffad8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34ca21e8b204404 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8004b50 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad80054d0 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffad8004cf0 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffad8005020 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a7d0e8b4b0 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffad80054d0 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ffad802e890 con 0x55a7d0e672f0 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 10 client.15201 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 20 client.15201 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0ef0bf0 0x55a7d0eef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 4 client.15201 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.957+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "status"}) -- 0x55a7d0dd4b10 con 0x55a7d0ef0bf0 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0ef0bf0 0x55a7d0eef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffad0ff9640 10 client.15201 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaeda0d640 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0ef0bf0 0x55a7d0eef900 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3376aa309c0b04 server_cookie=edae3d83dddc1a18 in_seq=0 out_seq=0 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffad0ff9640 1 -- 172.21.15.17:0/1321571002 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55a7d0dd4b10 con 0x55a7d0ef0bf0 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffad0ff9640 10 client.15201 handle_command_reply: tid=0 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 client.15201 shutdown 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 msgr2=0x55a7d0e857c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005e00 tx=0x7ffad8005770 comp rx=0 tx=0).stop 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 shutdown_connections 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a7d0ef0bf0 0x55a7d0eef900 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a7d0e71bb0 0x55a7d0e85d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7d0e672f0 0x55a7d0e857c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffad0ff9640 0 client.15201 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 --2- 172.21.15.17:0/1321571002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d0e669d0 0x55a7d0e8bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.958+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 >> 172.21.15.17:0/1321571002 conn(0x55a7d0e62f60 msgr2=0x55a7d0e6cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 shutdown_connections 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "d67bb9a6-73c5-11ef-bceb-c7b262605968", 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24515, 2024-09-16T01:02:15.002 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 105.522652169, 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 82, 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 80, 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 116.451239669 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaf1849740 1 -- 172.21.15.17:0/1321571002 wait complete. 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaf1849740 20 client.15201 trim_cache size 0 max 16384 2024-09-16T01:02:15.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 msgr2=0x7ffad40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 0x7ffad40a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffae40a4340 tx=0x7ffae40d2da0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 msgr2=0x7ffae80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c970 tx=0x7ffae400ce30 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 shutdown_connections 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7ffad40a3240 0x7ffad40a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8106f10 0x7ffae8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffae8102790 0x7ffae8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 --2- 172.21.15.17:0/730897190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae8101de0 0x7ffae80744f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 >> 172.21.15.17:0/730897190 conn(0x7ffae80fd8c0 msgr2=0x7ffae80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 shutdown_connections 2024-09-16T01:02:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:14.959+0000 7ffaef470640 1 -- 172.21.15.17:0/730897190 wait complete. 2024-09-16T01:02:15.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:14 smithi088 ceph-mon[34093]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-16T01:02:15.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:14 smithi154 ceph-mon[34759]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-16T01:02:15.866 INFO:teuthology.run_tasks:Running task sequential... 2024-09-16T01:02:15.876 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-16T01:02:15.876 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-16T01:02:15.877 INFO:teuthology.task.print:Enabling mgr modules 2024-09-16T01:02:15.877 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-16T01:02:15.878 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:02:15.878 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:02:15.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-16T01:02:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 -- 172.21.15.17:0/3062039109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c107830 msgr2=0x7f6e7c109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 --2- 172.21.15.17:0/3062039109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c107830 0x7f6e7c109ca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009ca0 tx=0x7f6e6c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 -- 172.21.15.17:0/3062039109 shutdown_connections 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 --2- 172.21.15.17:0/3062039109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c107830 0x7f6e7c109ca0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 --2- 172.21.15.17:0/3062039109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c104f00 0x7f6e7c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 --2- 172.21.15.17:0/3062039109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 -- 172.21.15.17:0/3062039109 >> 172.21.15.17:0/3062039109 conn(0x7f6e7c0fc1b0 msgr2=0x7f6e7c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 -- 172.21.15.17:0/3062039109 shutdown_connections 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.987+0000 7f6e83791640 1 -- 172.21.15.17:0/3062039109 wait complete. 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 Processor -- start 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 -- start start 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 0x7f6e7c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c107830 0x7f6e7c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c10d6a0 con 0x7f6e7c1025d0 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c10d520 con 0x7f6e7c104f00 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e83791640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c10d820 con 0x7f6e7c107830 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59828/0 (socket says 172.21.15.17:59828) 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 -- 172.21.15.17:0/1758533898 learned_addr learned my addr 172.21.15.17:0/1758533898 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e80d2c640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 0x7f6e7c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e81d2e640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c107830 0x7f6e7c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 -- 172.21.15.17:0/1758533898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c107830 msgr2=0x7f6e7c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c107830 0x7f6e7c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 -- 172.21.15.17:0/1758533898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 msgr2=0x7f6e7c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 0x7f6e7c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 -- 172.21.15.17:0/1758533898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c19f920 con 0x7f6e7c1025d0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e80d2c640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 0x7f6e7c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.988+0000 7f6e8152d640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400d950 tx=0x7f6e7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.989+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74017070 con 0x7f6e7c1025d0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.989+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e74009c30 con 0x7f6e7c1025d0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.989+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c19fc10 con 0x7f6e7c1025d0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.989+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400f620 con 0x7f6e7c1025d0 2024-09-16T01:02:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.989+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c1a01b0 con 0x7f6e7c1025d0 2024-09-16T01:02:15.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.990+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7c0fdca0 con 0x7f6e7c1025d0 2024-09-16T01:02:15.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.991+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e740109a0 con 0x7f6e7c1025d0 2024-09-16T01:02:15.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.992+0000 7f6e7a7fc640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 0x7f6e640a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:15.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.992+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6e740cf610 con 0x7f6e7c1025d0 2024-09-16T01:02:15.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.992+0000 7f6e80d2c640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 0x7f6e640a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.992+0000 7f6e80d2c640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 0x7f6e640a5830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c06ac20 tx=0x7f6e7000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:15.996+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e74009de0 con 0x7f6e7c1025d0 2024-09-16T01:02:16.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.219+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f6e7c062e90 con 0x7f6e7c1025d0 2024-09-16T01:02:16.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.792+0000 7f6e7a7fc640 1 -- 172.21.15.17:0/1758533898 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f6e7409c340 con 0x7f6e7c1025d0 2024-09-16T01:02:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 msgr2=0x7f6e640a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 0x7f6e640a5830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c06ac20 tx=0x7f6e7000a5c0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 msgr2=0x7f6e7c197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400d950 tx=0x7f6e7400de10 comp rx=0 tx=0).stop 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 shutdown_connections 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f6e640a3370 0x7f6e640a5830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c107830 0x7f6e7c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7c104f00 0x7f6e7c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 --2- 172.21.15.17:0/1758533898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e7c1025d0 0x7f6e7c197d10 secure :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400d950 tx=0x7f6e7400de10 comp rx=0 tx=0).stop 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 >> 172.21.15.17:0/1758533898 conn(0x7f6e7c0fc1b0 msgr2=0x7f6e7c102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 shutdown_connections 2024-09-16T01:02:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:16.796+0000 7f6e83791640 1 -- 172.21.15.17:0/1758533898 wait complete. 2024-09-16T01:02:16.816 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-16T01:02:16.846 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-16T01:02:16.846 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-16T01:02:16.847 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-16T01:02:16.847 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:02:16.847 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:16.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:16.847 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-16T01:02:16.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:16.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-16T01:02:16.934 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-09-16T01:02:16.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:02:16.935 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-16T01:02:16.936 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-16T01:02:16.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-mon[34093]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: ignoring --setuser ceph since I am not root 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: ignoring --setgroup ceph since I am not root 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-mgr[35492]: -- 172.21.15.88:0/2553374967 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557112df10e0 con 0x557112dcf000 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:16 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:16.948+0000 7f2d3032a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:02:17.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.004+0000 7f2d3032a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-mon[34759]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-16T01:02:17.153 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: ignoring --setuser ceph since I am not root 2024-09-16T01:02:17.153 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: ignoring --setgroup ceph since I am not root 2024-09-16T01:02:17.154 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-mgr[36548]: -- 172.21.15.154:0/2816232438 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56165caa90e0 con 0x56165ca86800 2024-09-16T01:02:17.154 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:16.948+0000 7f4e38b83040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:02:17.154 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.005+0000 7f4e38b83040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:16 smithi017 ceph-mon[31211]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:16 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:16.954+0000 7fdd82baa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:02:17.175 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.015+0000 7fdd82baa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:17.176 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.173+0000 7fdd82baa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:02:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:02:17.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.248+0000 7fdd82baa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:02:17.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.410+0000 7fdd82baa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.151+0000 7f2d3032a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.218+0000 7f2d3032a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.366+0000 7f2d3032a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.509+0000 7f2d3032a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.152+0000 7f4e38b83040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.219+0000 7f4e38b83040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.367+0000 7f4e38b83040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:17.510 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.508+0000 7f4e38b83040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- 172.21.15.17:0/1734248997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 msgr2=0x7fe35010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 --2- 172.21.15.17:0/1734248997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35010da40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe348009ca0 tx=0x7fe34802a950 comp rx=0 tx=0).stop 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- 172.21.15.17:0/1734248997 shutdown_connections 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 --2- 172.21.15.17:0/1734248997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35010da40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 --2- 172.21.15.17:0/1734248997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350102570 0x7fe3501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 --2- 172.21.15.17:0/1734248997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350100e20 0x7fe350101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- 172.21.15.17:0/1734248997 >> 172.21.15.17:0/1734248997 conn(0x7fe3500fc7d0 msgr2=0x7fe3500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- 172.21.15.17:0/1734248997 shutdown_connections 2024-09-16T01:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- 172.21.15.17:0/1734248997 wait complete. 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 Processor -- start 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.737+0000 7fe355656640 1 -- start start 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350100e20 0x7fe3501983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe350111f50 con 0x7fe350102ef0 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe350111dd0 con 0x7fe350102570 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe355656640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3501120d0 con 0x7fe350100e20 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:42148/0 (socket says 172.21.15.17:42148) 2024-09-16T01:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 -- 172.21.15.17:0/3363225047 learned_addr learned my addr 172.21.15.17:0/3363225047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350100e20 0x7fe3501983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59850/0 (socket says 172.21.15.17:59850) 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350100e20 msgr2=0x7fe3501983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350100e20 0x7fe3501983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 msgr2=0x7fe35019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 -- 172.21.15.17:0/3363225047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35019d3a0 con 0x7fe350102570 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.738+0000 7fe34e7fc640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.739+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33800cd80 con 0x7fe350102570 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.739+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35019d690 con 0x7fe350102570 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.739+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3380054d0 con 0x7fe350102570 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.739+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338010490 con 0x7fe350102570 2024-09-16T01:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.739+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35010e400 con 0x7fe350102570 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.740+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe350101200 con 0x7fe350102570 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.741+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fe338005020 con 0x7fe350102570 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.741+0000 7fe347fff640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 0x7fe33c0a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.742+0000 7fe34effd640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 msgr2=0x7fe33c0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.742+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe3380cfd50 con 0x7fe350102570 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.742+0000 7fe34effd640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 0x7fe33c0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.746+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe33809ca20 con 0x7fe350102570 2024-09-16T01:02:17.765 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.561+0000 7fdd82baa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:02:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.943+0000 7fe34effd640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 msgr2=0x7fe33c0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:17.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.943+0000 7fe34effd640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 0x7fe33c0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:02:17.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.959+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe350109090 con 0x7fe350102570 2024-09-16T01:02:17.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.960+0000 7fe347fff640 1 -- 172.21.15.17:0/3363225047 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fe33809c320 con 0x7fe350102570 2024-09-16T01:02:17.961 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:02:17.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 msgr2=0x7fe33c0a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:02:17.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 0x7fe33c0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 msgr2=0x7fe350198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800edf0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 shutdown_connections 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fe33c0a3290 0x7fe33c0a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe350102ef0 0x7fe35019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe350102570 0x7fe350198930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 --2- 172.21.15.17:0/3363225047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe350100e20 0x7fe3501983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 >> 172.21.15.17:0/3363225047 conn(0x7fe3500fc7d0 msgr2=0x7fe3500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 shutdown_connections 2024-09-16T01:02:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:17.962+0000 7fe355656640 1 -- 172.21.15.17:0/3363225047 wait complete. 2024-09-16T01:02:18.067 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-16T01:02:18.067 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-mon[34093]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-16T01:02:18.067 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.819+0000 7f2d3032a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:02:18.067 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:17.880+0000 7f2d3032a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:02:18.068 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.821+0000 7f4e38b83040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:02:18.068 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:17.883+0000 7f4e38b83040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:02:18.069 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-16T01:02:18.069 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:17 smithi154 ceph-mon[34759]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-16T01:02:18.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1758533898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-16T01:02:18.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-mon[31211]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-16T01:02:18.155 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.892+0000 7fdd82baa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:02:18.156 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:17.956+0000 7fdd82baa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:02:18.156 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:18 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:18.153+0000 7fdd82baa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:02:18.393 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:18.066+0000 7f2d3032a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:02:18.403 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:18.066+0000 7f4e38b83040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:02:18.780 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:02:18.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:02:18.781 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:02:18.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:18.781 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-16T01:02:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:02:18.799 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:02:18.800 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42180sec preferred_lft 42180sec 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:02:18.801 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-16T01:02:18.801 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:02:18.802 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-16T01:02:18.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:02:19.003 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:18 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3363225047' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:02:19.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:19.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:19.014 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:02:19.040 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-16T01:02:19.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:19.042 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-16T01:02:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-16T01:02:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:02:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:02:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:02:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:02:19.120 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:02:19.120 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-16T01:02:19.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:02:19.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:02:19.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:02:19.121 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-16T01:02:19.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:18 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3363225047' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:02:19.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:18.947+0000 7f2d3032a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:02:19.143 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:19.014+0000 7f2d3032a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:02:19.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:18 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3363225047' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:02:19.153 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:18.958+0000 7f4e38b83040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:02:19.153 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:19.025+0000 7f4e38b83040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:02:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:02:19.318 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:19.108+0000 7fdd82baa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:02:19.318 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:19.180+0000 7fdd82baa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:02:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:19.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:19.429 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-16T01:02:19.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:19.447 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-16T01:02:19.504 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:02:19.504 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-16T01:02:19.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:19.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T01:02:19.505 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-16T01:02:19.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:02:19.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:19.625 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T01:02:19.625 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:02:19.625 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-16T01:02:19.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T01:02:19.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:02:19.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T01:02:19.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T01:02:19.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T01:02:19.626 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-16T01:02:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:02:19.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:19.754 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:02:19.754 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-16T01:02:19.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-16T01:02:19.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:02:19.754 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-16T01:02:19.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:02:19.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:19.836 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-16T01:02:19.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:02:19.837 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:19.854 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:02:19.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:02:19.854 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:19.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-16T01:02:19.982 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:02:19.983 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:19.725+0000 7f2d3032a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:02:19.983 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:19.840+0000 7f2d3032a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:02:20.004 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:19.744+0000 7f4e38b83040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:02:20.004 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:19.860+0000 7f4e38b83040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:02:20.047 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-16T01:02:20.047 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:02:20.048 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-16T01:02:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/8a3f4eab94bfa16eff2e6fe4614b602b00ec27d55c754d8cbc53899de988c623/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/48bd142014e34a0868c05cb6aca23ba9564aff1da05b7e486e99e3da7def0969/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/2b475bdc1721836ba4ca9d1b26dcca2dd0cd7c683b0b5b5d0e17ce368b347a7d/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/54a5921466a6f42e5b6a89a62c79a0d8dda7426f9bd9b9067012e7083005ca86/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/5d8d792eb70183bf5d7c3ee79b6abf9946854f9cda00dafff5bb3082852a117d/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/44035becb0c266c67c9abc78e00295ee98e445348e247ef7b7463b0728d6983a/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/c8b1b29d19d1a56a850ef38a9ff85e38ea2d9df5a0fbae5ef66af1b7bb8ff2eb/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/2288e0d66342ee4f8f9f1f95f5efe04602a3730c8cba96b097a30ccadf77c362/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/5d768e14fd73e18c8da24fd4ce396442cbd1c32955379f76a8cdcdb8af882a02/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d693a3136f14ebfa346879696221e819db2cb413e15cc2cd256b1bee42a3df8b/merged 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-16T01:02:20.050 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:20.051 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:20.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:20.051 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-16T01:02:20.115 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T01:02:20.115 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/cfb26b32-7fd5-4b46-b0d9-a047bdbfd2e6 --client_fs=cephfs) 2024-09-16T01:02:20.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-16T01:02:20.196 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:02:20.243 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:19.958+0000 7fdd82baa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:02:20.243 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.084+0000 7fdd82baa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:02:20.257 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-16T01:02:20.257 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-16T01:02:20.257 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-16T01:02:20.258 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/8a3f4eab94bfa16eff2e6fe4614b602b00ec27d55c754d8cbc53899de988c623/merged 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/48bd142014e34a0868c05cb6aca23ba9564aff1da05b7e486e99e3da7def0969/merged 2024-09-16T01:02:20.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/2b475bdc1721836ba4ca9d1b26dcca2dd0cd7c683b0b5b5d0e17ce368b347a7d/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/54a5921466a6f42e5b6a89a62c79a0d8dda7426f9bd9b9067012e7083005ca86/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/5d8d792eb70183bf5d7c3ee79b6abf9946854f9cda00dafff5bb3082852a117d/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/44035becb0c266c67c9abc78e00295ee98e445348e247ef7b7463b0728d6983a/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/c8b1b29d19d1a56a850ef38a9ff85e38ea2d9df5a0fbae5ef66af1b7bb8ff2eb/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/2288e0d66342ee4f8f9f1f95f5efe04602a3730c8cba96b097a30ccadf77c362/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/5d768e14fd73e18c8da24fd4ce396442cbd1c32955379f76a8cdcdb8af882a02/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d693a3136f14ebfa346879696221e819db2cb413e15cc2cd256b1bee42a3df8b/merged 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:20.260 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:20.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:20.261 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-16T01:02:20.261 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:19.982+0000 7f2d3032a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:20.262 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.044+0000 7f2d3032a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:02:20.262 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.193+0000 7f2d3032a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:02:20.262 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.260+0000 7f2d3032a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:02:20.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-16T01:02:20.278+0000 7f719c335480 -1 init, newargv = 0x55866b0a7ab0 newargc=15 2024-09-16T01:02:20.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[80659]: starting ceph client 2024-09-16T01:02:20.286 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.002+0000 7f4e38b83040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:20.286 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.064+0000 7f4e38b83040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:02:20.286 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.215+0000 7f4e38b83040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:02:20.286 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.285+0000 7f4e38b83040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:02:20.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[80659]: starting fuse 2024-09-16T01:02:20.301 INFO:teuthology.orchestra.run.smithi017.stdout:120 2024-09-16T01:02:20.301 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-16T01:02:20.301 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-16T01:02:20.302 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-16T01:02:20.303 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-16T01:02:20.303 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T01:02:20.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-16T01:02:20.303 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-16T01:02:20.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-16T01:02:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.80659.asok 2024-09-16T01:02:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:02:20.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.80659.asok 2024-09-16T01:02:20.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:20.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.80659.asok status 2024-09-16T01:02:20.503 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.241+0000 7fdd82baa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:02:20.503 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.313+0000 7fdd82baa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:02:20.503 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.476+0000 7fdd82baa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:02:20.552 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.325+0000 7f2d3032a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:02:20.552 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.485+0000 7f2d3032a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:02:20.578 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.347+0000 7f4e38b83040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:02:20.578 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.511+0000 7f4e38b83040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:02:20.578 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.577+0000 7f4e38b83040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "80659", 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/volumes/qa/sv_0/cfb26b32-7fd5-4b46-b0d9-a047bdbfd2e6" 2024-09-16T01:02:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 15237, 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 15237 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:02:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1524830845 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1524830845 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.15237 192.168.0.1:0/1524830845", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/1524830845", 2024-09-16T01:02:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 5, 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 27, 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 82, 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-16T01:02:20.582 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:02:20.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:20.588 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-16T01:02:20.588 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:20.645 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-16T01:02:20.645 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:20.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:20.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:20.714 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T01:02:20.833 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:02:20.834 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:02:20.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.551+0000 7f2d3032a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.619+0000 7f2d3032a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.702+0000 7f2d3032a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.761+0000 7f2d3032a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.550+0000 7fdd82baa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.614+0000 7fdd82baa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:02:20.835 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.784+0000 7fdd82baa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:02:20.848 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.644+0000 7f4e38b83040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:02:20.848 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.727+0000 7f4e38b83040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:20.848 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.786+0000 7f4e38b83040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:02:20.848 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:20.847+0000 7f4e38b83040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:02:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 -- 172.21.15.17:0/2701174101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 msgr2=0x7fb798100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 --2- 172.21.15.17:0/2701174101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb798100e40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb794009900 tx=0x7fb79402a410 comp rx=0 tx=0).stop 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 -- 172.21.15.17:0/2701174101 shutdown_connections 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 --2- 172.21.15.17:0/2701174101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7981025f0 0x7fb798108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 --2- 172.21.15.17:0/2701174101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb798101c30 0x7fb7981020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 --2- 172.21.15.17:0/2701174101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb798100e40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 -- 172.21.15.17:0/2701174101 >> 172.21.15.17:0/2701174101 conn(0x7fb7980fc1e0 msgr2=0x7fb7980fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 -- 172.21.15.17:0/2701174101 shutdown_connections 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.940+0000 7fb7a0103640 1 -- 172.21.15.17:0/2701174101 wait complete. 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 Processor -- start 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 -- start start 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798101c30 0x7fb79819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 0x7fb79819f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810c570 con 0x7fb798100a40 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810c3f0 con 0x7fb7981025f0 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb7a0103640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810c6f0 con 0x7fb798101c30 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40078/0 (socket says 172.21.15.17:40078) 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 -- 172.21.15.17:0/1865224714 learned_addr learned my addr 172.21.15.17:0/1865224714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79e6a0640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 0x7fb79819f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79d69e640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798101c30 0x7fb79819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798101c30 msgr2=0x7fb79819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798101c30 0x7fb79819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 msgr2=0x7fb79819f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 0x7fb79819f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79de9f640 1 -- 172.21.15.17:0/1865224714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79819f980 con 0x7fb798100a40 2024-09-16T01:02:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.941+0000 7fb79e6a0640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 0x7fb79819f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb79de9f640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb7940314e0 tx=0x7fb794004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79403f030 con 0x7fb798100a40 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb794003aa0 con 0x7fb798100a40 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794035070 con 0x7fb798100a40 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79819fbb0 con 0x7fb798100a40 2024-09-16T01:02:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.942+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7981a00f0 con 0x7fb798100a40 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.943+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb798107e20 con 0x7fb798100a40 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.944+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fb794042030 con 0x7fb798100a40 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.945+0000 7fb78effd640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 0x7fb7840a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.945+0000 7fb79d69e640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 msgr2=0x7fb7840a5880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.945+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7940f0030 con 0x7fb798100a40 2024-09-16T01:02:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.945+0000 7fb79d69e640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 0x7fb7840a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:02:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:20.950+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7940bc6b0 con 0x7fb798100a40 2024-09-16T01:02:21.097 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.853+0000 7fdd82baa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:02:21.098 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:20.925+0000 7fdd82baa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:02:21.098 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:21.032+0000 7fdd82baa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:02:21.098 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:21.096+0000 7fdd82baa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:02:21.142 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:20.821+0000 7f2d3032a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:02:21.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.146+0000 7fb79d69e640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 msgr2=0x7fb7840a5880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:21.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.146+0000 7fb79d69e640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 0x7fb7840a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:02:21.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.188+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fb798062df0 con 0x7fb798100a40 2024-09-16T01:02:21.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.239+0000 7fb78effd640 1 -- 172.21.15.17:0/1865224714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fb7940c09b0 con 0x7fb798100a40 2024-09-16T01:02:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 msgr2=0x7fb7840a5880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 0x7fb7840a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 msgr2=0x7fb79806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb7940314e0 tx=0x7fb794004270 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 shutdown_connections 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7fb7840a33c0 0x7fb7840a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7981025f0 0x7fb79819f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798101c30 0x7fb79819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 --2- 172.21.15.17:0/1865224714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb798100a40 0x7fb79806a410 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 >> 172.21.15.17:0/1865224714 conn(0x7fb7980fc1e0 msgr2=0x7fb798104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 shutdown_connections 2024-09-16T01:02:21.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.242+0000 7fb7a0103640 1 -- 172.21.15.17:0/1865224714 wait complete. 2024-09-16T01:02:21.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-16T01:02:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 -- 172.21.15.17:0/1263334096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 msgr2=0x7f45ec1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 --2- 172.21.15.17:0/1263334096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec1020b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009900 tx=0x7f45d802a410 comp rx=0 tx=0).stop 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 -- 172.21.15.17:0/1263334096 shutdown_connections 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 --2- 172.21.15.17:0/1263334096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45ec1025f0 0x7f45ec108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 --2- 172.21.15.17:0/1263334096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec1020b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 --2- 172.21.15.17:0/1263334096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 -- 172.21.15.17:0/1263334096 >> 172.21.15.17:0/1263334096 conn(0x7f45ec0fc1e0 msgr2=0x7f45ec0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 -- 172.21.15.17:0/1263334096 shutdown_connections 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.361+0000 7f45f31e4640 1 -- 172.21.15.17:0/1263334096 wait complete. 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 Processor -- start 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 -- start start 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45ec1025f0 0x7f45ec1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec10c550 con 0x7f45ec101c30 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec10c3d0 con 0x7f45ec100a40 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f31e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec10c6d0 con 0x7f45ec1025f0 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f0f80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f0f80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:58778/0 (socket says 172.21.15.17:58778) 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40104/0 (socket says 172.21.15.17:40104) 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f0f80640 1 -- 172.21.15.17:0/2296898108 learned_addr learned my addr 172.21.15.17:0/2296898108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.362+0000 7f45f1781640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45ec1025f0 0x7f45ec1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45ec1025f0 msgr2=0x7f45ec1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45ec1025f0 0x7f45ec1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 msgr2=0x7f45ec19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec1a1b20 con 0x7f45ec100a40 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45ec101c30 0x7f45ec19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f0f80640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec199f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e000e9c0 tx=0x7f45e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e000cd80 con 0x7f45ec100a40 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45e00035f0 con 0x7f45ec100a40 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec1a1e10 con 0x7f45ec100a40 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0010690 con 0x7f45ec100a40 2024-09-16T01:02:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.363+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec1a2270 con 0x7f45ec100a40 2024-09-16T01:02:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.364+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec1a2500 con 0x7f45ec100a40 2024-09-16T01:02:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.365+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f45e00037a0 con 0x7f45ec100a40 2024-09-16T01:02:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.366+0000 7f45e9ffb640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 0x7f45dc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.366+0000 7f45ebfff640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 msgr2=0x7f45dc0a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.366+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45e00cfd30 con 0x7f45ec100a40 2024-09-16T01:02:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.366+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 0x7f45dc0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:02:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.370+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e009ca00 con 0x7f45ec100a40 2024-09-16T01:02:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:21 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-16T01:02:21.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:21.158+0000 7fdd82baa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:02:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.567+0000 7f45ebfff640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 msgr2=0x7f45dc0a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.567+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 0x7f45dc0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:02:21.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.573+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f45ec069fe0 con 0x7f45dc0a3340 2024-09-16T01:02:21.615 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:21 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-16T01:02:21.644 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:21 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-16T01:02:21.892 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:02:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y[35488]: 2024-09-16T01:02:21.614+0000 7f2d3032a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:02:21.903 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:02:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z[36507]: 2024-09-16T01:02:21.643+0000 7f4e38b83040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:02:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.968+0000 7f45ebfff640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 msgr2=0x7f45dc0a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/333607551 2024-09-16T01:02:21.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:21.968+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 0x7f45dc0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:02:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:22.015+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f45e0098970 con 0x7f45ec100a40 2024-09-16T01:02:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:22.015+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 msgr2=0x7f45dc0a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:02:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:22.015+0000 7f45e9ffb640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/333607551,v1:172.21.15.17:6801/333607551] conn(0x7f45dc0a3340 0x7f45dc0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:02:22.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Standby manager daemon y restarted 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Standby manager daemon y started 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Standby manager daemon z restarted 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Standby manager daemon z started 2024-09-16T01:02:22.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Active manager daemon x restarted 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Activating manager daemon x 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: mgrmap e20: x(active, starting, since 0.010786s), standbys: z, y 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:02:22.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:02:22.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:02:22.257 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:02:22.258 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.001+0000 7fdd82baa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Standby manager daemon y restarted 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Standby manager daemon y started 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Standby manager daemon z restarted 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Standby manager daemon z started 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Active manager daemon x restarted 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Activating manager daemon x 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: mgrmap e20: x(active, starting, since 0.010786s), standbys: z, y 2024-09-16T01:02:22.522 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:02:22.523 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:02:22.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:02:22.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:02:22.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: Manager daemon x is now available 2024-09-16T01:02:22.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:22.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:02:22.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:22 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:02:22.526 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:02:22.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: Manager daemon x is now available 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.265+0000 7fdced1c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.265+0000 7fdced1c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.265+0000 7fdced1c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.265+0000 7fdced1c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.528 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.265+0000 7fdced1c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.529 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.268+0000 7fdce8979640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.529 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.268+0000 7fdce8979640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.529 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.268+0000 7fdce8979640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.529 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.268+0000 7fdce8979640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.529 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:22.268+0000 7fdce8979640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1865224714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Standby manager daemon y restarted 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Standby manager daemon y started 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.88:0/2819879655' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Standby manager daemon z restarted 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Standby manager daemon z started 2024-09-16T01:02:22.531 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.? 172.21.15.154:0/93111726' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Active manager daemon x restarted 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Activating manager daemon x 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: mgrmap e20: x(active, starting, since 0.010786s), standbys: z, y 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:02:22.532 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:02:22.534 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: Manager daemon x is now available 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:02:22.535 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:22 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.019+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mon.2 v2:172.21.15.88:3300/0 8 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f45e00cd860 con 0x7f45ec100a40 2024-09-16T01:02:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.019+0000 7f45e9ffb640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45dc06b200 0x7f45dc06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.019+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f45e0009030 con 0x7f45dc06b200 2024-09-16T01:02:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.022+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45dc06b200 0x7f45dc06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.023+0000 7f45ebfff640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45dc06b200 0x7f45dc06b5e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45d8006010 tx=0x7f45d8000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.040+0000 7f45e9ffb640 1 -- 172.21.15.17:0/2296898108 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f45e0009030 con 0x7f45dc06b200 2024-09-16T01:02:23.041 INFO:teuthology.orchestra.run.smithi017.stdout:{} 2024-09-16T01:02:23.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45dc06b200 msgr2=0x7f45dc06b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45dc06b200 0x7f45dc06b5e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45d8006010 tx=0x7f45d8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 msgr2=0x7f45ec199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 --2- 172.21.15.17:0/2296898108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45ec100a40 0x7f45ec199f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e000e9c0 tx=0x7f45e000ee80 comp rx=0 tx=0).stop 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f1781640 1 -- 172.21.15.17:0/2296898108 reap_dead start 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 shutdown_connections 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 >> 172.21.15.17:0/2296898108 conn(0x7f45ec0fc1e0 msgr2=0x7f45ec0698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 shutdown_connections 2024-09-16T01:02:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.042+0000 7f45f31e4640 1 -- 172.21.15.17:0/2296898108 wait complete. 2024-09-16T01:02:23.055 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-16T01:02:23.066 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T01:02:23.074 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:02:23.074 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:02:23.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-16T01:02:23.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 -- 172.21.15.17:0/2023421693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4107880 msgr2=0x7f19e4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/2023421693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4107880 0x7f19e4109c90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009ca0 tx=0x7f19dc02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 -- 172.21.15.17:0/2023421693 shutdown_connections 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/2023421693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4107880 0x7f19e4109c90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/2023421693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4104f50 0x7f19e4107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/2023421693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 0x7f19e4104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 -- 172.21.15.17:0/2023421693 >> 172.21.15.17:0/2023421693 conn(0x7f19e40fc1e0 msgr2=0x7f19e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 -- 172.21.15.17:0/2023421693 shutdown_connections 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.179+0000 7f19ec2c0640 1 -- 172.21.15.17:0/2023421693 wait complete. 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 Processor -- start 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 -- start start 2024-09-16T01:02:23.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 0x7f19e4101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 0x7f19e4100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19e410d6e0 con 0x7f19e4104f50 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f19e410d560 con 0x7f19e4107880 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ec2c0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19e410d860 con 0x7f19e4102620 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40242/0 (socket says 172.21.15.17:40242) 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 -- 172.21.15.17:0/4169564507 learned_addr learned my addr 172.21.15.17:0/4169564507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ea05c640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 0x7f19e4101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ea85d640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 0x7f19e4100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 -- 172.21.15.17:0/4169564507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 msgr2=0x7f19e4101f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 0x7f19e4101f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 -- 172.21.15.17:0/4169564507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 msgr2=0x7f19e4100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 0x7f19e4100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 -- 172.21.15.17:0/4169564507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e41013a0 con 0x7f19e4104f50 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19ea85d640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 0x7f19e4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.180+0000 7f19e985b640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f19d4005fd0 tx=0x7f19d400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.181+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4017070 con 0x7f19e4104f50 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.181+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19d4009c30 con 0x7f19e4104f50 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.181+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e41a1e30 con 0x7f19e4104f50 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.181+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4003d40 con 0x7f19e4104f50 2024-09-16T01:02:23.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.181+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e41a2290 con 0x7f19e4104f50 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.182+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e40fdcd0 con 0x7f19e4104f50 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.184+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f19d4003ee0 con 0x7f19e4104f50 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.184+0000 7f19db7fe640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 0x7f19d00a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.185+0000 7f19ea05c640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 0x7f19d00a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.185+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f19d40cf960 con 0x7f19e4104f50 2024-09-16T01:02:23.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.185+0000 7f19ea05c640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 0x7f19d00a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009bd0 tx=0x7f19e0005f90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.188+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19d4020030 con 0x7f19e4104f50 2024-09-16T01:02:23.396 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:23.031+0000 7fdce7176640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:23.396 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:23.031+0000 7fdce7176640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:23.396 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:23.031+0000 7fdce7176640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:23.396 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:23.031+0000 7fdce7176640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:23.396 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:23.031+0000 7fdce7176640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:02:23.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.423+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f19e4062fa0 con 0x7f19e4104f50 2024-09-16T01:02:23.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.427+0000 7f19db7fe640 1 -- 172.21.15.17:0/4169564507 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f19d409c880 con 0x7f19e4104f50 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 msgr2=0x7f19d00a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 0x7f19d00a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009bd0 tx=0x7f19e0005f90 comp rx=0 tx=0).stop 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 msgr2=0x7f19e41005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f19d4005fd0 tx=0x7f19d400dde0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 shutdown_connections 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f19d00a3100 0x7f19d00a55c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e4107880 0x7f19e4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19e4104f50 0x7f19e41005d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 --2- 172.21.15.17:0/4169564507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19e4102620 0x7f19e4101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 >> 172.21.15.17:0/4169564507 conn(0x7f19e40fc1e0 msgr2=0x7f19e4102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 shutdown_connections 2024-09-16T01:02:23.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.429+0000 7f19ec2c0640 1 -- 172.21.15.17:0/4169564507 wait complete. 2024-09-16T01:02:23.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 -- 172.21.15.17:0/411416959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 msgr2=0x7f4c10100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 --2- 172.21.15.17:0/411416959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10100e40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009900 tx=0x7f4c0c02a410 comp rx=0 tx=0).stop 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 -- 172.21.15.17:0/411416959 shutdown_connections 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 --2- 172.21.15.17:0/411416959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c10108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 --2- 172.21.15.17:0/411416959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 0x7f4c101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 --2- 172.21.15.17:0/411416959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10100e40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 -- 172.21.15.17:0/411416959 >> 172.21.15.17:0/411416959 conn(0x7f4c100fc1e0 msgr2=0x7f4c100fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 -- 172.21.15.17:0/411416959 shutdown_connections 2024-09-16T01:02:23.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.549+0000 7f4c17711640 1 -- 172.21.15.17:0/411416959 wait complete. 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 Processor -- start 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 -- start start 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 0x7f4c10197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c1019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1010c570 con 0x7f4c10100a40 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1010c3f0 con 0x7f4c101025f0 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c17711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1010c6f0 con 0x7f4c10101c30 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c154ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c154ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40258/0 (socket says 172.21.15.17:40258) 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c154ad640 1 -- 172.21.15.17:0/83379461 learned_addr learned my addr 172.21.15.17:0/83379461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c14cac640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 0x7f4c10197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.550+0000 7f4c15cae640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c1019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 -- 172.21.15.17:0/83379461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 msgr2=0x7f4c10197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 0x7f4c10197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 -- 172.21.15.17:0/83379461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 msgr2=0x7f4c1019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c1019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 -- 172.21.15.17:0/83379461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1019e830 con 0x7f4c10100a40 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c15cae640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c1019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c154ad640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0314e0 tx=0x7f4c0c031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c03f030 con 0x7f4c10100a40 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c0c0044b0 con 0x7f4c10100a40 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1019eac0 con 0x7f4c10100a40 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c035070 con 0x7f4c10100a40 2024-09-16T01:02:23.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.551+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1019f000 con 0x7f4c10100a40 2024-09-16T01:02:23.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.552+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c10107dd0 con 0x7f4c10100a40 2024-09-16T01:02:23.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.553+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f4c0c042030 con 0x7f4c10100a40 2024-09-16T01:02:23.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.554+0000 7f4c067fc640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 0x7f4bfc0a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.554+0000 7f4c14cac640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 0x7f4bfc0a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.554+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4c0c0efba0 con 0x7f4c10100a40 2024-09-16T01:02:23.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.554+0000 7f4c14cac640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 0x7f4bfc0a5640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005fd0 tx=0x7f4c0000b390 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.558+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c0c0bca80 con 0x7f4c10100a40 2024-09-16T01:02:23.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.749+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f4c10062df0 con 0x7f4c10100a40 2024-09-16T01:02:23.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.753+0000 7f4c067fc640 1 -- 172.21.15.17:0/83379461 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f4c0c0bc380 con 0x7f4c10100a40 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 msgr2=0x7f4bfc0a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 0x7f4bfc0a5640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005fd0 tx=0x7f4c0000b390 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 msgr2=0x7f4c10196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0314e0 tx=0x7f4c0c031a30 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 shutdown_connections 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f4bfc0a3180 0x7f4bfc0a5640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c101025f0 0x7f4c1019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c10101c30 0x7f4c10197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 --2- 172.21.15.17:0/83379461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c10100a40 0x7f4c10196c20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 >> 172.21.15.17:0/83379461 conn(0x7f4c100fc1e0 msgr2=0x7f4c10104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.756+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 shutdown_connections 2024-09-16T01:02:23.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.757+0000 7f4c17711640 1 -- 172.21.15.17:0/83379461 wait complete. 2024-09-16T01:02:23.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.882+0000 7fc8f3e01640 1 -- 172.21.15.17:0/1447228952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec100a40 msgr2=0x7fc8ec100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.882+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/1447228952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec100a40 0x7fc8ec100e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009900 tx=0x7fc8e802a410 comp rx=0 tx=0).stop 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.882+0000 7fc8f3e01640 1 -- 172.21.15.17:0/1447228952 shutdown_connections 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.882+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/1447228952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.882+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/1447228952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec101c30 0x7fc8ec1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/1447228952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec100a40 0x7fc8ec100e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 -- 172.21.15.17:0/1447228952 >> 172.21.15.17:0/1447228952 conn(0x7fc8ec0fc1e0 msgr2=0x7fc8ec0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 -- 172.21.15.17:0/1447228952 shutdown_connections 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 -- 172.21.15.17:0/1447228952 wait complete. 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 Processor -- start 2024-09-16T01:02:23.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 -- start start 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.883+0000 7fc8f3e01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec100a40 0x7fc8ec06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10c570 con 0x7fc8ec1025f0 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10c3f0 con 0x7fc8ec101c30 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec10c6f0 con 0x7fc8ec100a40 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f139c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40264/0 (socket says 172.21.15.17:40264) 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f139c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:58944/0 (socket says 172.21.15.17:58944) 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f1b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec100a40 0x7fc8ec06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 -- 172.21.15.17:0/2693549524 learned_addr learned my addr 172.21.15.17:0/2693549524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 -- 172.21.15.17:0/2693549524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec100a40 msgr2=0x7fc8ec06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec100a40 0x7fc8ec06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 -- 172.21.15.17:0/2693549524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 msgr2=0x7fc8ec19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 -- 172.21.15.17:0/2693549524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec19f9a0 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f139c640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f239e640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400efd0 tx=0x7fc8e400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4003b70 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec19fc30 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8e4003d10 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.884+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4010980 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.885+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec1a0180 con 0x7fc8ec1025f0 2024-09-16T01:02:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.886+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ec107e80 con 0x7fc8ec1025f0 2024-09-16T01:02:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.887+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fc8e4004b40 con 0x7fc8ec1025f0 2024-09-16T01:02:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.888+0000 7fc8e2ffd640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 0x7fc8d80a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.888+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc8e40cfd90 con 0x7fc8ec1025f0 2024-09-16T01:02:23.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.888+0000 7fc8f1b9d640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 0x7fc8d80a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.888+0000 7fc8f1b9d640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 0x7fc8d80a55c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8004770 tx=0x7fc8e8000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:23.891+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8e409ccb0 con 0x7fc8ec1025f0 2024-09-16T01:02:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.101+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fc8ec02d7c0 con 0x7fc8ec1025f0 2024-09-16T01:02:24.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.108+0000 7fc8e2ffd640 1 -- 172.21.15.17:0/2693549524 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7fc8e409c5b0 con 0x7fc8ec1025f0 2024-09-16T01:02:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 msgr2=0x7fc8d80a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 0x7fc8d80a55c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8004770 tx=0x7fc8e8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 msgr2=0x7fc8ec19f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400efd0 tx=0x7fc8e400c6a0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 shutdown_connections 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc8d80a3100 0x7fc8d80a55c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ec1025f0 0x7fc8ec19f090 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8ec101c30 0x7fc8ec19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 --2- 172.21.15.17:0/2693549524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8ec100a40 0x7fc8ec06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 >> 172.21.15.17:0/2693549524 conn(0x7fc8ec0fc1e0 msgr2=0x7fc8ec105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 shutdown_connections 2024-09-16T01:02:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.112+0000 7fc8f3e01640 1 -- 172.21.15.17:0/2693549524 wait complete. 2024-09-16T01:02:24.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:24 smithi017 ceph-mon[31211]: mgrmap e21: x(active, since 1.01621s), standbys: z, y 2024-09-16T01:02:24.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:24 smithi017 ceph-mon[31211]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:24.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:24 smithi017 ceph-mon[31211]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:24.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:24 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4169564507' entity='client.admin' 2024-09-16T01:02:24.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:24 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/83379461' entity='client.admin' 2024-09-16T01:02:24.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 -- 172.21.15.17:0/621211180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 msgr2=0x7f92d41049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 --2- 172.21.15.17:0/621211180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d41049b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009900 tx=0x7f92d002a410 comp rx=0 tx=0).stop 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 -- 172.21.15.17:0/621211180 shutdown_connections 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 --2- 172.21.15.17:0/621211180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4107820 0x7f92d4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 --2- 172.21.15.17:0/621211180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4104ef0 0x7f92d41072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 --2- 172.21.15.17:0/621211180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d41049b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 -- 172.21.15.17:0/621211180 >> 172.21.15.17:0/621211180 conn(0x7f92d40fc1e0 msgr2=0x7f92d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 -- 172.21.15.17:0/621211180 shutdown_connections 2024-09-16T01:02:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.244+0000 7f92dc39f640 1 -- 172.21.15.17:0/621211180 wait complete. 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 Processor -- start 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 -- start start 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4104ef0 0x7f92d4100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 0x7f92d4100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f92d410d6b0 con 0x7f92d41025c0 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92d410d530 con 0x7f92d4107820 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92dc39f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92d410d830 con 0x7f92d4104ef0 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92da13b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92da93c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 0x7f92d4100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92da13b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40292/0 (socket says 172.21.15.17:40292) 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92da13b640 1 -- 172.21.15.17:0/127671050 learned_addr learned my addr 172.21.15.17:0/127671050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.245+0000 7f92d993a640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4104ef0 0x7f92d4100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 -- 172.21.15.17:0/127671050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4104ef0 msgr2=0x7f92d4100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4104ef0 0x7f92d4100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 -- 172.21.15.17:0/127671050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 msgr2=0x7f92d4100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 0x7f92d4100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 -- 172.21.15.17:0/127671050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d4101340 con 0x7f92d41025c0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da93c640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 0x7f92d4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92da13b640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f92d0005940 tx=0x7f92d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d003f030 con 0x7f92d41025c0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92d0003cb0 con 0x7f92d41025c0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d41a1e50 con 0x7f92d41025c0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0035070 con 0x7f92d41025c0 2024-09-16T01:02:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.246+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d41a2260 con 0x7f92d41025c0 2024-09-16T01:02:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.247+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d40fdcd0 con 0x7f92d41025c0 2024-09-16T01:02:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.249+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f92d0042030 con 0x7f92d41025c0 2024-09-16T01:02:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.250+0000 7f92cb7fe640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 0x7f92c00a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.250+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92d00efb00 con 0x7f92d41025c0 2024-09-16T01:02:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.250+0000 7f92d993a640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 0x7f92c00a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.251+0000 7f92d993a640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 0x7f92c00a55c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92d4101ca0 tx=0x7f92c4005f90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.254+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92d00bc390 con 0x7f92d41025c0 2024-09-16T01:02:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:24 smithi088 ceph-mon[34093]: mgrmap e21: x(active, since 1.01621s), standbys: z, y 2024-09-16T01:02:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:24 smithi088 ceph-mon[34093]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:24 smithi088 ceph-mon[34093]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:24 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4169564507' entity='client.admin' 2024-09-16T01:02:24.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:24 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/83379461' entity='client.admin' 2024-09-16T01:02:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:24 smithi154 ceph-mon[34759]: mgrmap e21: x(active, since 1.01621s), standbys: z, y 2024-09-16T01:02:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:24 smithi154 ceph-mon[34759]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:24.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:24 smithi154 ceph-mon[34759]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:24.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:24 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4169564507' entity='client.admin' 2024-09-16T01:02:24.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:24 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/83379461' entity='client.admin' 2024-09-16T01:02:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.533+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f92d4062630 con 0x7f92c00a3100 2024-09-16T01:02:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.619+0000 7f92cb7fe640 1 -- 172.21.15.17:0/127671050 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f92d4062630 con 0x7f92c00a3100 2024-09-16T01:02:24.622 INFO:teuthology.orchestra.run.smithi017.stdout:Schedule set for path / 2024-09-16T01:02:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 msgr2=0x7f92c00a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 0x7f92c00a55c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92d4101ca0 tx=0x7f92c4005f90 comp rx=0 tx=0).stop 2024-09-16T01:02:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 msgr2=0x7f92d4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f92d0005940 tx=0x7f92d00042f0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 shutdown_connections 2024-09-16T01:02:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.621+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92c00a3100 0x7f92c00a55c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4107820 0x7f92d4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92d4104ef0 0x7f92d4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 --2- 172.21.15.17:0/127671050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92d41025c0 0x7f92d4101f30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 >> 172.21.15.17:0/127671050 conn(0x7f92d40fc1e0 msgr2=0x7f92d4102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 shutdown_connections 2024-09-16T01:02:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.622+0000 7f92dc39f640 1 -- 172.21.15.17:0/127671050 wait complete. 2024-09-16T01:02:24.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 -- 172.21.15.17:0/3230599516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68641025c0 msgr2=0x7f68641049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 --2- 172.21.15.17:0/3230599516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68641025c0 0x7f68641049b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6854009900 tx=0x7f685402a410 comp rx=0 tx=0).stop 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 -- 172.21.15.17:0/3230599516 shutdown_connections 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 --2- 172.21.15.17:0/3230599516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6864107820 0x7f6864109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 --2- 172.21.15.17:0/3230599516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 0x7f68641072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 --2- 172.21.15.17:0/3230599516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68641025c0 0x7f68641049b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.743+0000 7f686881e640 1 -- 172.21.15.17:0/3230599516 >> 172.21.15.17:0/3230599516 conn(0x7f68640fc1e0 msgr2=0x7f68640fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- 172.21.15.17:0/3230599516 shutdown_connections 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- 172.21.15.17:0/3230599516 wait complete. 2024-09-16T01:02:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 Processor -- start 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- start start 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68641025c0 0x7f6864197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 0x7f68641982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f686410d6e0 con 0x7f6864107820 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f686410d560 con 0x7f6864104ef0 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.744+0000 7f686881e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f686410d860 con 0x7f68641025c0 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40304/0 (socket says 172.21.15.17:40304) 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6861d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 0x7f68641982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 -- 172.21.15.17:0/2465047330 learned_addr learned my addr 172.21.15.17:0/2465047330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f686259c640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68641025c0 0x7f6864197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 -- 172.21.15.17:0/2465047330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68641025c0 msgr2=0x7f6864197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68641025c0 0x7f6864197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 -- 172.21.15.17:0/2465047330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 msgr2=0x7f68641982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 0x7f68641982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 -- 172.21.15.17:0/2465047330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686419f9c0 con 0x7f6864107820 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f6862d9d640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f685c00eb40 tx=0x7f685c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c004b20 con 0x7f6864107820 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f685c004cc0 con 0x7f6864107820 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686419fcb0 con 0x7f6864107820 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0107b0 con 0x7f6864107820 2024-09-16T01:02:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.745+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68641a01b0 con 0x7f6864107820 2024-09-16T01:02:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.746+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68640fdcd0 con 0x7f6864107820 2024-09-16T01:02:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.748+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f685c005000 con 0x7f6864107820 2024-09-16T01:02:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.748+0000 7f68537fe640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 0x7f684c0a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.748+0000 7f686259c640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 0x7f684c0a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.749+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f685c0cfdb0 con 0x7f6864107820 2024-09-16T01:02:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.749+0000 7f686259c640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 0x7f684c0a55c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6864199280 tx=0x7f6854000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:24.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.756+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f685c09ccd0 con 0x7f6864107820 2024-09-16T01:02:24.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.768+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7f685c098bb0 con 0x7f6864107820 2024-09-16T01:02:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:24.999+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f68640626d0 con 0x7f684c0a3100 2024-09-16T01:02:25.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.065+0000 7f68537fe640 1 -- 172.21.15.17:0/2465047330 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f68640626d0 con 0x7f684c0a3100 2024-09-16T01:02:25.067 INFO:teuthology.orchestra.run.smithi017.stdout:Retention added to path / 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 msgr2=0x7f684c0a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 0x7f684c0a55c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6864199280 tx=0x7f6854000bc0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 msgr2=0x7f686419f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f685c00eb40 tx=0x7f685c00c2d0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 shutdown_connections 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f684c0a3100 0x7f684c0a55c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864107820 0x7f686419f320 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6864104ef0 0x7f68641982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 --2- 172.21.15.17:0/2465047330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68641025c0 0x7f6864197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.067+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 >> 172.21.15.17:0/2465047330 conn(0x7f68640fc1e0 msgr2=0x7f6864102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.068+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 shutdown_connections 2024-09-16T01:02:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.068+0000 7f686881e640 1 -- 172.21.15.17:0/2465047330 wait complete. 2024-09-16T01:02:25.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-16T01:02:25.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 -- 172.21.15.17:0/3997689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440101b60 msgr2=0x7fa440101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 --2- 172.21.15.17:0/3997689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440101b60 0x7fa440101f60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa430009900 tx=0x7fa43002a410 comp rx=0 tx=0).stop 2024-09-16T01:02:25.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 -- 172.21.15.17:0/3997689639 shutdown_connections 2024-09-16T01:02:25.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 --2- 172.21.15.17:0/3997689639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa440109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 --2- 172.21.15.17:0/3997689639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440102d50 0x7fa4401031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 --2- 172.21.15.17:0/3997689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440101b60 0x7fa440101f60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 -- 172.21.15.17:0/3997689639 >> 172.21.15.17:0/3997689639 conn(0x7fa4400fd2e0 msgr2=0x7fa4400ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 -- 172.21.15.17:0/3997689639 shutdown_connections 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.187+0000 7fa445dc4640 1 -- 172.21.15.17:0/3997689639 wait complete. 2024-09-16T01:02:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.188+0000 7fa445dc4640 1 Processor -- start 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.188+0000 7fa445dc4640 1 -- start start 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440101b60 0x7fa440197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 0x7fa4401981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d670 con 0x7fa440102d50 2024-09-16T01:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d4f0 con 0x7fa440103710 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa445dc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d7f0 con 0x7fa440101b60 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 0x7fa4401981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 0x7fa4401981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40326/0 (socket says 172.21.15.17:40326) 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:59024/0 (socket says 172.21.15.17:59024) 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43effd640 1 -- 172.21.15.17:0/2959793471 learned_addr learned my addr 172.21.15.17:0/2959793471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43f7fe640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440101b60 0x7fa440197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 -- 172.21.15.17:0/2959793471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440101b60 msgr2=0x7fa440197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440101b60 0x7fa440197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 -- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 msgr2=0x7fa4401981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 0x7fa4401981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 -- 172.21.15.17:0/2959793471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44019f8d0 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.189+0000 7fa43ffff640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa438009fd0 tx=0x7fa43800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.190+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43800ce20 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.190+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa438005020 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.190+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44019fbc0 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.190+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438010690 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.190+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4401a00e0 con 0x7fa440103710 2024-09-16T01:02:25.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.191+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa440108ea0 con 0x7fa440103710 2024-09-16T01:02:25.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.192+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7fa438004b20 con 0x7fa440103710 2024-09-16T01:02:25.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.193+0000 7fa43cff9640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 0x7fa4280a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.193+0000 7fa43f7fe640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 0x7fa4280a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.193+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa4380d0500 con 0x7fa440103710 2024-09-16T01:02:25.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.194+0000 7fa43f7fe640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 0x7fa4280a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa430004770 tx=0x7fa430000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:25.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.197+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa43809cd40 con 0x7fa440103710 2024-09-16T01:02:25.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2693549524' entity='client.admin' 2024-09-16T01:02:25.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.396 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.397 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.398 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.398 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:25.398 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:25 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:25.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.399+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fa440062630 con 0x7fa4280a3580 2024-09-16T01:02:25.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2693549524' entity='client.admin' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:02:25.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.406 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.407 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:25.407 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:25 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:25.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.407+0000 7fa43cff9640 1 -- 172.21.15.17:0/2959793471 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fa440062630 con 0x7fa4280a3580 2024-09-16T01:02:25.409 INFO:teuthology.orchestra.run.smithi017.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-16T00:00:00", "created": "2024-09-16T01:02:24", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-16T01:02:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 msgr2=0x7fa4280a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 0x7fa4280a5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa430004770 tx=0x7fa430000bc0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 msgr2=0x7fa44019f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa438009fd0 tx=0x7fa43800ef10 comp rx=0 tx=0).stop 2024-09-16T01:02:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 shutdown_connections 2024-09-16T01:02:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa4280a3580 0x7fa4280a5a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa440103710 0x7fa44019f230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa440102d50 0x7fa4401981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 --2- 172.21.15.17:0/2959793471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa440101b60 0x7fa440197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 >> 172.21.15.17:0/2959793471 conn(0x7fa4400fd2e0 msgr2=0x7fa440106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 shutdown_connections 2024-09-16T01:02:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.409+0000 7fa445dc4640 1 -- 172.21.15.17:0/2959793471 wait complete. 2024-09-16T01:02:25.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2693549524' entity='client.admin' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:02:25.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:25.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:25 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:25.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 -- 172.21.15.17:0/275997005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 msgr2=0x7f2f2410a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/275997005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2410a030 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009ca0 tx=0x7f2f1c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 -- 172.21.15.17:0/275997005 shutdown_connections 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/275997005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2410a030 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/275997005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/275997005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 -- 172.21.15.17:0/275997005 >> 172.21.15.17:0/275997005 conn(0x7f2f240fb930 msgr2=0x7f2f240fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 -- 172.21.15.17:0/275997005 shutdown_connections 2024-09-16T01:02:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.535+0000 7f2f29a3c640 1 -- 172.21.15.17:0/275997005 wait complete. 2024-09-16T01:02:25.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 Processor -- start 2024-09-16T01:02:25.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 -- start start 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.536+0000 7f2f29a3c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2410d6e0 con 0x7f2f241037a0 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f29a3c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2410d560 con 0x7f2f24102de0 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f29a3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2410d860 con 0x7f2f240ffe10 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40342/0 (socket says 172.21.15.17:40342) 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f237fe640 1 -- 172.21.15.17:0/2431561114 learned_addr learned my addr 172.21.15.17:0/2431561114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f22ffd640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 -- 172.21.15.17:0/2431561114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 msgr2=0x7f2f24197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 -- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 msgr2=0x7f2f2419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 -- 172.21.15.17:0/2431561114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2419f940 con 0x7f2f24102de0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f22ffd640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f237fe640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.537+0000 7f2f227fc640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24198270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800d6d0 tx=0x7f2f1800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.538+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18017070 con 0x7f2f24102de0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.538+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2419fc30 con 0x7f2f24102de0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.538+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f18009820 con 0x7f2f24102de0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.538+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004c40 con 0x7f2f24102de0 2024-09-16T01:02:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.538+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241a01d0 con 0x7f2f24102de0 2024-09-16T01:02:25.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.539+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24108f90 con 0x7f2f24102de0 2024-09-16T01:02:25.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.541+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7f2f18005220 con 0x7f2f24102de0 2024-09-16T01:02:25.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.541+0000 7f2f28a3a640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 0x7f2f0c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:25.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.542+0000 7f2f22ffd640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 0x7f2f0c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:25.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.542+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2f180cf990 con 0x7f2f24102de0 2024-09-16T01:02:25.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.542+0000 7f2f22ffd640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 0x7f2f0c0a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f24199200 tx=0x7f2f14005f90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:25.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.546+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mon.2 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f1809bbe0 con 0x7f2f24102de0 2024-09-16T01:02:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.780+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2f24062630 con 0x7f2f0c0a3500 2024-09-16T01:02:25.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.788+0000 7f2f28a3a640 1 -- 172.21.15.17:0/2431561114 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2f24062630 con 0x7f2f0c0a3500 2024-09-16T01:02:25.789 INFO:teuthology.orchestra.run.smithi017.stdout:/ 1m 6m3h 2024-09-16T01:02:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 msgr2=0x7f2f0c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 0x7f2f0c0a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f24199200 tx=0x7f2f14005f90 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 msgr2=0x7f2f24198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24198270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800d6d0 tx=0x7f2f1800db90 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 shutdown_connections 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f2f0c0a3500 0x7f2f0c0a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f241037a0 0x7f2f2419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f24102de0 0x7f2f24198270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 --2- 172.21.15.17:0/2431561114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f240ffe10 0x7f2f24197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 >> 172.21.15.17:0/2431561114 conn(0x7f2f240fb930 msgr2=0x7f2f24106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 shutdown_connections 2024-09-16T01:02:25.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:02:25.790+0000 7f2f29a3c640 1 -- 172.21.15.17:0/2431561114 wait complete. 2024-09-16T01:02:25.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-16T01:02:25.835 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-16T01:02:25.845 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-16T01:02:25.854 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:02:25.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-16T01:02:25.878 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T01:02:25.892 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:02:25.892 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T01:02:25.892 INFO:tasks.workunit:timeout=3h 2024-09-16T01:02:25.893 INFO:tasks.workunit:cleanup=True 2024-09-16T01:02:25.893 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-16 01:00:43.870556691 +0000 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-16 01:00:43.870556691 +0000 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-16 01:02:20.711339130 +0000 2024-09-16T01:02:25.913 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-16T01:02:25.914 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:25.915 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T01:02:25.986 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:02:26.042 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T01:02:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:02:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:02:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.189 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:26 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:26 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:02:26.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:02:26.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-16T01:02:26.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi088:/etc/ceph/ceph.conf 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: Updating smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:02:26.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:26.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:26 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:27.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:27 smithi088 ceph-mon[34093]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-16T01:02:27.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:27.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:27.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:27.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:27.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:27 smithi154 ceph-mon[34759]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-16T01:02:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:02:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-mon[31211]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:27.156+0000 7fdcc7af8640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:01:02:27] ENGINE Error in HTTPServer.serve 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: Traceback (most recent call last): 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._run(expiration_interval) 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:02:27.438 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self.do_handshake() 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:02:27.439 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:02:27 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: [16/Sep/2024:01:02:26] ENGINE Bus STARTING 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: [16/Sep/2024:01:02:27] ENGINE Serving on http://172.21.15.17:8765 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: [16/Sep/2024:01:02:27] ENGINE Serving on https://172.21.15.17:7150 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: [16/Sep/2024:01:02:27] ENGINE Bus STARTED 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: [16/Sep/2024:01:02:27] ENGINE Error in HTTPServer.serve 2024-09-16T01:02:28.393 INFO:journalctl@ceph.mon.b.smithi088.stdout: Traceback (most recent call last): 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: self._run(expiration_interval) 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: s = self.context.wrap_socket( 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: return self.sslsocket_class._create( 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:02:28.394 INFO:journalctl@ceph.mon.b.smithi088.stdout: self.do_handshake() 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout: self._sslobj.do_handshake() 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:28.395 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:28.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: [16/Sep/2024:01:02:26] ENGINE Bus STARTING 2024-09-16T01:02:28.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: [16/Sep/2024:01:02:27] ENGINE Serving on http://172.21.15.17:8765 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: [16/Sep/2024:01:02:27] ENGINE Serving on https://172.21.15.17:7150 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: [16/Sep/2024:01:02:27] ENGINE Bus STARTED 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: [16/Sep/2024:01:02:27] ENGINE Error in HTTPServer.serve 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: Traceback (most recent call last): 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: self._run(expiration_interval) 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:02:28.404 INFO:journalctl@ceph.mon.c.smithi154.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: s = self.context.wrap_socket( 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: return self.sslsocket_class._create( 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: self.do_handshake() 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: self._sslobj.do_handshake() 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:28.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:28.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: [16/Sep/2024:01:02:26] ENGINE Bus STARTING 2024-09-16T01:02:28.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: [16/Sep/2024:01:02:27] ENGINE Serving on http://172.21.15.17:8765 2024-09-16T01:02:28.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: [16/Sep/2024:01:02:27] ENGINE Serving on https://172.21.15.17:7150 2024-09-16T01:02:28.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: [16/Sep/2024:01:02:27] ENGINE Bus STARTED 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: [16/Sep/2024:01:02:27] ENGINE Error in HTTPServer.serve 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:02:28.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:02:28.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:02:29.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:29 smithi017 ceph-mon[31211]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-16T01:02:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:29 smithi088 ceph-mon[34093]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-16T01:02:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:29 smithi154 ceph-mon[34759]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-16T01:02:31.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:31 smithi017 ceph-mon[31211]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 133 KiB/s wr, 80 op/s 2024-09-16T01:02:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:31 smithi088 ceph-mon[34093]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 133 KiB/s wr, 80 op/s 2024-09-16T01:02:31.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:31 smithi154 ceph-mon[34759]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 133 KiB/s wr, 80 op/s 2024-09-16T01:02:33.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:33 smithi017 ceph-mon[31211]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-16T01:02:33.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:33 smithi088 ceph-mon[34093]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-16T01:02:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:33 smithi154 ceph-mon[34759]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-16T01:02:35.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:35 smithi017 ceph-mon[31211]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 55 op/s 2024-09-16T01:02:35.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:35 smithi088 ceph-mon[34093]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 55 op/s 2024-09-16T01:02:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:35 smithi154 ceph-mon[34759]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 55 op/s 2024-09-16T01:02:37.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:37 smithi017 ceph-mon[31211]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-16T01:02:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:37 smithi088 ceph-mon[34093]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-16T01:02:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:37 smithi154 ceph-mon[34759]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 -- 172.21.15.17:0/585436243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea010c110 msgr2=0x7f1ea010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/585436243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea010c110 0x7f1ea010e590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009ca0 tx=0x7f1e9802a950 comp rx=0 tx=0).stop 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 -- 172.21.15.17:0/585436243 shutdown_connections 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/585436243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea010c110 0x7f1ea010e590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/585436243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea01035e0 0x7f1ea010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/585436243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea0102cc0 0x7f1ea01030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 -- 172.21.15.17:0/585436243 >> 172.21.15.17:0/585436243 conn(0x7f1ea00fc6b0 msgr2=0x7f1ea00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 -- 172.21.15.17:0/585436243 shutdown_connections 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.037+0000 7f1ea72b7640 1 -- 172.21.15.17:0/585436243 wait complete. 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 Processor -- start 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 -- start start 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea0102cc0 0x7f1ea0100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea010c110 0x7f1ea0101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111df0 con 0x7f1ea01035e0 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111c70 con 0x7f1ea0102cc0 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea72b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111f70 con 0x7f1ea010c110 2024-09-16T01:02:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea4852640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea4852640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50092/0 (socket says 172.21.15.17:50092) 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea4852640 1 -- 172.21.15.17:0/429997537 learned_addr learned my addr 172.21.15.17:0/429997537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea5053640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea0102cc0 0x7f1ea0100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.038+0000 7f1ea5854640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea010c110 0x7f1ea0101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 -- 172.21.15.17:0/429997537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea010c110 msgr2=0x7f1ea0101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea010c110 0x7f1ea0101390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 -- 172.21.15.17:0/429997537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea0102cc0 msgr2=0x7f1ea0100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea0102cc0 0x7f1ea0100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 -- 172.21.15.17:0/429997537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea01a6720 con 0x7f1ea01035e0 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea4852640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000d740 tx=0x7f1e9000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1e967fc640 1 -- 172.21.15.17:0/429997537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90017070 con 0x7f1ea01035e0 2024-09-16T01:02:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1e967fc640 1 -- 172.21.15.17:0/429997537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e9000de50 con 0x7f1ea01035e0 2024-09-16T01:02:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea01a6a10 con 0x7f1ea01035e0 2024-09-16T01:02:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1e967fc640 1 -- 172.21.15.17:0/429997537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000f620 con 0x7f1ea01035e0 2024-09-16T01:02:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.039+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea01a6fb0 con 0x7f1ea01035e0 2024-09-16T01:02:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1e967fc640 1 -- 172.21.15.17:0/429997537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f1e90009c30 con 0x7f1ea01035e0 2024-09-16T01:02:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 Processor -- start 2024-09-16T01:02:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 -- start start 2024-09-16T01:02:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f07ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8e6c2f0 con 0x55dfd8f12cb0 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8e14270 con 0x55dfd8f08410 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.042+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8e682b0 con 0x55dfd8f07af0 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea4852640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:38046/0 (socket says 172.21.15.17:38046) 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 -- 172.21.15.17:0/3760290817 learned_addr learned my addr 172.21.15.17:0/3760290817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1e967fc640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 0x7f1e8c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5854640 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f07ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5854640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 0x7f1e8c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 -- 172.21.15.17:0/3760290817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 msgr2=0x55dfd8f07ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f07ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 -- 172.21.15.17:0/3760290817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 msgr2=0x55dfd8f150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 -- 172.21.15.17:0/3760290817 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd8e13340 con 0x55dfd8f08410 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1e967fc640 1 -- 172.21.15.17:0/429997537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1e900cfa00 con 0x7f1ea01035e0 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1ea5053640 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00b760 tx=0x7f1e9c00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2fb6615c21fc91 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.043+0000 7f1e8b7fe640 1 -- 172.21.15.17:0/3760290817 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c003dd0 con 0x55dfd8f08410 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1ea5854640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 0x7f1e8c0a5ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e98006010 tx=0x7f1e9802a950 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1e8b7fe640 1 -- 172.21.15.17:0/3760290817 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e9c015070 con 0x55dfd8f08410 2024-09-16T01:02:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1e8b7fe640 1 -- 172.21.15.17:0/3760290817 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c004d50 con 0x55dfd8f08410 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3760290817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 msgr2=0x55dfd8f12770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00b760 tx=0x7f1e9c00bc20 comp rx=0 tx=0).stop 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3760290817 shutdown_connections 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f12770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3760290817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f07ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3760290817 >> 172.21.15.17:0/3760290817 conn(0x55dfd8f04060 msgr2=0x55dfd8f04440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3760290817 shutdown_connections 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.044+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3760290817 wait complete. 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 -- start start 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 Processor -- start 2024-09-16T01:02:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f100b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8f15880 con 0x55dfd8f12cb0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8df5290 con 0x55dfd8f08410 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.045+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8f15a00 con 0x55dfd8f07af0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1eaa04e740 10 client.0 _ll_register_callbacks cb 0x55dfd8e26140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50104/0 (socket says 172.21.15.17:50104) 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 -- 172.21.15.17:0/2703780408 learned_addr learned my addr 172.21.15.17:0/2703780408 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea4852640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5053640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 -- 172.21.15.17:0/2703780408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 msgr2=0x55dfd8f0fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 -- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 msgr2=0x55dfd8f100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 -- 172.21.15.17:0/2703780408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd8b7f210 con 0x55dfd8f12cb0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea4852640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1ea5854640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1e98035000 tx=0x7f1e980095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf43e7b9a9384d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98034040 con 0x55dfd8f12cb0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9c015070 con 0x55dfd8f12cb0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1e98004450 con 0x55dfd8f12cb0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.046+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e98004650 con 0x55dfd8f12cb0 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 10 client.15348 fetch_fsmap learned FSMap version 28 2024-09-16T01:02:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfd8c4b620 con 0x55dfd8f12cb0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e9c015070 con 0x55dfd8f12cb0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e9803a430 con 0x55dfd8f12cb0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 10 client.15348 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 20 client.15348 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f22bd0 0x55dfd8f24fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 4 client.15348 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd8e79a20 con 0x55dfd8f22bd0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.047+0000 7f1ea5053640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f22bd0 0x55dfd8f24fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.048+0000 7f1ea5053640 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f22bd0 0x55dfd8f24fc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d09e4e97502149f server_cookie=6ddf7b5e1ebc7c1e in_seq=0 out_seq=0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.048+0000 7f1e88ff9640 10 client.15348 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.048+0000 7f1e88ff9640 1 -- 172.21.15.17:0/2703780408 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd8e79a20 con 0x55dfd8f22bd0 2024-09-16T01:02:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.048+0000 7f1e88ff9640 10 client.15348 handle_command_reply: tid=0 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 client.15348 shutdown 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 msgr2=0x55dfd8f105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1e98035000 tx=0x7f1e980095c0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 shutdown_connections 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f22bd0 0x55dfd8f24fc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f105f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1e88ff9640 0 client.15348 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/2703780408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 >> 172.21.15.17:0/2703780408 conn(0x55dfd8f04060 msgr2=0x55dfd8f09d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 shutdown_connections 2024-09-16T01:02:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 1 -- 172.21.15.17:0/2703780408 wait complete. 2024-09-16T01:02:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.049+0000 7f1eaa04e740 20 client.15348 trim_cache size 0 max 16384 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 Processor -- start 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 -- start start 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f08410 0x55dfd8f10420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01af8a0 con 0x55dfd8f12cb0 2024-09-16T01:02:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01b13e0 con 0x55dfd8f07af0 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01aff70 con 0x55dfd8f08410 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50116/0 (socket says 172.21.15.17:50116) 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 -- 172.21.15.17:0/3605341908 learned_addr learned my addr 172.21.15.17:0/3605341908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea4852640 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f08410 0x55dfd8f10420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5053640 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 -- 172.21.15.17:0/3605341908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f08410 msgr2=0x55dfd8f10420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f08410 0x55dfd8f10420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 -- 172.21.15.17:0/3605341908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f07af0 msgr2=0x55dfd8f0a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.064+0000 7f1ea5854640 1 -- 172.21.15.17:0/3605341908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd8f08240 con 0x55dfd8f12cb0 2024-09-16T01:02:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1ea5854640 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fe0 tx=0x7f1e98004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a2a0dff1568b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1e8affd640 1 -- 172.21.15.17:0/3605341908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9802f520 con 0x55dfd8f12cb0 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1e8affd640 1 -- 172.21.15.17:0/3605341908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e9805e020 con 0x55dfd8f12cb0 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1e8affd640 1 -- 172.21.15.17:0/3605341908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e980044b0 con 0x55dfd8f12cb0 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3605341908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 msgr2=0x55dfd8f2a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fe0 tx=0x7f1e98004980 comp rx=0 tx=0).stop 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3605341908 shutdown_connections 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f2a8d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f08410 0x55dfd8f10420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/3605341908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f07af0 0x55dfd8f0a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3605341908 >> 172.21.15.17:0/3605341908 conn(0x55dfd8f04060 msgr2=0x55dfd8f11bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3605341908 shutdown_connections 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.065+0000 7f1eaa04e740 1 -- 172.21.15.17:0/3605341908 wait complete. 2024-09-16T01:02:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 -- start start 2024-09-16T01:02:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 Processor -- start 2024-09-16T01:02:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f1b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01b0d10 con 0x55dfd8f12cb0 2024-09-16T01:02:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01b0640 con 0x55dfd8f08410 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01ad880 con 0x55dfd8f07af0 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1eaa04e740 10 client.0 _ll_register_callbacks cb 0x7f1e98009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1ea5854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50126/0 (socket says 172.21.15.17:50126) 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1ea5854640 1 -- 172.21.15.17:0/1467839465 learned_addr learned my addr 172.21.15.17:0/1467839465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.066+0000 7f1ea4852640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f1b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5053640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 -- 172.21.15.17:0/1467839465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 msgr2=0x55dfd8f1b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f1b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 -- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 msgr2=0x55dfd8f1b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f1b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 -- 172.21.15.17:0/1467839465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd8f16db0 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea4852640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f1b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1ea5854640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e980096c0 tx=0x7f1e98005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96baf23dbc022614 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98004250 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9805e020 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1e980043f0 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e9803aa40 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1eaa04e740 10 client.15354 fetch_fsmap learned FSMap version 28 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.067+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfd8f8d510 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e9805e020 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e98039450 con 0x55dfd8f12cb0 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 10 client.15354 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:02:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 20 client.15354 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f8db10 0x55dfd8f8ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 4 client.15354 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfd8e73d70 con 0x55dfd8f8db10 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.068+0000 7f1ea5053640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f8db10 0x55dfd8f8ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.069+0000 7f1e88ff9640 10 client.15354 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.069+0000 7f1ea5053640 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f8db10 0x55dfd8f8ff00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89d3e16743cd446 server_cookie=3e5531349ccf1b8f in_seq=0 out_seq=0 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1e88ff9640 1 -- 172.21.15.17:0/1467839465 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfd8e73d70 con 0x55dfd8f8db10 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1e88ff9640 10 client.15354 handle_command_reply: tid=0 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 client.15354 shutdown 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 msgr2=0x55dfd8f16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e980096c0 tx=0x7f1e98005cf0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 shutdown_connections 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfd8f8db10 0x55dfd8f8ff00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfd8f12cb0 0x55dfd8f16580 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1e88ff9640 0 client.15354 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfd8f08410 0x55dfd8f1b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 --2- 172.21.15.17:0/1467839465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfd8f07af0 0x55dfd8f1b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 >> 172.21.15.17:0/1467839465 conn(0x55dfd8f04060 msgr2=0x55dfd8f113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 shutdown_connections 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 1 -- 172.21.15.17:0/1467839465 wait complete. 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1eaa04e740 20 client.15354 trim_cache size 0 max 16384 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:02:39.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:02:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 msgr2=0x7f1e8c0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 0x7f1e8c0a5ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e98006010 tx=0x7f1e9802a950 comp rx=0 tx=0).stop 2024-09-16T01:02:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 msgr2=0x7f1ea0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000d740 tx=0x7f1e9000dc00 comp rx=0 tx=0).stop 2024-09-16T01:02:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 shutdown_connections 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1e8c0a3600 0x7f1e8c0a5ac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ea010c110 0x7f1ea0101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea01035e0 0x7f1ea0100e50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 --2- 172.21.15.17:0/429997537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ea0102cc0 0x7f1ea0100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 >> 172.21.15.17:0/429997537 conn(0x7f1ea00fc6b0 msgr2=0x7f1ea00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 shutdown_connections 2024-09-16T01:02:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:39.082+0000 7f1ea72b7640 1 -- 172.21.15.17:0/429997537 wait complete. 2024-09-16T01:02:39.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:39 smithi017 ceph-mon[31211]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-16T01:02:39.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:39 smithi088 ceph-mon[34093]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-16T01:02:39.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:39 smithi154 ceph-mon[34759]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-16T01:02:41.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:41 smithi017 ceph-mon[31211]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-09-16T01:02:41.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:41 smithi088 ceph-mon[34093]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-09-16T01:02:41.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:41 smithi154 ceph-mon[34759]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-09-16T01:02:43.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:43 smithi017 ceph-mon[31211]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:02:43.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:43 smithi088 ceph-mon[34093]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:02:43.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:43 smithi154 ceph-mon[34759]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:02:45.445 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:45 smithi088 ceph-mon[34093]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-09-16T01:02:45.454 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:45 smithi154 ceph-mon[34759]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-09-16T01:02:45.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:45 smithi017 ceph-mon[31211]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-09-16T01:02:47.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:47 smithi088 ceph-mon[34093]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-16T01:02:47.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:47 smithi154 ceph-mon[34759]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-16T01:02:47.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:47 smithi017 ceph-mon[31211]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-16T01:02:49.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:49 smithi088 ceph-mon[34093]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-16T01:02:49.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:49 smithi154 ceph-mon[34759]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-16T01:02:49.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:49 smithi017 ceph-mon[31211]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-16T01:02:51.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:51 smithi088 ceph-mon[34093]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-16T01:02:51.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:51 smithi154 ceph-mon[34759]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-16T01:02:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:51 smithi017 ceph-mon[31211]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2024-09-16T01:02:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 -- 172.21.15.17:0/3840537567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c1034a0 msgr2=0x7f379c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 --2- 172.21.15.17:0/3840537567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c1034a0 0x7f379c10b980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3790009900 tx=0x7f379002a480 comp rx=0 tx=0).stop 2024-09-16T01:02:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 -- 172.21.15.17:0/3840537567 shutdown_connections 2024-09-16T01:02:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 --2- 172.21.15.17:0/3840537567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c10bf50 0x7f379c10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 --2- 172.21.15.17:0/3840537567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c1034a0 0x7f379c10b980 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 --2- 172.21.15.17:0/3840537567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 -- 172.21.15.17:0/3840537567 >> 172.21.15.17:0/3840537567 conn(0x7f379c0fc510 msgr2=0x7f379c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.174+0000 7f37a1201640 1 -- 172.21.15.17:0/3840537567 shutdown_connections 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.175+0000 7f37a1201640 1 -- 172.21.15.17:0/3840537567 wait complete. 2024-09-16T01:02:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.175+0000 7f37a1201640 1 Processor -- start 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.175+0000 7f37a1201640 1 -- start start 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c1007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c1034a0 0x7f379c100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 0x7f379c101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f379c111bd0 con 0x7f379c10bf50 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f379c111a50 con 0x7f379c1034a0 2024-09-16T01:02:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f37a1201640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f379c111d50 con 0x7f379c102b80 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 0x7f379c101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c1007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c1007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.17:58406/0 (socket says 172.21.15.17:58406) 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379ad9d640 1 -- 172.21.15.17:0/2585470170 learned_addr learned my addr 172.21.15.17:0/2585470170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379a59c640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c1034a0 0x7f379c100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 -- 172.21.15.17:0/2585470170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 msgr2=0x7f379c1007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c1007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 -- 172.21.15.17:0/2585470170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c1034a0 msgr2=0x7f379c100d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c1034a0 0x7f379c100d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.176+0000 7f379b59e640 1 -- 172.21.15.17:0/2585470170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c1a65e0 con 0x7f379c10bf50 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f379b59e640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 0x7f379c101250 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f379400cab0 tx=0x7f379400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f3783fff640 1 -- 172.21.15.17:0/2585470170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379400ae20 con 0x7f379c10bf50 2024-09-16T01:02:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c1a68d0 con 0x7f379c10bf50 2024-09-16T01:02:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f3783fff640 1 -- 172.21.15.17:0/2585470170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f379400f900 con 0x7f379c10bf50 2024-09-16T01:02:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f3783fff640 1 -- 172.21.15.17:0/2585470170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794018a00 con 0x7f379c10bf50 2024-09-16T01:02:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.177+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1a6df0 con 0x7f379c10bf50 2024-09-16T01:02:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.180+0000 7f37a4074740 1 Processor -- start 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.180+0000 7f3783fff640 1 -- 172.21.15.17:0/2585470170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f379400fab0 con 0x7f379c10bf50 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.180+0000 7f37a4074740 1 -- start start 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe9674cc0 0x55dfe96750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 0x55dfe9682270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfe95d92f0 con 0x55dfe96755e0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55dfe9581270 con 0x55dfe9674cc0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f37a4074740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfe95d52b0 con 0x55dfe967fe80 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48210/0 (socket says 172.21.15.17:48210) 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 -- 172.21.15.17:0/2672435205 learned_addr learned my addr 172.21.15.17:0/2672435205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379a59c640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe9674cc0 0x55dfe96750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379a59c640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 0x55dfe9682270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 -- 172.21.15.17:0/2672435205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 msgr2=0x55dfe9682270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 0x55dfe9682270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 -- 172.21.15.17:0/2672435205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe9674cc0 msgr2=0x55dfe96750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe9674cc0 0x55dfe96750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 -- 172.21.15.17:0/2672435205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe9580340 con 0x55dfe96755e0 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379a59c640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 0x55dfe9682270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f3783fff640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 0x7f37840a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f378c00adb0 tx=0x7f378c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50da10a1758cccb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f379a59c640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 0x7f37840a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.181+0000 7f3783fff640 1 -- 172.21.15.17:0/2585470170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f37940d0630 con 0x7f379c10bf50 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37817fa640 1 -- 172.21.15.17:0/2672435205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c01d070 con 0x55dfe96755e0 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37817fa640 1 -- 172.21.15.17:0/2672435205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f378c010cf0 con 0x55dfe96755e0 2024-09-16T01:02:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37817fa640 1 -- 172.21.15.17:0/2672435205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c018be0 con 0x55dfe96755e0 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 -- 172.21.15.17:0/2672435205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 msgr2=0x55dfe967f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f378c00adb0 tx=0x7f378c00f790 comp rx=0 tx=0).stop 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f379a59c640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 0x7f37840a5990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3790031440 tx=0x7f3790009560 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 -- 172.21.15.17:0/2672435205 shutdown_connections 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe967fe80 0x55dfe9682270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe96755e0 0x55dfe967f940 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 --2- 172.21.15.17:0/2672435205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe9674cc0 0x55dfe96750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 -- 172.21.15.17:0/2672435205 >> 172.21.15.17:0/2672435205 conn(0x55dfe9671230 msgr2=0x55dfe9671610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 -- 172.21.15.17:0/2672435205 shutdown_connections 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.182+0000 7f37a4074740 1 -- 172.21.15.17:0/2672435205 wait complete. 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 -- start start 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 Processor -- start 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 0x55dfe967d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 0x55dfe967d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfe9682a50 con 0x55dfe9674cc0 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55dfe9562290 con 0x55dfe967fe80 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfe9682bd0 con 0x55dfe96755e0 2024-09-16T01:02:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f37a4074740 10 client.0 _ll_register_callbacks cb 0x55dfe9593140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48214/0 (socket says 172.21.15.17:48214) 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379ad9d640 1 -- 172.21.15.17:0/2355689468 learned_addr learned my addr 172.21.15.17:0/2355689468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379a59c640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 0x55dfe967d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379b59e640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 0x55dfe967d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.183+0000 7f379ad9d640 1 -- 172.21.15.17:0/2355689468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 msgr2=0x55dfe967d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 0x55dfe967d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379ad9d640 1 -- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 msgr2=0x55dfe967d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 0x55dfe967d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379ad9d640 1 -- 172.21.15.17:0/2355689468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe92ec210 con 0x55dfe9674cc0 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379b59e640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 0x55dfe967d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379a59c640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 0x55dfe967d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f379ad9d640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f378c000c00 tx=0x7f378c0108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6916f1559e223741 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c01d040 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f378c00fe40 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378c010cf0 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f378c031050 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f37a4074740 10 client.15366 fetch_fsmap learned FSMap version 28 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfe93b8620 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f378c010cf0 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.184+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f378c020030 con 0x55dfe9674cc0 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 10 client.15366 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 20 client.15366 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe968fd30 0x55dfe9692120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 4 client.15366 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfe95e6a20 con 0x55dfe968fd30 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f379a59c640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe968fd30 0x55dfe9692120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f377eff5640 10 client.15366 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.185+0000 7f379a59c640 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe968fd30 0x55dfe9692120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6298bfb4aa42750e server_cookie=2ffa55a5f831687f in_seq=0 out_seq=0 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f377eff5640 1 -- 172.21.15.17:0/2355689468 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfe95e6a20 con 0x55dfe968fd30 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f377eff5640 10 client.15366 handle_command_reply: tid=0 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 client.15366 shutdown 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 msgr2=0x55dfe967cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f378c000c00 tx=0x7f378c0108f0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 shutdown_connections 2024-09-16T01:02:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe968fd30 0x55dfe9692120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe967fe80 0x55dfe967d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe96755e0 0x55dfe967d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f377eff5640 0 client.15366 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 --2- 172.21.15.17:0/2355689468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe9674cc0 0x55dfe967cdc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 >> 172.21.15.17:0/2355689468 conn(0x55dfe9671230 msgr2=0x55dfe9676f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 shutdown_connections 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 1 -- 172.21.15.17:0/2355689468 wait complete. 2024-09-16T01:02:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.186+0000 7f37a4074740 20 client.15366 trim_cache size 0 max 16384 2024-09-16T01:02:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 Processor -- start 2024-09-16T01:02:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 -- start start 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9671610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe967d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1af640 con 0x55dfe967fe80 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1b1180 con 0x55dfe96755e0 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f37a4074740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1afd10 con 0x55dfe9674cc0 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f379b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f379b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48228/0 (socket says 172.21.15.17:48228) 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f379b59e640 1 -- 172.21.15.17:0/269523347 learned_addr learned my addr 172.21.15.17:0/269523347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f379a59c640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe967d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.202+0000 7f379ad9d640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9671610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 -- 172.21.15.17:0/269523347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 msgr2=0x55dfe9671610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9671610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 -- 172.21.15.17:0/269523347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 msgr2=0x55dfe967d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe967d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 -- 172.21.15.17:0/269523347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe967bd50 con 0x55dfe967fe80 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379a59c640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe967d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f379b59e640 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f37940ce3b0 tx=0x7f379400fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd28ebc33ea768 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f3780ff9640 1 -- 172.21.15.17:0/269523347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37940b4020 con 0x55dfe967fe80 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f3780ff9640 1 -- 172.21.15.17:0/269523347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f379409c6f0 con 0x55dfe967fe80 2024-09-16T01:02:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.203+0000 7f3780ff9640 1 -- 172.21.15.17:0/269523347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37940cdf10 con 0x55dfe967fe80 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- 172.21.15.17:0/269523347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 msgr2=0x55dfe967d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f37940ce3b0 tx=0x7f379400fe20 comp rx=0 tx=0).stop 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- 172.21.15.17:0/269523347 shutdown_connections 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe967d830 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe967d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- 172.21.15.17:0/269523347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9671610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- 172.21.15.17:0/269523347 >> 172.21.15.17:0/269523347 conn(0x55dfe9671230 msgr2=0x55dfe967ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- 172.21.15.17:0/269523347 shutdown_connections 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- 172.21.15.17:0/269523347 wait complete. 2024-09-16T01:02:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- start start 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 Processor -- start 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9683ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe9684010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1b0ab0 con 0x55dfe967fe80 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1b03e0 con 0x55dfe96755e0 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1ad620 con 0x55dfe9674cc0 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.204+0000 7f37a4074740 10 client.0 _ll_register_callbacks cb 0x7f378c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48238/0 (socket says 172.21.15.17:48238) 2024-09-16T01:02:52.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 -- 172.21.15.17:0/4016963156 learned_addr learned my addr 172.21.15.17:0/4016963156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379a59c640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe9684010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379ad9d640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9683ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 -- 172.21.15.17:0/4016963156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 msgr2=0x55dfe9683ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9683ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 -- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 msgr2=0x55dfe9684010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe9684010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 -- 172.21.15.17:0/4016963156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe96f96c0 con 0x55dfe967fe80 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379a59c640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe9684010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379ad9d640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9683ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f379b59e640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f379401f000 tx=0x7f37940a5360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932739d51bf1190e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f377eff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37940b4050 con 0x55dfe967fe80 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f37940ce120 con 0x55dfe967fe80 2024-09-16T01:02:52.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f379409c6f0 con 0x55dfe967fe80 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f379400f450 con 0x55dfe967fe80 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f37a4074740 10 client.15372 fetch_fsmap learned FSMap version 28 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.205+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfe96fa920 con 0x55dfe967fe80 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f379409c6f0 con 0x55dfe967fe80 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3794098440 con 0x55dfe967fe80 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 10 client.15372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 20 client.15372 populate_metadata read hostname 'smithi017' 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe96faff0 0x55dfe96fd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 4 client.15372 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfe95e0d70 con 0x55dfe96faff0 2024-09-16T01:02:52.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.206+0000 7f379ad9d640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe96faff0 0x55dfe96fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.207+0000 7f377eff5640 10 client.15372 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:52.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.207+0000 7f379ad9d640 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe96faff0 0x55dfe96fd410 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e9b549d956af40 server_cookie=db606775bed2bba0 in_seq=0 out_seq=0 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f377eff5640 1 -- 172.21.15.17:0/4016963156 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfe95e0d70 con 0x55dfe96faff0 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f377eff5640 10 client.15372 handle_command_reply: tid=0 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 client.15372 shutdown 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 msgr2=0x55dfe9684550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f379401f000 tx=0x7f37940a5360 comp rx=0 tx=0).stop 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 shutdown_connections 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55dfe96faff0 0x55dfe96fd410 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfe967fe80 0x55dfe9684550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55dfe96755e0 0x55dfe9684010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f377eff5640 0 client.15372 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 --2- 172.21.15.17:0/4016963156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfe9674cc0 0x55dfe9683ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 >> 172.21.15.17:0/4016963156 conn(0x55dfe9671230 msgr2=0x55dfe966f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 shutdown_connections 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 1 -- 172.21.15.17:0/4016963156 wait complete. 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a4074740 20 client.15372 trim_cache size 0 max 16384 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:02:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:02:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 msgr2=0x7f37840a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.213+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 0x7f37840a5990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3790031440 tx=0x7f3790009560 comp rx=0 tx=0).stop 2024-09-16T01:02:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 msgr2=0x7f379c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 0x7f379c101250 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f379400cab0 tx=0x7f379400cf70 comp rx=0 tx=0).stop 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 shutdown_connections 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f37840a34d0 0x7f37840a5990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c10bf50 0x7f379c101250 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c1034a0 0x7f379c100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 --2- 172.21.15.17:0/2585470170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f379c102b80 0x7f379c1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 >> 172.21.15.17:0/2585470170 conn(0x7f379c0fc510 msgr2=0x7f379c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 shutdown_connections 2024-09-16T01:02:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:02:52.214+0000 7f37a1201640 1 -- 172.21.15.17:0/2585470170 wait complete. 2024-09-16T01:02:53.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:53 smithi088 ceph-mon[34093]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:02:53.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:53 smithi154 ceph-mon[34759]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:02:53.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:53 smithi017 ceph-mon[31211]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:02:55.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:55 smithi088 ceph-mon[34093]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-09-16T01:02:55.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:55 smithi154 ceph-mon[34759]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-09-16T01:02:55.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:55 smithi017 ceph-mon[31211]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-09-16T01:02:57.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:57 smithi088 ceph-mon[34093]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:02:57.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:57 smithi154 ceph-mon[34759]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:02:57.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:57 smithi017 ceph-mon[31211]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:02:59.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:02:59 smithi088 ceph-mon[34093]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:02:59.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:02:59 smithi154 ceph-mon[34759]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:02:59.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:02:59 smithi017 ceph-mon[31211]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:03:00.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:03:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:03:00.076+0000 7fdccd343640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:03:00.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:03:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:03:00.076+0000 7fdccd343640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:03:00.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:03:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:03:00.076+0000 7fdccd343640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:03:00.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:03:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:03:00.076+0000 7fdccd343640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:03:00.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:03:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:03:00.076+0000 7fdccd343640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:03:01.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:01 smithi088 ceph-mon[34093]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:03:01.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:01 smithi154 ceph-mon[34759]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:03:01.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:01 smithi017 ceph-mon[31211]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T01:03:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:03 smithi088 ceph-mon[34093]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:03:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:03 smithi088 ceph-mon[34093]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-16T01:03:03.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:03 smithi154 ceph-mon[34759]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:03:03.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:03 smithi154 ceph-mon[34759]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-16T01:03:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:03 smithi017 ceph-mon[31211]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T01:03:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:03 smithi017 ceph-mon[31211]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 -- 172.21.15.17:0/4136674586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8107b70 msgr2=0x7f74a8107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 --2- 172.21.15.17:0/4136674586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8107b70 0x7f74a8107f50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f749c009930 tx=0x7f749c02a420 comp rx=0 tx=0).stop 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 -- 172.21.15.17:0/4136674586 shutdown_connections 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 --2- 172.21.15.17:0/4136674586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8102470 0x7f74a810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 --2- 172.21.15.17:0/4136674586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a8101ad0 0x7f74a8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 --2- 172.21.15.17:0/4136674586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8107b70 0x7f74a8107f50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 -- 172.21.15.17:0/4136674586 >> 172.21.15.17:0/4136674586 conn(0x7f74a80fd7d0 msgr2=0x7f74a80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 -- 172.21.15.17:0/4136674586 shutdown_connections 2024-09-16T01:03:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.348+0000 7f74aef26640 1 -- 172.21.15.17:0/4136674586 wait complete. 2024-09-16T01:03:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.349+0000 7f74aef26640 1 Processor -- start 2024-09-16T01:03:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.349+0000 7f74aef26640 1 -- start start 2024-09-16T01:03:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.349+0000 7f74aef26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 0x7f74a8196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.349+0000 7f74aef26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.349+0000 7f74aef26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a819ab50 0x7f74a819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74aef26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74a810fc10 con 0x7f74a8102470 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53250/0 (socket says 172.21.15.17:53250) 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 -- 172.21.15.17:0/2750605577 learned_addr learned my addr 172.21.15.17:0/2750605577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74accc2640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 0x7f74a8196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f74a810fa90 con 0x7f74a819ab50 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74a810fd90 con 0x7f74a8101ad0 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a819ab50 0x7f74a819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 -- 172.21.15.17:0/2750605577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 msgr2=0x7f74a8196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 0x7f74a8196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 -- 172.21.15.17:0/2750605577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a819ab50 msgr2=0x7f74a819b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a819ab50 0x7f74a819b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74a7fff640 1 -- 172.21.15.17:0/2750605577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a819b640 con 0x7f74a8102470 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.350+0000 7f74accc2640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 0x7f74a8196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74a7fff640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7494011b00 tx=0x7f749400f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74a5ffb640 1 -- 172.21.15.17:0/2750605577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749400fc90 con 0x7f74a8102470 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74a5ffb640 1 -- 172.21.15.17:0/2750605577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f749400fe30 con 0x7f74a8102470 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a819b930 con 0x7f74a8102470 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74a5ffb640 1 -- 172.21.15.17:0/2750605577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494004a70 con 0x7f74a8102470 2024-09-16T01:03:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.351+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a81a30b0 con 0x7f74a8102470 2024-09-16T01:03:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 Processor -- start 2024-09-16T01:03:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74a5ffb640 1 -- 172.21.15.17:0/2750605577 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f7494020020 con 0x7f74a8102470 2024-09-16T01:03:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 -- start start 2024-09-16T01:03:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3fae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5601c3f052f0 con 0x5601c3fa0af0 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5601c3ead270 con 0x5601c3fabcb0 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.355+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5601c3f012b0 con 0x5601c3fa1410 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53260/0 (socket says 172.21.15.17:53260) 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 -- 172.21.15.17:0/3829003868 learned_addr learned my addr 172.21.15.17:0/3829003868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74accc2640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3fae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 -- 172.21.15.17:0/3829003868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 msgr2=0x5601c3fab770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fab770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 -- 172.21.15.17:0/3829003868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 msgr2=0x5601c3fae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3fae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 -- 172.21.15.17:0/3829003868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c3eac340 con 0x5601c3fa0af0 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3fae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.356+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009fa0 tx=0x7f74a00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec26ba1c1481891 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f74a5ffb640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 0x7f74980a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f74a5ffb640 1 -- 172.21.15.17:0/2750605577 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f74940d33b0 con 0x7f74a8102470 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f74accc2640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 0x7f74980a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f7492ffd640 1 -- 172.21.15.17:0/3829003868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0004d20 con 0x5601c3fa0af0 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f7492ffd640 1 -- 172.21.15.17:0/3829003868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74a0004050 con 0x5601c3fa0af0 2024-09-16T01:03:05.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.357+0000 7f7492ffd640 1 -- 172.21.15.17:0/3829003868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0005280 con 0x5601c3fa0af0 2024-09-16T01:03:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3829003868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 msgr2=0x5601c3fa0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74accc2640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 0x7f74980a5bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f749c009230 tx=0x7f749c005a20 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009fa0 tx=0x7f74a00118d0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3829003868 shutdown_connections 2024-09-16T01:03:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3fae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3829003868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa0ed0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3829003868 >> 172.21.15.17:0/3829003868 conn(0x5601c3f9d060 msgr2=0x5601c3f9d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3829003868 shutdown_connections 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.358+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3829003868 wait complete. 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.359+0000 7f74b1cb8740 1 -- start start 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.359+0000 7f74b1cb8740 1 Processor -- start 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.359+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 0x5601c3fa8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.359+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 0x5601c3fa90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.359+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3fa95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 0x5601c3fa90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 0x5601c3fa90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53272/0 (socket says 172.21.15.17:53272) 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74a7fff640 1 -- 172.21.15.17:0/2360841541 learned_addr learned my addr 172.21.15.17:0/2360841541 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5601c3fae8d0 con 0x5601c3fa1410 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 0x5601c3fa8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5601c3e8e290 con 0x5601c3fa0af0 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5601c3faea50 con 0x5601c3fabcb0 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3fa95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74b1cb8740 10 client.0 _ll_register_callbacks cb 0x5601c3ebf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 -- 172.21.15.17:0/2360841541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 msgr2=0x5601c3fa95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3fa95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 -- 172.21.15.17:0/2360841541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 msgr2=0x5601c3fa90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 0x5601c3fa90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74accc2640 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c3c18210 con 0x5601c3fa0af0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.360+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3fa95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a0004050 con 0x5601c3fa0af0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f74accc2640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 0x5601c3fa8b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f749c008000 tx=0x7f749c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503e3ad20a17cf9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f7487fff640 10 client.25130 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f7487fff640 1 -- 172.21.15.17:0/2360841541 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c035040 con 0x5601c3fa0af0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f7487fff640 1 -- 172.21.15.17:0/2360841541 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f749c0035f0 con 0x5601c3fa0af0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f7487fff640 1 -- 172.21.15.17:0/2360841541 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f749c003830 con 0x5601c3fa0af0 2024-09-16T01:03:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f74b1cb8740 10 client.25130 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.361+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5601c3ce4620 con 0x5601c3fa0af0 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f7487fff640 1 -- 172.21.15.17:0/2360841541 <== mon.2 v2:172.21.15.88:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f749c044030 con 0x5601c3fa0af0 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 10 client.25130 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 10 client.25130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 20 client.25130 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c3fbbf50 0x5601c3fbe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 4 client.25130 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601c3f12a20 con 0x5601c3fbbf50 2024-09-16T01:03:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.362+0000 7f74a7fff640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c3fbbf50 0x5601c3fbe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.363+0000 7f74a7fff640 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c3fbbf50 0x5601c3fbe410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d62e28bf89c0e2 server_cookie=471c1fa5725425e1 in_seq=0 out_seq=0 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.363+0000 7f7487fff640 10 client.25130 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.363+0000 7f7487fff640 1 -- 172.21.15.17:0/2360841541 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601c3f12a20 con 0x5601c3fbbf50 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.363+0000 7f7487fff640 10 client.25130 handle_command_reply: tid=0 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.363+0000 7f74b1cb8740 1 client.25130 shutdown 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 msgr2=0x5601c3fa8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 0x5601c3fa8b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f749c008000 tx=0x7f749c009260 comp rx=0 tx=0).stop 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 shutdown_connections 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c3fbbf50 0x5601c3fbe410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3fa95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa1410 0x5601c3fa90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/2360841541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa0af0 0x5601c3fa8b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 >> 172.21.15.17:0/2360841541 conn(0x5601c3f9d060 msgr2=0x5601c3f9c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f7487fff640 0 client.25130 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 shutdown_connections 2024-09-16T01:03:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 1 -- 172.21.15.17:0/2360841541 wait complete. 2024-09-16T01:03:05.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.364+0000 7f74b1cb8740 20 client.25130 trim_cache size 0 max 16384 2024-09-16T01:03:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 Processor -- start 2024-09-16T01:03:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 -- start start 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fa9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3faaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f748c00e6c0 con 0x5601c3fa0af0 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f748c010200 con 0x5601c3fabcb0 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.393+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f748c00ed90 con 0x5601c3fa1410 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53280/0 (socket says 172.21.15.17:53280) 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 -- 172.21.15.17:0/3709806140 learned_addr learned my addr 172.21.15.17:0/3709806140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3faaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fa9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 -- 172.21.15.17:0/3709806140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 msgr2=0x5601c3fa9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fa9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 -- 172.21.15.17:0/3709806140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 msgr2=0x5601c3faaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3faaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 -- 172.21.15.17:0/3709806140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601c3fa1240 con 0x5601c3fa0af0 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74accc2640 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f749c0044a0 tx=0x7f749c04a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bed3772f5f44bba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.394+0000 7f74927fc640 1 -- 172.21.15.17:0/3709806140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c005020 con 0x5601c3fa0af0 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.395+0000 7f74927fc640 1 -- 172.21.15.17:0/3709806140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74a0004050 con 0x5601c3fa0af0 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.395+0000 7f74927fc640 1 -- 172.21.15.17:0/3709806140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c031b80 con 0x5601c3fa0af0 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3709806140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 msgr2=0x5601c3fa3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f749c0044a0 tx=0x7f749c04a070 comp rx=0 tx=0).stop 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3709806140 shutdown_connections 2024-09-16T01:03:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fabcb0 0x5601c3faaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fa1410 0x5601c3fa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3709806140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3fa3560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3709806140 >> 172.21.15.17:0/3709806140 conn(0x5601c3f9d060 msgr2=0x5601c3faa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3709806140 shutdown_connections 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3709806140 wait complete. 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 -- start start 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.396+0000 7f74b1cb8740 1 Processor -- start 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 0x5601c3faf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3faf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f748c00fb30 con 0x5601c3fa0af0 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53292/0 (socket says 172.21.15.17:53292) 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 -- 172.21.15.17:0/3068746792 learned_addr learned my addr 172.21.15.17:0/3068746792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f748c00f460 con 0x5601c3fa1410 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f748c00c6a0 con 0x5601c3fabcb0 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74ad4c3640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3faf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 0x5601c3faf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74b1cb8740 10 client.0 _ll_register_callbacks cb 0x7f749c005230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 -- 172.21.15.17:0/3068746792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 msgr2=0x5601c3faf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3faf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 -- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 msgr2=0x5601c3faf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 0x5601c3faf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.397+0000 7f74accc2640 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601c4024cf0 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 0x5601c3faf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a0004050 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f74accc2640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c00 tx=0x7f749c004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7797b50b33be866 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f7487fff640 10 client.15396 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f7487fff640 1 -- 172.21.15.17:0/3068746792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c069060 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f7487fff640 1 -- 172.21.15.17:0/3068746792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f749c003de0 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f7487fff640 1 -- 172.21.15.17:0/3068746792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f749c031800 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f74b1cb8740 10 client.15396 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.398+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5601c4025e70 con 0x5601c3fa0af0 2024-09-16T01:03:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f7487fff640 1 -- 172.21.15.17:0/3068746792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f749c06c050 con 0x5601c3fa0af0 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 10 client.15396 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 20 client.15396 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c4026470 0x5601c4028860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 4 client.15396 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601c3f0cd70 con 0x5601c4026470 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.399+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c4026470 0x5601c4028860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.400+0000 7f7487fff640 10 client.15396 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.400+0000 7f74a7fff640 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c4026470 0x5601c4028860 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d805b7415e71b08 server_cookie=129300f497fbb8e1 in_seq=0 out_seq=0 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f7487fff640 1 -- 172.21.15.17:0/3068746792 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601c3f0cd70 con 0x5601c4026470 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f7487fff640 10 client.15396 handle_command_reply: tid=0 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 client.15396 shutdown 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 msgr2=0x5601c3faeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c00 tx=0x7f749c004f30 comp rx=0 tx=0).stop 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 shutdown_connections 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5601c4026470 0x5601c4028860 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601c3fabcb0 0x5601c3faf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5601c3fa1410 0x5601c3faf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 --2- 172.21.15.17:0/3068746792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601c3fa0af0 0x5601c3faeca0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 >> 172.21.15.17:0/3068746792 conn(0x5601c3f9d060 msgr2=0x5601c3f9c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.406+0000 7f7487fff640 0 client.15396 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.407+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 shutdown_connections 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.407+0000 7f74b1cb8740 1 -- 172.21.15.17:0/3068746792 wait complete. 2024-09-16T01:03:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.407+0000 7f74b1cb8740 20 client.15396 trim_cache size 0 max 16384 2024-09-16T01:03:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:03:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:03:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:03:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 msgr2=0x7f74980a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 0x7f74980a5bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f749c009230 tx=0x7f749c005a20 comp rx=0 tx=0).stop 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 msgr2=0x7f74a81967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7494011b00 tx=0x7f749400f050 comp rx=0 tx=0).stop 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 shutdown_connections 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f74980a3710 0x7f74980a5bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74a819ab50 0x7f74a819b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a8102470 0x7f74a81967d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 --2- 172.21.15.17:0/2750605577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8101ad0 0x7f74a8196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 >> 172.21.15.17:0/2750605577 conn(0x7f74a80fd7d0 msgr2=0x7f74a80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 shutdown_connections 2024-09-16T01:03:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:05.408+0000 7f74aef26640 1 -- 172.21.15.17:0/2750605577 wait complete. 2024-09-16T01:03:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:05 smithi088 ceph-mon[34093]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:05.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:05 smithi154 ceph-mon[34759]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:05 smithi017 ceph-mon[31211]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:07.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:07 smithi088 ceph-mon[34093]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-16T01:03:07.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:07 smithi154 ceph-mon[34759]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-16T01:03:07.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:07 smithi017 ceph-mon[31211]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-16T01:03:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:09 smithi088 ceph-mon[34093]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:09.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:09 smithi154 ceph-mon[34759]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:09 smithi017 ceph-mon[31211]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:11 smithi088 ceph-mon[34093]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-16T01:03:11.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:11 smithi154 ceph-mon[34759]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-16T01:03:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:11 smithi017 ceph-mon[31211]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-16T01:03:13.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:13 smithi017 ceph-mon[31211]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:13.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:13 smithi088 ceph-mon[34093]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:13.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:13 smithi154 ceph-mon[34759]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:15.642 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:15 smithi088 ceph-mon[34093]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:15.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:15 smithi154 ceph-mon[34759]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:15 smithi017 ceph-mon[31211]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-16T01:03:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:17 smithi088 ceph-mon[34093]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:03:17.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:17 smithi154 ceph-mon[34759]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:03:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:17 smithi017 ceph-mon[31211]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-16T01:03:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.533+0000 7f53b4d03640 1 -- 172.21.15.17:0/2858066228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0103600 msgr2=0x7f53b010bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.533+0000 7f53b4d03640 1 --2- 172.21.15.17:0/2858066228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0103600 0x7f53b010bae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009900 tx=0x7f53a402a480 comp rx=0 tx=0).stop 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 -- 172.21.15.17:0/2858066228 shutdown_connections 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 --2- 172.21.15.17:0/2858066228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 --2- 172.21.15.17:0/2858066228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0103600 0x7f53b010bae0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 --2- 172.21.15.17:0/2858066228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102ce0 0x7f53b01030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 -- 172.21.15.17:0/2858066228 >> 172.21.15.17:0/2858066228 conn(0x7f53b0077990 msgr2=0x7f53b00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 -- 172.21.15.17:0/2858066228 shutdown_connections 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 -- 172.21.15.17:0/2858066228 wait complete. 2024-09-16T01:03:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 Processor -- start 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.534+0000 7f53b4d03640 1 -- start start 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0103600 0x7f53b0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111d60 con 0x7f53b0102ce0 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111be0 con 0x7f53b010c0b0 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53b4d03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111ee0 con 0x7f53b0103600 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54654/0 (socket says 172.21.15.17:54654) 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 -- 172.21.15.17:0/1564664036 learned_addr learned my addr 172.21.15.17:0/1564664036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53add9b640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0103600 0x7f53b0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53aed9d640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 -- 172.21.15.17:0/1564664036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0103600 msgr2=0x7f53b0198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0103600 0x7f53b0198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 -- 172.21.15.17:0/1564664036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 msgr2=0x7f53b019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 -- 172.21.15.17:0/1564664036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b019d2c0 con 0x7f53b0102ce0 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53aed9d640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.535+0000 7f53ae59c640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d770 tx=0x7f53a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.536+0000 7f539f7fe640 1 -- 172.21.15.17:0/1564664036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0017070 con 0x7f53b0102ce0 2024-09-16T01:03:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.536+0000 7f539f7fe640 1 -- 172.21.15.17:0/1564664036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53a00054d0 con 0x7f53b0102ce0 2024-09-16T01:03:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.536+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b019d5b0 con 0x7f53b0102ce0 2024-09-16T01:03:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.536+0000 7f539f7fe640 1 -- 172.21.15.17:0/1564664036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0004cf0 con 0x7f53b0102ce0 2024-09-16T01:03:18.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.536+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b01a4e40 con 0x7f53b0102ce0 2024-09-16T01:03:18.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 Processor -- start 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 -- start start 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f539f7fe640 1 -- 172.21.15.17:0/1564664036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f53a0004e90 con 0x7f53b0102ce0 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 0x55646714a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55646714acb0 0x55646714d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5564670a42f0 con 0x556467140410 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55646704c270 con 0x55646713faf0 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53b7a98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564670a02b0 con 0x55646714acb0 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53aed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53aed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:34548/0 (socket says 172.21.15.17:34548) 2024-09-16T01:03:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.540+0000 7f53aed9d640 1 -- 172.21.15.17:0/3628923424 learned_addr learned my addr 172.21.15.17:0/3628923424 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53aed9d640 1 -- 172.21.15.17:0/3628923424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55646714acb0 msgr2=0x55646714d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55646714acb0 0x55646714d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53aed9d640 1 -- 172.21.15.17:0/3628923424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 msgr2=0x55646714a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53ae59c640 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 0x55646714a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f539f7fe640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 0x7f53980a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f539f7fe640 1 -- 172.21.15.17:0/1564664036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f53a00cf980 con 0x7f53b0102ce0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 0x55646714a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53aed9d640 1 -- 172.21.15.17:0/3628923424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646704b340 con 0x55646713faf0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53ae59c640 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 0x55646714a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.541+0000 7f53add9b640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 0x7f53980a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.542+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009ea0 tx=0x7f53a8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66171ae6d5736b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.542+0000 7f53add9b640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 0x7f53980a5b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53a4031440 tx=0x7f53a4005bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.542+0000 7f539cff9640 1 -- 172.21.15.17:0/3628923424 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8016070 con 0x55646713faf0 2024-09-16T01:03:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.542+0000 7f539cff9640 1 -- 172.21.15.17:0/3628923424 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53a800ee80 con 0x55646713faf0 2024-09-16T01:03:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.542+0000 7f539cff9640 1 -- 172.21.15.17:0/3628923424 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a80116d0 con 0x55646713faf0 2024-09-16T01:03:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- 172.21.15.17:0/3628923424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 msgr2=0x55646713fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009ea0 tx=0x7f53a8009f90 comp rx=0 tx=0).stop 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- 172.21.15.17:0/3628923424 shutdown_connections 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55646714acb0 0x55646714d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556467140410 0x55646714a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3628923424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x55646713fed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- 172.21.15.17:0/3628923424 >> 172.21.15.17:0/3628923424 conn(0x55646713c060 msgr2=0x55646713c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- 172.21.15.17:0/3628923424 shutdown_connections 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- 172.21.15.17:0/3628923424 wait complete. 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 -- start start 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.543+0000 7f53b7a98740 1 Processor -- start 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x5564671485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556467151c90 con 0x55646714acb0 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55646702d290 con 0x55646713faf0 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556467151e10 con 0x556467140410 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53b7a98740 10 client.0 _ll_register_callbacks cb 0x55646705e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53add9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x5564671485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53add9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.17:50918/0 (socket says 172.21.15.17:50918) 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53add9b640 1 -- 172.21.15.17:0/263393453 learned_addr learned my addr 172.21.15.17:0/263393453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 -- 172.21.15.17:0/263393453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 msgr2=0x556467148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 -- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 msgr2=0x556467147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53aed9d640 1 -- 172.21.15.17:0/263393453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556466db7210 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.544+0000 7f53add9b640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f53aed9d640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x5564671485d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009ea0 tx=0x7f53a8011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0f08215782401d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f5395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8028060 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f53a80099e0 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564670b1a20 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53a8016040 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f53b7a98740 10 client.15405 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556466e83620 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.545+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5564670b1a20 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53a800f040 con 0x55646714acb0 2024-09-16T01:03:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 10 client.15405 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 20 client.15405 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55646715ef40 0x556467161330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 4 client.15405 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564670abd70 con 0x55646715ef40 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53ae59c640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55646715ef40 0x556467161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f5395ffb640 10 client.15405 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.546+0000 7f53ae59c640 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55646715ef40 0x556467161330 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a3debd7c5aa94f server_cookie=e06c539e4e1dbe02 in_seq=0 out_seq=0 2024-09-16T01:03:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f5395ffb640 1 -- 172.21.15.17:0/263393453 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564670abd70 con 0x55646715ef40 2024-09-16T01:03:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f5395ffb640 10 client.15405 handle_command_reply: tid=0 2024-09-16T01:03:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 client.15405 shutdown 2024-09-16T01:03:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 msgr2=0x5564671485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x5564671485d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009ea0 tx=0x7f53a8011df0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 shutdown_connections 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55646715ef40 0x556467161330 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x5564671485d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 --2- 172.21.15.17:0/263393453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 >> 172.21.15.17:0/263393453 conn(0x55646713c060 msgr2=0x556467141dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f5395ffb640 0 client.15405 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 shutdown_connections 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.547+0000 7f53b7a98740 1 -- 172.21.15.17:0/263393453 wait complete. 2024-09-16T01:03:18.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.548+0000 7f53b7a98740 20 client.15405 trim_cache size 0 max 16384 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 Processor -- start 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 -- start start 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467142560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ab550 con 0x55646714acb0 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ad090 con 0x55646713faf0 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53b7a98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01abc20 con 0x556467140410 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.562+0000 7f53aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54672/0 (socket says 172.21.15.17:54672) 2024-09-16T01:03:18.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 -- 172.21.15.17:0/3969668011 learned_addr learned my addr 172.21.15.17:0/3969668011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53ae59c640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53add9b640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 -- 172.21.15.17:0/3969668011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 msgr2=0x556467149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 -- 172.21.15.17:0/3969668011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 msgr2=0x556467142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 -- 172.21.15.17:0/3969668011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556467140240 con 0x55646714acb0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53add9b640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f53aed9d640 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53a80096e0 tx=0x7f53a8005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d94aca98168b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f5397fff640 1 -- 172.21.15.17:0/3969668011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8009980 con 0x55646714acb0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f5397fff640 1 -- 172.21.15.17:0/3969668011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53a80059e0 con 0x55646714acb0 2024-09-16T01:03:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.563+0000 7f5397fff640 1 -- 172.21.15.17:0/3969668011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a802d480 con 0x55646714acb0 2024-09-16T01:03:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 -- 172.21.15.17:0/3969668011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 msgr2=0x556467166930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53a80096e0 tx=0x7f53a8005890 comp rx=0 tx=0).stop 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 -- 172.21.15.17:0/3969668011 shutdown_connections 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646714acb0 0x556467166930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x556467149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 --2- 172.21.15.17:0/3969668011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646713faf0 0x556467142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 -- 172.21.15.17:0/3969668011 >> 172.21.15.17:0/3969668011 conn(0x55646713c060 msgr2=0x5564671493b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 -- 172.21.15.17:0/3969668011 shutdown_connections 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.564+0000 7f53b7a98740 1 -- 172.21.15.17:0/3969668011 wait complete. 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 -- start start 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 Processor -- start 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x5564671577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 0x556467144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54674/0 (socket says 172.21.15.17:54674) 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 -- 172.21.15.17:0/2988669835 learned_addr learned my addr 172.21.15.17:0/2988669835 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ac9c0 con 0x55646713faf0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ac2f0 con 0x55646714acb0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01a9530 con 0x556467140410 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53add9b640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x5564671577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53b7a98740 10 client.0 _ll_register_callbacks cb 0x7f53a8009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53aed9d640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 0x556467144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 -- 172.21.15.17:0/2988669835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 msgr2=0x5564671577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x5564671577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 -- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 msgr2=0x556467144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 0x556467144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53ae59c640 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564671447f0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.565+0000 7f53aed9d640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 0x556467144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53ae59c640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53a0098420 tx=0x7f53a00d3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dd5d12e49fb1a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0020040 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f53a00980c0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53a80059e0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53a009c150 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53b7a98740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5564671c92b0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53a80059e0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53a00977a0 con 0x55646713faf0 2024-09-16T01:03:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53b7a98740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.566+0000 7f53b7a98740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53b7a98740 20 client.15411 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5564671c99d0 0x5564671cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53b7a98740 4 client.15411 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556467028900 con 0x5564671c99d0 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53add9b640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5564671c99d0 0x5564671cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f5395ffb640 10 client.15411 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.567+0000 7f53add9b640 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5564671c99d0 0x5564671cbe10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f38d166d9960784 server_cookie=4778883ed690ad79 in_seq=0 out_seq=0 2024-09-16T01:03:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f5395ffb640 1 -- 172.21.15.17:0/2988669835 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556467028900 con 0x5564671c99d0 2024-09-16T01:03:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f5395ffb640 10 client.15411 handle_command_reply: tid=0 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 client.15411 shutdown 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 msgr2=0x556467157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53a0098420 tx=0x7f53a00d3040 comp rx=0 tx=0).stop 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 shutdown_connections 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5564671c99d0 0x5564671cbe10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55646714acb0 0x556467144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556467140410 0x5564671577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f5395ffb640 0 client.15411 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 --2- 172.21.15.17:0/2988669835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646713faf0 0x556467157290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.571+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 >> 172.21.15.17:0/2988669835 conn(0x55646713c060 msgr2=0x55646713b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 shutdown_connections 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b7a98740 1 -- 172.21.15.17:0/2988669835 wait complete. 2024-09-16T01:03:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b7a98740 20 client.15411 trim_cache size 0 max 16384 2024-09-16T01:03:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:03:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:03:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:03:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 msgr2=0x7f53980a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 0x7f53980a5b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53a4031440 tx=0x7f53a4005bc0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 msgr2=0x7f53b01982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d770 tx=0x7f53a000dc30 comp rx=0 tx=0).stop 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 shutdown_connections 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f53980a3690 0x7f53980a5b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53b010c0b0 0x7f53b019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0103600 0x7f53b0198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 --2- 172.21.15.17:0/1564664036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b0102ce0 0x7f53b01982d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 >> 172.21.15.17:0/1564664036 conn(0x7f53b0077990 msgr2=0x7f53b00fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 shutdown_connections 2024-09-16T01:03:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:18.572+0000 7f53b4d03640 1 -- 172.21.15.17:0/1564664036 wait complete. 2024-09-16T01:03:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:19 smithi088 ceph-mon[34093]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-16T01:03:19.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:19 smithi154 ceph-mon[34759]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-16T01:03:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:19 smithi017 ceph-mon[31211]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-16T01:03:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:21 smithi088 ceph-mon[34093]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T01:03:21.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:21 smithi154 ceph-mon[34759]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T01:03:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:21 smithi017 ceph-mon[31211]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T01:03:23.612 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 93% (12074/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T01:03:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:23 smithi088 ceph-mon[34093]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:03:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:23 smithi154 ceph-mon[34759]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:03:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:23 smithi017 ceph-mon[31211]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T01:03:24.423 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-16T01:03:24.424 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T01:03:24.428 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T01:03:24.495 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T01:03:24.497 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:03:24.497 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T01:03:25.174 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T01:03:25.247 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T01:03:25.288 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:03:25.289 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:03:25.289 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T01:03:25.329 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:03:25.333 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T01:03:25.333 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T01:03:25.390 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-16T01:03:25.391 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-16T01:03:25.391 DEBUG:teuthology.orchestra.run.smithi017:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-16T01:03:25.456 INFO:tasks.workunit.client.0.smithi017.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-16T01:03:25.457 INFO:tasks.workunit.client.0.smithi017.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-16T01:03:25.457 INFO:tasks.workunit.client.0.smithi017.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-16T01:03:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:25 smithi088 ceph-mon[34093]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-16T01:03:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:25 smithi154 ceph-mon[34759]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-16T01:03:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:25 smithi017 ceph-mon[31211]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-16T01:03:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:27 smithi088 ceph-mon[34093]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:03:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:27 smithi154 ceph-mon[34759]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:03:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:27 smithi017 ceph-mon[31211]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:28.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:28.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:28.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:28.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:03:28.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:03:29.896 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:29 smithi088 ceph-mon[34093]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-16T01:03:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:29 smithi154 ceph-mon[34759]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-16T01:03:29.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:29 smithi017 ceph-mon[31211]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-16T01:03:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 -- 172.21.15.17:0/1340364571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f066010e440 msgr2=0x7f0660110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1340364571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f066010e440 0x7f0660110830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0658009ca0 tx=0x7f065802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 -- 172.21.15.17:0/1340364571 shutdown_connections 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1340364571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f066010e440 0x7f0660110830 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1340364571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 0x7f066010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1340364571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0660100890 0x7f0660100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 -- 172.21.15.17:0/1340364571 >> 172.21.15.17:0/1340364571 conn(0x7f0660077990 msgr2=0x7f06600fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 -- 172.21.15.17:0/1340364571 shutdown_connections 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.672+0000 7f0667f5f640 1 -- 172.21.15.17:0/1340364571 wait complete. 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 Processor -- start 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 -- start start 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 0x7f066019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f066010e440 0x7f066019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0660113fb0 con 0x7f0660100890 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0660113e30 con 0x7f066010e440 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0667f5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0660114130 con 0x7f0660101240 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35016/0 (socket says 172.21.15.17:35016) 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 -- 172.21.15.17:0/1661416130 learned_addr learned my addr 172.21.15.17:0/1661416130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f06654fa640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 0x7f066019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f06664fc640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f066010e440 0x7f066019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 -- 172.21.15.17:0/1661416130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 msgr2=0x7f066019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 0x7f066019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 -- 172.21.15.17:0/1661416130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f066010e440 msgr2=0x7f066019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f066010e440 0x7f066019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.673+0000 7f0665cfb640 1 -- 172.21.15.17:0/1661416130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066019f430 con 0x7f0660100890 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d950 tx=0x7f065c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0656ffd640 1 -- 172.21.15.17:0/1661416130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c017070 con 0x7f0660100890 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0656ffd640 1 -- 172.21.15.17:0/1661416130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f065c009c30 con 0x7f0660100890 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066019f720 con 0x7f0660100890 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0656ffd640 1 -- 172.21.15.17:0/1661416130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c00f620 con 0x7f0660100890 2024-09-16T01:03:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.674+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06601a6fb0 con 0x7f0660100890 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.676+0000 7f0656ffd640 1 -- 172.21.15.17:0/1661416130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f065c0109a0 con 0x7f0660100890 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.676+0000 7f066add6740 1 Processor -- start 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 -- start start 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf79410 0x557ffcf83770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ffcedd2f0 con 0x557ffcf83cb0 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557ffce85270 con 0x557ffcf78af0 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f066add6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ffced92b0 con 0x557ffcf79410 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06654fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06664fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06654fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35028/0 (socket says 172.21.15.17:35028) 2024-09-16T01:03:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06664fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:37012/0 (socket says 172.21.15.17:37012) 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06654fa640 1 -- 172.21.15.17:0/731903724 learned_addr learned my addr 172.21.15.17:0/731903724 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f0656ffd640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 0x7f064c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f0665cfb640 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf79410 0x557ffcf83770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.677+0000 7f06664fc640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 0x7f064c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f0656ffd640 1 -- 172.21.15.17:0/1661416130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f065c0cfad0 con 0x7f0660100890 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 -- 172.21.15.17:0/731903724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf79410 msgr2=0x557ffcf83770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf79410 0x557ffcf83770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 -- 172.21.15.17:0/731903724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 msgr2=0x557ffcf860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 -- 172.21.15.17:0/731903724 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ffce84340 con 0x557ffcf78af0 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06654fa640 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f065802ade0 tx=0x7f0658031f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07c8eeac12759bf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f06664fc640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 0x7f064c0a5b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0658048000 tx=0x7f065804a000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f064bfff640 1 -- 172.21.15.17:0/731903724 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658031850 con 0x557ffcf78af0 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f064bfff640 1 -- 172.21.15.17:0/731903724 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0658036070 con 0x557ffcf78af0 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.678+0000 7f064bfff640 1 -- 172.21.15.17:0/731903724 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658030980 con 0x557ffcf78af0 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- 172.21.15.17:0/731903724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 msgr2=0x557ffcf78ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f065802ade0 tx=0x7f0658031f90 comp rx=0 tx=0).stop 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- 172.21.15.17:0/731903724 shutdown_connections 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf79410 0x557ffcf83770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 --2- 172.21.15.17:0/731903724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf78af0 0x557ffcf78ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- 172.21.15.17:0/731903724 >> 172.21.15.17:0/731903724 conn(0x557ffcf75060 msgr2=0x557ffcf75440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- 172.21.15.17:0/731903724 shutdown_connections 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- 172.21.15.17:0/731903724 wait complete. 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 -- start start 2024-09-16T01:03:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.679+0000 7f066add6740 1 Processor -- start 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf78af0 0x557ffcf80c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf811c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ffcf866a0 con 0x557ffcf83cb0 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557ffce66290 con 0x557ffcf79410 2024-09-16T01:03:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ffcf86820 con 0x557ffcf78af0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f066add6740 10 client.0 _ll_register_callbacks cb 0x557ffce97140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35040/0 (socket says 172.21.15.17:35040) 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 -- 172.21.15.17:0/1406886855 learned_addr learned my addr 172.21.15.17:0/1406886855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06654fa640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf811c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf78af0 0x557ffcf80c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 -- 172.21.15.17:0/1406886855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf78af0 msgr2=0x557ffcf80c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf78af0 0x557ffcf80c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 -- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 msgr2=0x557ffcf811c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf811c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06664fc640 1 -- 172.21.15.17:0/1406886855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ffcbf0210 con 0x557ffcf83cb0 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.680+0000 7f06654fa640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf811c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06664fc640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0658009a60 tx=0x7f0658030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf539905357b2f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658057070 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0658004240 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0658036070 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0658031850 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ffccbc620 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0658036070 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0658053900 con 0x557ffcf83cb0 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.681+0000 7f066add6740 20 client.15423 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcf93980 0x557ffcf95d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f066add6740 4 client.15423 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ffceeaa20 con 0x557ffcf93980 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcf93980 0x557ffcf95d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f0665cfb640 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcf93980 0x557ffcf95d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe8f90dd0cd8dcd server_cookie=5cd349b073ca0455 in_seq=0 out_seq=0 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.682+0000 7f06497fa640 10 client.15423 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f06497fa640 1 -- 172.21.15.17:0/1406886855 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ffceeaa20 con 0x557ffcf93980 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f06497fa640 10 client.15423 handle_command_reply: tid=0 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 client.15423 shutdown 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 msgr2=0x557ffcf81700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0658009a60 tx=0x7f0658030d80 comp rx=0 tx=0).stop 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 shutdown_connections 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcf93980 0x557ffcf95d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf83cb0 0x557ffcf81700 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f06497fa640 0 client.15423 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf811c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 --2- 172.21.15.17:0/1406886855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf78af0 0x557ffcf80c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 >> 172.21.15.17:0/1406886855 conn(0x557ffcf75060 msgr2=0x557ffcf7adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 shutdown_connections 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 1 -- 172.21.15.17:0/1406886855 wait complete. 2024-09-16T01:03:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.683+0000 7f066add6740 20 client.15423 trim_cache size 0 max 16384 2024-09-16T01:03:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 Processor -- start 2024-09-16T01:03:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 -- start start 2024-09-16T01:03:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf81530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06601af7c0 con 0x557ffcf78af0 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06601b1300 con 0x557ffcf79410 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f066add6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06601afe90 con 0x557ffcf83cb0 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35054/0 (socket says 172.21.15.17:35054) 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f0665cfb640 1 -- 172.21.15.17:0/3358200771 learned_addr learned my addr 172.21.15.17:0/3358200771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f0665cfb640 1 -- 172.21.15.17:0/3358200771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 msgr2=0x557ffcf9b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.698+0000 7f06664fc640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f06654fa640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf81530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f0665cfb640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf9b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f0665cfb640 1 -- 172.21.15.17:0/3358200771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 msgr2=0x557ffcf81530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f0665cfb640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf81530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f0665cfb640 1 -- 172.21.15.17:0/3358200771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ffcf81a70 con 0x557ffcf78af0 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f06664fc640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf9b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f06654fa640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf81530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f0665cfb640 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f065c0cd100 tx=0x7f065c06d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a14dd9cd76fd333 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f064b7fe640 1 -- 172.21.15.17:0/3358200771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c0b3070 con 0x557ffcf78af0 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f064b7fe640 1 -- 172.21.15.17:0/3358200771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f065c09ff50 con 0x557ffcf78af0 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f064b7fe640 1 -- 172.21.15.17:0/3358200771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c020040 con 0x557ffcf78af0 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 -- 172.21.15.17:0/3358200771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 msgr2=0x557ffcf7f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f065c0cd100 tx=0x7f065c06d040 comp rx=0 tx=0).stop 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 -- 172.21.15.17:0/3358200771 shutdown_connections 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf9b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf81530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 --2- 172.21.15.17:0/3358200771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf7f530 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.699+0000 7f066add6740 1 -- 172.21.15.17:0/3358200771 >> 172.21.15.17:0/3358200771 conn(0x557ffcf75060 msgr2=0x557ffcf82d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- 172.21.15.17:0/3358200771 shutdown_connections 2024-09-16T01:03:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- 172.21.15.17:0/3358200771 wait complete. 2024-09-16T01:03:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- start start 2024-09-16T01:03:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 Processor -- start 2024-09-16T01:03:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf7db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf7e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06601b0c30 con 0x557ffcf78af0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06601b0560 con 0x557ffcf79410 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06601ad7a0 con 0x557ffcf83cb0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f066add6740 10 client.0 _ll_register_callbacks cb 0x7f0650004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f0665cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35064/0 (socket says 172.21.15.17:35064) 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.700+0000 7f0665cfb640 1 -- 172.21.15.17:0/119944164 learned_addr learned my addr 172.21.15.17:0/119944164 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06664fc640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf7e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06654fa640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 -- 172.21.15.17:0/119944164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 msgr2=0x557ffcf7e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf7e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 -- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 msgr2=0x557ffcf7db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf7db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 -- 172.21.15.17:0/119944164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ffcffd520 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06664fc640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf7e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06654fa640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f0665cfb640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f065c0058c0 tx=0x7f065c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff33d42f4abd073 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06497fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c020070 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f065c086120 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f065c09ff50 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f065c081050 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f066add6740 10 client.15429 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ffcffe660 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.701+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f065c09ff50 con 0x557ffcf78af0 2024-09-16T01:03:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f065c0979a0 con 0x557ffcf78af0 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 10 client.15429 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 20 client.15429 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcffed20 0x557ffd001110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 4 client.15429 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ffcee4d70 con 0x557ffcffed20 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f06654fa640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcffed20 0x557ffd001110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f06497fa640 10 client.15429 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.702+0000 7f06654fa640 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcffed20 0x557ffd001110 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307efa23feb56f73 server_cookie=495a90ff0c61b88d in_seq=0 out_seq=0 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f06497fa640 1 -- 172.21.15.17:0/119944164 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ffcee4d70 con 0x557ffcffed20 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f06497fa640 10 client.15429 handle_command_reply: tid=0 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 client.15429 shutdown 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 msgr2=0x557ffcf8c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f065c0058c0 tx=0x7f065c005bb0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 shutdown_connections 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557ffcffed20 0x557ffd001110 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ffcf83cb0 0x557ffcf7e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557ffcf79410 0x557ffcf7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 --2- 172.21.15.17:0/119944164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ffcf78af0 0x557ffcf8c3b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 >> 172.21.15.17:0/119944164 conn(0x557ffcf75060 msgr2=0x557ffcf7a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f06497fa640 0 client.15429 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 shutdown_connections 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 1 -- 172.21.15.17:0/119944164 wait complete. 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.711+0000 7f066add6740 20 client.15429 trim_cache size 0 max 16384 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:03:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 msgr2=0x7f064c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 0x7f064c0a5b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0658048000 tx=0x7f065804a000 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 msgr2=0x7f066019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d950 tx=0x7f065c00de10 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 shutdown_connections 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f064c0a3690 0x7f064c0a5b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f066010e440 0x7f066019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0660101240 0x7f066019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 --2- 172.21.15.17:0/1661416130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0660100890 0x7f066019a440 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 >> 172.21.15.17:0/1661416130 conn(0x7f0660077990 msgr2=0x7f06600ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 shutdown_connections 2024-09-16T01:03:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:31.712+0000 7f0667f5f640 1 -- 172.21.15.17:0/1661416130 wait complete. 2024-09-16T01:03:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:31 smithi088 ceph-mon[34093]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:31 smithi154 ceph-mon[34759]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:31.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:31 smithi017 ceph-mon[31211]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:33 smithi088 ceph-mon[34093]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:33.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:33 smithi154 ceph-mon[34759]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:33.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:33 smithi017 ceph-mon[31211]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-16T01:03:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:35 smithi088 ceph-mon[34093]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-16T01:03:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:35 smithi154 ceph-mon[34759]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-16T01:03:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:35 smithi017 ceph-mon[31211]: pgmap v39: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-16T01:03:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:37 smithi088 ceph-mon[34093]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-16T01:03:37.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:37 smithi154 ceph-mon[34759]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-16T01:03:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:37 smithi017 ceph-mon[31211]: pgmap v40: 97 pgs: 97 active+clean; 1.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-16T01:03:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:39 smithi088 ceph-mon[34093]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-09-16T01:03:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:39 smithi154 ceph-mon[34759]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-09-16T01:03:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:39 smithi017 ceph-mon[31211]: pgmap v41: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-09-16T01:03:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:41 smithi088 ceph-mon[34093]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:41 smithi154 ceph-mon[34759]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:41 smithi017 ceph-mon[31211]: pgmap v42: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:43.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:43 smithi088 ceph-mon[34093]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:43.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:43 smithi154 ceph-mon[34759]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:43 smithi017 ceph-mon[31211]: pgmap v43: 97 pgs: 97 active+clean; 1.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 -- 172.21.15.17:0/294914822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 msgr2=0x7f92681030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 --2- 172.21.15.17:0/294914822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f92681030a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9258009900 tx=0x7f925802a480 comp rx=0 tx=0).stop 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 -- 172.21.15.17:0/294914822 shutdown_connections 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 --2- 172.21.15.17:0/294914822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 --2- 172.21.15.17:0/294914822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92681035e0 0x7f926810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 --2- 172.21.15.17:0/294914822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f92681030a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 -- 172.21.15.17:0/294914822 >> 172.21.15.17:0/294914822 conn(0x7f92680fc6b0 msgr2=0x7f92680fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 -- 172.21.15.17:0/294914822 shutdown_connections 2024-09-16T01:03:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.813+0000 7f926c8dd640 1 -- 172.21.15.17:0/294914822 wait complete. 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.814+0000 7f926c8dd640 1 Processor -- start 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.814+0000 7f926c8dd640 1 -- start start 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.814+0000 7f926c8dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.814+0000 7f926c8dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92681035e0 0x7f92681987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111da0 con 0x7f9268102cc0 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111c20 con 0x7f926810c110 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9268111f20 con 0x7f92681035e0 2024-09-16T01:03:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50964/0 (socket says 172.21.15.17:50964) 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 -- 172.21.15.17:0/2881484015 learned_addr learned my addr 172.21.15.17:0/2881484015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 -- 172.21.15.17:0/2881484015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92681035e0 msgr2=0x7f92681987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92681035e0 0x7f92681987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 -- 172.21.15.17:0/2881484015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 msgr2=0x7f926819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 -- 172.21.15.17:0/2881484015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926819d280 con 0x7f9268102cc0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926659c640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9258005940 tx=0x7f92580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f92577fe640 1 -- 172.21.15.17:0/2881484015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925803f030 con 0x7f9268102cc0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926819d510 con 0x7f9268102cc0 2024-09-16T01:03:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f92577fe640 1 -- 172.21.15.17:0/2881484015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9258003cb0 con 0x7f9268102cc0 2024-09-16T01:03:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f92577fe640 1 -- 172.21.15.17:0/2881484015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258035070 con 0x7f9268102cc0 2024-09-16T01:03:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.815+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a4e00 con 0x7f9268102cc0 2024-09-16T01:03:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f92577fe640 1 -- 172.21.15.17:0/2881484015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f9258042030 con 0x7f9268102cc0 2024-09-16T01:03:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f926f674740 1 Processor -- start 2024-09-16T01:03:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f926f674740 1 -- start start 2024-09-16T01:03:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f926f674740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f926f674740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.818+0000 7f926f674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926f674740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ba38e22f0 con 0x563ba397e310 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926f674740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x563ba388a270 con 0x563ba397d9f0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926f674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ba38de2b0 con 0x563ba398d0c0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50968/0 (socket says 172.21.15.17:50968) 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 -- 172.21.15.17:0/1976352810 learned_addr learned my addr 172.21.15.17:0/1976352810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f9266d9d640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f9265d9b640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f92577fe640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 0x7f92500a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 0x7f92500a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f92577fe640 1 -- 172.21.15.17:0/2881484015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92580f0820 con 0x7f9268102cc0 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 -- 172.21.15.17:0/1976352810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 msgr2=0x563ba398f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 -- 172.21.15.17:0/1976352810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 msgr2=0x563ba397ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 -- 172.21.15.17:0/1976352810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba3889340 con 0x563ba397e310 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f9266d9d640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.819+0000 7f926659c640 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92580bc5f0 tx=0x7f925802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87620d124f0a539d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 0x7f92500a5ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9260005fd0 tx=0x7f9260004ab0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f9254ff9640 1 -- 172.21.15.17:0/1976352810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258049070 con 0x563ba397e310 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f9254ff9640 1 -- 172.21.15.17:0/1976352810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f925803b460 con 0x563ba397e310 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f9254ff9640 1 -- 172.21.15.17:0/1976352810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92580c5560 con 0x563ba397e310 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 -- 172.21.15.17:0/1976352810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 msgr2=0x563ba398cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92580bc5f0 tx=0x7f925802a480 comp rx=0 tx=0).stop 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 -- 172.21.15.17:0/1976352810 shutdown_connections 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba398cb80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 --2- 172.21.15.17:0/1976352810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.820+0000 7f926f674740 1 -- 172.21.15.17:0/1976352810 >> 172.21.15.17:0/1976352810 conn(0x563ba397a060 msgr2=0x563ba397a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- 172.21.15.17:0/1976352810 shutdown_connections 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- 172.21.15.17:0/1976352810 wait complete. 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- start start 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 Processor -- start 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397e310 0x563ba398a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ba38e22f0 con 0x563ba397d9f0 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x563ba386b290 con 0x563ba397e310 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ba398fae0 con 0x563ba398d0c0 2024-09-16T01:03:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926f674740 10 client.0 _ll_register_callbacks cb 0x563ba389c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50980/0 (socket says 172.21.15.17:50980) 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.821+0000 7f926659c640 1 -- 172.21.15.17:0/2705611742 learned_addr learned my addr 172.21.15.17:0/2705611742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397e310 0x563ba398a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 -- 172.21.15.17:0/2705611742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 msgr2=0x563ba398aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 -- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397e310 msgr2=0x563ba398a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397e310 0x563ba398a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 -- 172.21.15.17:0/2705611742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba35f5210 con 0x563ba397d9f0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926659c640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f92580edea0 tx=0x7f92580a71a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e43aa5a5fcf6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f924dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258049070 con 0x563ba397d9f0 2024-09-16T01:03:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92580bcb50 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ba38efa20 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9258005d50 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926f674740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ba36c1620 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.822+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x563ba38efa20 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f92580c50d0 con 0x563ba397d9f0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 20 client.15441 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba399cbe0 0x563ba399efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 4 client.15441 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ba38e9d70 con 0x563ba399cbe0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba399cbe0 0x563ba399efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba399cbe0 0x563ba399efd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=347cecd4194daa6b server_cookie=8655c51f38ac2d4c in_seq=0 out_seq=0 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.823+0000 7f924dffb640 10 client.15441 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.824+0000 7f924dffb640 1 -- 172.21.15.17:0/2705611742 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ba38e9d70 con 0x563ba399cbe0 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.824+0000 7f924dffb640 10 client.15441 handle_command_reply: tid=0 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.824+0000 7f926f674740 1 client.15441 shutdown 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.824+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 msgr2=0x563ba3989fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.824+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f92580edea0 tx=0x7f92580a71a0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 shutdown_connections 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba399cbe0 0x563ba399efd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba398aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397e310 0x563ba398a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f924dffb640 0 client.15441 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 --2- 172.21.15.17:0/2705611742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397d9f0 0x563ba3989fe0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 >> 172.21.15.17:0/2705611742 conn(0x563ba397a060 msgr2=0x563ba397fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 shutdown_connections 2024-09-16T01:03:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 1 -- 172.21.15.17:0/2705611742 wait complete. 2024-09-16T01:03:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.825+0000 7f926f674740 20 client.15441 trim_cache size 0 max 16384 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.839+0000 7f926f674740 1 Processor -- start 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.839+0000 7f926f674740 1 -- start start 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba39a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f92681ab4b0 con 0x563ba397e310 2024-09-16T01:03:44.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92681acff0 con 0x563ba397d9f0 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926f674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92681abb80 con 0x563ba398d0c0 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50986/0 (socket says 172.21.15.17:50986) 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 -- 172.21.15.17:0/1582516285 learned_addr learned my addr 172.21.15.17:0/1582516285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9266d9d640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba39a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926659c640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 -- 172.21.15.17:0/1582516285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 msgr2=0x563ba39a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba39a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 -- 172.21.15.17:0/1582516285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 msgr2=0x563ba397fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 -- 172.21.15.17:0/1582516285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba397afc0 con 0x563ba397e310 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f926659c640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f9265d9b640 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563ba397f570 tx=0x7f925c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c9f60aed4c8220 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f924ffff640 1 -- 172.21.15.17:0/1582516285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c003d20 con 0x563ba397e310 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f924ffff640 1 -- 172.21.15.17:0/1582516285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f925c01d8d0 con 0x563ba397e310 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.840+0000 7f924ffff640 1 -- 172.21.15.17:0/1582516285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0109d0 con 0x563ba397e310 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- 172.21.15.17:0/1582516285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 msgr2=0x563ba39a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563ba397f570 tx=0x7f925c004410 comp rx=0 tx=0).stop 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- 172.21.15.17:0/1582516285 shutdown_connections 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba39a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba39a47a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 --2- 172.21.15.17:0/1582516285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba397fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- 172.21.15.17:0/1582516285 >> 172.21.15.17:0/1582516285 conn(0x563ba397a060 msgr2=0x563ba397f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- 172.21.15.17:0/1582516285 shutdown_connections 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- 172.21.15.17:0/1582516285 wait complete. 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.841+0000 7f926f674740 1 -- start start 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 Processor -- start 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba3995400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba3990c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f92681ac920 con 0x563ba397e310 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92681ac250 con 0x563ba397d9f0 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92681a9490 con 0x563ba398d0c0 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926f674740 10 client.0 _ll_register_callbacks cb 0x7f9260009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50994/0 (socket says 172.21.15.17:50994) 2024-09-16T01:03:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 -- 172.21.15.17:0/2447049174 learned_addr learned my addr 172.21.15.17:0/2447049174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9266d9d640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba3990c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f926659c640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba3995400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 -- 172.21.15.17:0/2447049174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 msgr2=0x563ba3990c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba3990c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 -- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 msgr2=0x563ba3995400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba3995400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.842+0000 7f9265d9b640 1 -- 172.21.15.17:0/2447049174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba3991490 con 0x563ba397e310 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f9265d9b640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f925c005ff0 tx=0x7f925c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e5fcc56ed5d362 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c01d620 con 0x563ba397e310 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f925c01d8d0 con 0x563ba397e310 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f925c003a40 con 0x563ba397e310 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f925c003c40 con 0x563ba397e310 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 10 client.15447 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ba3a07690 con 0x563ba397e310 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f925c01d8d0 con 0x563ba397e310 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f925c025070 con 0x563ba397e310 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 10 client.15447 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 20 client.15447 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba3a07e20 0x563ba3a0a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 4 client.15447 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.843+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ba3866900 con 0x563ba3a07e20 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.844+0000 7f926659c640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba3a07e20 0x563ba3a0a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.844+0000 7f926659c640 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba3a07e20 0x563ba3a0a240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6ff60a0145f771 server_cookie=c051e019fd5b29a1 in_seq=0 out_seq=0 2024-09-16T01:03:44.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.844+0000 7f924dffb640 10 client.15447 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.857+0000 7f924dffb640 1 -- 172.21.15.17:0/2447049174 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ba3866900 con 0x563ba3a07e20 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f924dffb640 10 client.15447 handle_command_reply: tid=0 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 client.15447 shutdown 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 msgr2=0x563ba3990720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f925c005ff0 tx=0x7f925c009680 comp rx=0 tx=0).stop 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 shutdown_connections 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563ba3a07e20 0x563ba3a0a240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ba398d0c0 0x563ba3990c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ba397e310 0x563ba3990720 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f924dffb640 0 client.15447 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 --2- 172.21.15.17:0/2447049174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x563ba397d9f0 0x563ba3995400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 >> 172.21.15.17:0/2447049174 conn(0x563ba397a060 msgr2=0x563ba39791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 shutdown_connections 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 1 -- 172.21.15.17:0/2447049174 wait complete. 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926f674740 20 client.15447 trim_cache size 0 max 16384 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:03:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 msgr2=0x7f92500a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 0x7f92500a5ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9260005fd0 tx=0x7f9260004ab0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 msgr2=0x7f9268198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.858+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9258005940 tx=0x7f92580042f0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 shutdown_connections 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f92500a3610 0x7f92500a5ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f926810c110 0x7f926819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92681035e0 0x7f92681987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 --2- 172.21.15.17:0/2881484015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9268102cc0 0x7f9268198290 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 >> 172.21.15.17:0/2881484015 conn(0x7f92680fc6b0 msgr2=0x7f92680fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 shutdown_connections 2024-09-16T01:03:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:44.859+0000 7f926c8dd640 1 -- 172.21.15.17:0/2881484015 wait complete. 2024-09-16T01:03:45.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:45 smithi088 ceph-mon[34093]: pgmap v44: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-16T01:03:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:45 smithi154 ceph-mon[34759]: pgmap v44: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-16T01:03:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:45 smithi017 ceph-mon[31211]: pgmap v44: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-16T01:03:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:47 smithi088 ceph-mon[34093]: pgmap v45: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-16T01:03:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:47 smithi154 ceph-mon[34759]: pgmap v45: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-16T01:03:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:47 smithi017 ceph-mon[31211]: pgmap v45: 97 pgs: 97 active+clean; 1.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-16T01:03:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:49 smithi088 ceph-mon[34093]: pgmap v46: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-16T01:03:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:49 smithi154 ceph-mon[34759]: pgmap v46: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-16T01:03:49.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:49 smithi017 ceph-mon[31211]: pgmap v46: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-16T01:03:51.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:51 smithi088 ceph-mon[34093]: pgmap v47: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:51 smithi154 ceph-mon[34759]: pgmap v47: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:51.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:51 smithi017 ceph-mon[31211]: pgmap v47: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:53 smithi088 ceph-mon[34093]: pgmap v48: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:53.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:53 smithi154 ceph-mon[34759]: pgmap v48: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:53 smithi017 ceph-mon[31211]: pgmap v48: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-16T01:03:55.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:55 smithi154 ceph-mon[34759]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:55.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:55 smithi154 ceph-mon[34759]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-16T01:03:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:55 smithi017 ceph-mon[31211]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:55 smithi017 ceph-mon[31211]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-16T01:03:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:55 smithi088 ceph-mon[34093]: pgmap v49: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-16T01:03:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:55 smithi088 ceph-mon[34093]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-16T01:03:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:57 smithi154 ceph-mon[34759]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-16T01:03:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:57 smithi017 ceph-mon[31211]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-16T01:03:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 -- 172.21.15.17:0/4099284806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c101350 msgr2=0x7f031c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 --2- 172.21.15.17:0/4099284806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c101350 0x7f031c10d880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0314009cd0 tx=0x7f031402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 -- 172.21.15.17:0/4099284806 shutdown_connections 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 --2- 172.21.15.17:0/4099284806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c101350 0x7f031c10d880 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 --2- 172.21.15.17:0/4099284806 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c1009b0 0x7f031c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 --2- 172.21.15.17:0/4099284806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1069c0 0x7f031c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 -- 172.21.15.17:0/4099284806 >> 172.21.15.17:0/4099284806 conn(0x7f031c077990 msgr2=0x7f031c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 -- 172.21.15.17:0/4099284806 shutdown_connections 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.959+0000 7f0322f2a640 1 -- 172.21.15.17:0/4099284806 wait complete. 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 Processor -- start 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 -- start start 2024-09-16T01:03:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1009b0 0x7f031c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c101350 0x7f031c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f031c110cb0 con 0x7f031c1069c0 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f031c110b30 con 0x7f031c101350 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0322f2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f031c110e30 con 0x7f031c1009b0 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f03214c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f03214c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39762/0 (socket says 172.21.15.17:39762) 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f03214c7640 1 -- 172.21.15.17:0/682034425 learned_addr learned my addr 172.21.15.17:0/682034425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f0320cc6640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1009b0 0x7f031c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f031bfff640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c101350 0x7f031c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f03214c7640 1 -- 172.21.15.17:0/682034425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1009b0 msgr2=0x7f031c1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.960+0000 7f03214c7640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1009b0 0x7f031c1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f03214c7640 1 -- 172.21.15.17:0/682034425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c101350 msgr2=0x7f031c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f03214c7640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c101350 0x7f031c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f03214c7640 1 -- 172.21.15.17:0/682034425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c19d2b0 con 0x7f031c1069c0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f03214c7640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0314005cc0 tx=0x7f0314003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f0319ffb640 1 -- 172.21.15.17:0/682034425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314004450 con 0x7f031c1069c0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f0319ffb640 1 -- 172.21.15.17:0/682034425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0314031c90 con 0x7f031c1069c0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c19d540 con 0x7f031c1069c0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f0319ffb640 1 -- 172.21.15.17:0/682034425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031403b400 con 0x7f031c1069c0 2024-09-16T01:03:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.961+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1a4e30 con 0x7f031c1069c0 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.964+0000 7f0319ffb640 1 -- 172.21.15.17:0/682034425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0314004680 con 0x7f031c1069c0 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.964+0000 7f0325cc6740 1 Processor -- start 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 -- start start 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb4cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb5c0c0 0x557d7cb5e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d7cab12f0 con 0x557d7cb4d2f0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557d7ca59270 con 0x557d7cb4c9d0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0325cc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d7caad2b0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39772/0 (socket says 172.21.15.17:39772) 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 -- 172.21.15.17:0/3122861298 learned_addr learned my addr 172.21.15.17:0/3122861298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0319ffb640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 0x7f03040a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f031bfff640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb4cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f031bfff640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb5c0c0 0x557d7cb5e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f03214c7640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 0x7f03040a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 -- 172.21.15.17:0/3122861298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb5c0c0 msgr2=0x557d7cb5e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb5c0c0 0x557d7cb5e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0319ffb640 1 -- 172.21.15.17:0/682034425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f031402e030 con 0x7f031c1069c0 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 -- 172.21.15.17:0/3122861298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 msgr2=0x557d7cb4cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb4cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f0320cc6640 1 -- 172.21.15.17:0/3122861298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7ca58340 con 0x557d7cb4d2f0 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.965+0000 7f031bfff640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb4cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.966+0000 7f0320cc6640 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f030c00bcc0 tx=0x7f030c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06d2d783dd63e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.966+0000 7f03214c7640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 0x7f03040a59a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03140bd070 tx=0x7f03140dd040 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.966+0000 7f0302ffd640 1 -- 172.21.15.17:0/3122861298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c011440 con 0x557d7cb4d2f0 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.966+0000 7f0302ffd640 1 -- 172.21.15.17:0/3122861298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f030c011a90 con 0x557d7cb4d2f0 2024-09-16T01:03:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.966+0000 7f0302ffd640 1 -- 172.21.15.17:0/3122861298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c019aa0 con 0x557d7cb4d2f0 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- 172.21.15.17:0/3122861298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 msgr2=0x557d7cb5bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f030c00bcc0 tx=0x7f030c0107a0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- 172.21.15.17:0/3122861298 shutdown_connections 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb5c0c0 0x557d7cb5e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4d2f0 0x557d7cb5bb80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 --2- 172.21.15.17:0/3122861298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb4cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- 172.21.15.17:0/3122861298 >> 172.21.15.17:0/3122861298 conn(0x557d7cb49060 msgr2=0x557d7cb49440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- 172.21.15.17:0/3122861298 shutdown_connections 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- 172.21.15.17:0/3122861298 wait complete. 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 -- start start 2024-09-16T01:03:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.967+0000 7f0325cc6740 1 Processor -- start 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb58f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d7cb5ecf0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557d7ca3a290 con 0x557d7cb4c9d0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557d7cb5ee70 con 0x557d7cb4d2f0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 10 client.0 _ll_register_callbacks cb 0x557d7ca6b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39782/0 (socket says 172.21.15.17:39782) 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 -- 172.21.15.17:0/2578799511 learned_addr learned my addr 172.21.15.17:0/2578799511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb58f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 -- 172.21.15.17:0/2578799511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 msgr2=0x557d7cb594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 -- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 msgr2=0x557d7cb58f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb58f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 -- 172.21.15.17:0/2578799511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7c7c4210 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f031bfff640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f031000bc60 tx=0x7f03100041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f69230d41817e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f02fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310005020 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f03100051c0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.968+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030c011a90 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f03100053c0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 10 client.15459 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d7c890620 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f030c011a90 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f031001c030 con 0x557d7cb5c0c0 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 20 client.15459 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cb6bfe0 0x557d7cb6e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 4 client.15459 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.969+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d7cabea20 con 0x557d7cb6bfe0 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.970+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cb6bfe0 0x557d7cb6e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.970+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cb6bfe0 0x557d7cb6e3d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f6f4ef24bb7d67 server_cookie=c5a6c3657837994 in_seq=0 out_seq=0 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.970+0000 7f02fbfff640 10 client.15459 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f02fbfff640 1 -- 172.21.15.17:0/2578799511 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d7cabea20 con 0x557d7cb6bfe0 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f02fbfff640 10 client.15459 handle_command_reply: tid=0 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 client.15459 shutdown 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 msgr2=0x557d7cb599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f031000bc60 tx=0x7f03100041d0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 shutdown_connections 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cb6bfe0 0x557d7cb6e3d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cb599f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f02fbfff640 0 client.15459 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2578799511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4c9d0 0x557d7cb58f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 >> 172.21.15.17:0/2578799511 conn(0x557d7cb49060 msgr2=0x557d7cb4ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 shutdown_connections 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 1 -- 172.21.15.17:0/2578799511 wait complete. 2024-09-16T01:03:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.971+0000 7f0325cc6740 20 client.15459 trim_cache size 0 max 16384 2024-09-16T01:03:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 Processor -- start 2024-09-16T01:03:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 -- start start 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb5c0c0 0x557d7cb561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ab460 con 0x557d7cb4c9d0 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1acfa0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0325cc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1abb30 con 0x557d7cb4d2f0 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39792/0 (socket says 172.21.15.17:39792) 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f031bfff640 1 -- 172.21.15.17:0/2306162493 learned_addr learned my addr 172.21.15.17:0/2306162493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.986+0000 7f031bfff640 1 -- 172.21.15.17:0/2306162493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 msgr2=0x557d7cb741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f031bfff640 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb741b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f031bfff640 1 -- 172.21.15.17:0/2306162493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb5c0c0 msgr2=0x557d7cb561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f031bfff640 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb5c0c0 0x557d7cb561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f031bfff640 1 -- 172.21.15.17:0/2306162493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7cb48e90 con 0x557d7cb4c9d0 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f031bfff640 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0310000c00 tx=0x7f031000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5920c568887eebba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f03027fc640 1 -- 172.21.15.17:0/2306162493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310005560 con 0x557d7cb4c9d0 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f03027fc640 1 -- 172.21.15.17:0/2306162493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f031002d040 con 0x557d7cb4c9d0 2024-09-16T01:03:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f03027fc640 1 -- 172.21.15.17:0/2306162493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310026ca0 con 0x557d7cb4c9d0 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f0325cc6740 1 -- 172.21.15.17:0/2306162493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 msgr2=0x557d7cb73c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.987+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0310000c00 tx=0x7f031000b910 comp rx=0 tx=0).stop 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- 172.21.15.17:0/2306162493 shutdown_connections 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb5c0c0 0x557d7cb561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4d2f0 0x557d7cb741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2306162493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb4c9d0 0x557d7cb73c70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- 172.21.15.17:0/2306162493 >> 172.21.15.17:0/2306162493 conn(0x557d7cb49060 msgr2=0x557d7cb5aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- 172.21.15.17:0/2306162493 shutdown_connections 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- 172.21.15.17:0/2306162493 wait complete. 2024-09-16T01:03:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- start start 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 Processor -- start 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4c9d0 0x557d7cb60550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4d2f0 0x557d7cb60a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ac8d0 con 0x557d7cb5c0c0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ac200 con 0x557d7cb4d2f0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1a9440 con 0x557d7cb4c9d0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.988+0000 7f0325cc6740 10 client.0 _ll_register_callbacks cb 0x7f0310004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39808/0 (socket says 172.21.15.17:39808) 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 -- 172.21.15.17:0/2626987173 learned_addr learned my addr 172.21.15.17:0/2626987173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4c9d0 0x557d7cb60550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4d2f0 0x557d7cb60a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 -- 172.21.15.17:0/2626987173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4c9d0 msgr2=0x557d7cb60550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4c9d0 0x557d7cb60550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 -- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4d2f0 msgr2=0x557d7cb60a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4d2f0 0x557d7cb60a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 -- 172.21.15.17:0/2626987173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7cbd6180 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f031bfff640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f031000bf70 tx=0x7f03100042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff75121b401f269f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f02fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310026790 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0310026930 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f031002d040 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0310011860 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f0325cc6740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.989+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d7cbd7400 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f031002d040 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0310030070 con 0x557d7cb5c0c0 2024-09-16T01:03:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 20 client.15465 populate_metadata read hostname 'smithi017' 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cbd7a00 0x557d7cbd9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 4 client.15465 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d7cab8d70 con 0x557d7cbd7a00 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cbd7a00 0x557d7cbd9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f02fbfff640 10 client.15465 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:57.990+0000 7f0320cc6640 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cbd7a00 0x557d7cbd9e20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc42a80727438908 server_cookie=3e0139bb8ce6a73f in_seq=0 out_seq=0 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f02fbfff640 1 -- 172.21.15.17:0/2626987173 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d7cab8d70 con 0x557d7cbd7a00 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f02fbfff640 10 client.15465 handle_command_reply: tid=0 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 client.15465 shutdown 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 msgr2=0x557d7cbd5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f031000bf70 tx=0x7f03100042a0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 shutdown_connections 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557d7cbd7a00 0x557d7cbd9e20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d7cb5c0c0 0x557d7cbd5c40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557d7cb4d2f0 0x557d7cb60a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f02fbfff640 0 client.15465 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 --2- 172.21.15.17:0/2626987173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557d7cb4c9d0 0x557d7cb60550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.005+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 >> 172.21.15.17:0/2626987173 conn(0x557d7cb49060 msgr2=0x557d7cb479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 shutdown_connections 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0325cc6740 1 -- 172.21.15.17:0/2626987173 wait complete. 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0325cc6740 20 client.15465 trim_cache size 0 max 16384 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:03:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:03:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:03:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:03:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 msgr2=0x7f03040a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 0x7f03040a59a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03140bd070 tx=0x7f03140dd040 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 msgr2=0x7f031c19cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0314005cc0 tx=0x7f0314003c20 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 shutdown_connections 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f03040a34e0 0x7f03040a59a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c1069c0 0x7f031c19cb80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f031c101350 0x7f031c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 --2- 172.21.15.17:0/682034425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c1009b0 0x7f031c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 >> 172.21.15.17:0/682034425 conn(0x7f031c077990 msgr2=0x7f031c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 shutdown_connections 2024-09-16T01:03:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:03:58.006+0000 7f0322f2a640 1 -- 172.21.15.17:0/682034425 wait complete. 2024-09-16T01:03:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:57 smithi088 ceph-mon[34093]: pgmap v50: 97 pgs: 97 active+clean; 1.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-16T01:03:59.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:03:59 smithi017 ceph-mon[31211]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 27 op/s 2024-09-16T01:04:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:03:59 smithi088 ceph-mon[34093]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 27 op/s 2024-09-16T01:04:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:03:59 smithi154 ceph-mon[34759]: pgmap v51: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 27 op/s 2024-09-16T01:04:01.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:01 smithi017 ceph-mon[31211]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:02.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:01 smithi088 ceph-mon[34093]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:01 smithi154 ceph-mon[34759]: pgmap v52: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:03 smithi017 ceph-mon[31211]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:03 smithi088 ceph-mon[34093]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:03 smithi154 ceph-mon[34759]: pgmap v53: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-16T01:04:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:05 smithi017 ceph-mon[31211]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 39 op/s 2024-09-16T01:04:06.142 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:05 smithi088 ceph-mon[34093]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 39 op/s 2024-09-16T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:05 smithi154 ceph-mon[34759]: pgmap v54: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 39 op/s 2024-09-16T01:04:07.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:07 smithi017 ceph-mon[31211]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-16T01:04:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:07 smithi088 ceph-mon[34093]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-16T01:04:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:07 smithi154 ceph-mon[34759]: pgmap v55: 97 pgs: 97 active+clean; 1.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-16T01:04:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:09 smithi017 ceph-mon[31211]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-16T01:04:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:09 smithi088 ceph-mon[34093]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-16T01:04:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:09 smithi154 ceph-mon[34759]: pgmap v56: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 -- 172.21.15.17:0/4119023364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 msgr2=0x7f639810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 --2- 172.21.15.17:0/4119023364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639810e550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ca0 tx=0x7f639002a950 comp rx=0 tx=0).stop 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 -- 172.21.15.17:0/4119023364 shutdown_connections 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 --2- 172.21.15.17:0/4119023364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639810e550 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 --2- 172.21.15.17:0/4119023364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f639810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 --2- 172.21.15.17:0/4119023364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 0x7f63981030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 -- 172.21.15.17:0/4119023364 >> 172.21.15.17:0/4119023364 conn(0x7f6398077990 msgr2=0x7f63980fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 -- 172.21.15.17:0/4119023364 shutdown_connections 2024-09-16T01:04:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.107+0000 7f639daac640 1 -- 172.21.15.17:0/4119023364 wait complete. 2024-09-16T01:04:11.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 Processor -- start 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 -- start start 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 0x7f6398198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f63981987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6398111d20 con 0x7f639810c0b0 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6398111ba0 con 0x7f6398102ce0 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.108+0000 7f639daac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6398111ea0 con 0x7f6398103600 2024-09-16T01:04:11.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43870/0 (socket says 172.21.15.17:43870) 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 -- 172.21.15.17:0/84282411 learned_addr learned my addr 172.21.15.17:0/84282411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f63977fe640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 0x7f6398198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6396ffd640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f63981987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 -- 172.21.15.17:0/84282411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 msgr2=0x7f63981987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f63981987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 -- 172.21.15.17:0/84282411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 msgr2=0x7f6398198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 0x7f6398198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 -- 172.21.15.17:0/84282411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639819d260 con 0x7f639810c0b0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6396ffd640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f63981987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6397fff640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f639002ae70 tx=0x7f639002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6394ff9640 1 -- 172.21.15.17:0/84282411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390034040 con 0x7f639810c0b0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6394ff9640 1 -- 172.21.15.17:0/84282411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63900308f0 con 0x7f639810c0b0 2024-09-16T01:04:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639819d4f0 con 0x7f639810c0b0 2024-09-16T01:04:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f6394ff9640 1 -- 172.21.15.17:0/84282411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390004780 con 0x7f639810c0b0 2024-09-16T01:04:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.109+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981a4de0 con 0x7f639810c0b0 2024-09-16T01:04:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.112+0000 7f6394ff9640 1 -- 172.21.15.17:0/84282411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6390037020 con 0x7f639810c0b0 2024-09-16T01:04:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.112+0000 7f63a084a740 1 Processor -- start 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.112+0000 7f63a084a740 1 -- start start 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a433ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56376a3982f0 con 0x56376a434410 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56376a340270 con 0x56376a43ecb0 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63a084a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56376a3942b0 con 0x56376a433af0 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6394ff9640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 0x7f63800a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43882/0 (socket says 172.21.15.17:43882) 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 -- 172.21.15.17:0/2268964402 learned_addr learned my addr 172.21.15.17:0/2268964402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6396ffd640 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a433ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6397fff640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 0x7f63800a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6394ff9640 1 -- 172.21.15.17:0/84282411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f63900f0cb0 con 0x7f639810c0b0 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6396ffd640 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 -- 172.21.15.17:0/2268964402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 msgr2=0x56376a433ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a433ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 -- 172.21.15.17:0/2268964402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 msgr2=0x56376a4410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 -- 172.21.15.17:0/2268964402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376a33f340 con 0x56376a434410 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f63977fe640 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f638800bcd0 tx=0x7f63880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50db6c0fa7ef168 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.113+0000 7f6397fff640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 0x7f63800a59a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63900bcd70 tx=0x7f63900b2500 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f637dffb640 1 -- 172.21.15.17:0/2268964402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388005220 con 0x56376a434410 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f637dffb640 1 -- 172.21.15.17:0/2268964402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6388004c50 con 0x56376a434410 2024-09-16T01:04:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f637dffb640 1 -- 172.21.15.17:0/2268964402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388011730 con 0x56376a434410 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 -- 172.21.15.17:0/2268964402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 msgr2=0x56376a43e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f638800bcd0 tx=0x7f63880107a0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 -- 172.21.15.17:0/2268964402 shutdown_connections 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43e770 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 --2- 172.21.15.17:0/2268964402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a433ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 -- 172.21.15.17:0/2268964402 >> 172.21.15.17:0/2268964402 conn(0x56376a430060 msgr2=0x56376a430440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 -- 172.21.15.17:0/2268964402 shutdown_connections 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.114+0000 7f63a084a740 1 -- 172.21.15.17:0/2268964402 wait complete. 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 -- start start 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 Processor -- start 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a43c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56376a441880 con 0x56376a434410 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56376a321290 con 0x56376a43ecb0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.115+0000 7f63a084a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56376a441a00 con 0x56376a433af0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43886/0 (socket says 172.21.15.17:43886) 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 -- 172.21.15.17:0/1477879062 learned_addr learned my addr 172.21.15.17:0/1477879062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63a084a740 10 client.0 _ll_register_callbacks cb 0x56376a352140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6396ffd640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a43c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6396ffd640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 -- 172.21.15.17:0/1477879062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 msgr2=0x56376a43bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 -- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 msgr2=0x56376a43c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a43c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 -- 172.21.15.17:0/1477879062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56376a0ab210 con 0x56376a434410 2024-09-16T01:04:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6396ffd640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63977fe640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f638800bca0 tx=0x7f63880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc24f419cb9aabb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638800b8c0 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6388005010 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6388004c50 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6388005210 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63a084a740 10 client.15477 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.116+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56376a177620 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6388004c50 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f638801b430 con 0x56376a434410 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 20 client.15477 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a44ebc0 0x56376a450fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 4 client.15477 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56376a3a5a20 con 0x56376a44ebc0 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.117+0000 7f6396ffd640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a44ebc0 0x56376a450fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.118+0000 7f6396ffd640 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a44ebc0 0x56376a450fb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d88ca5ac917297fa server_cookie=36c9d1fd1ccbe5a1 in_seq=0 out_seq=0 2024-09-16T01:04:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.118+0000 7f6376ffd640 10 client.15477 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f6376ffd640 1 -- 172.21.15.17:0/1477879062 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56376a3a5a20 con 0x56376a44ebc0 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f6376ffd640 10 client.15477 handle_command_reply: tid=0 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 client.15477 shutdown 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 msgr2=0x56376a43c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f638800bca0 tx=0x7f63880048f0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 shutdown_connections 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a44ebc0 0x56376a450fb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a43c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43c0c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f6376ffd640 0 client.15477 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 --2- 172.21.15.17:0/1477879062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 >> 172.21.15.17:0/1477879062 conn(0x56376a430060 msgr2=0x56376a435d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 shutdown_connections 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 1 -- 172.21.15.17:0/1477879062 wait complete. 2024-09-16T01:04:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.119+0000 7f63a084a740 20 client.15477 trim_cache size 0 max 16384 2024-09-16T01:04:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 Processor -- start 2024-09-16T01:04:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 -- start start 2024-09-16T01:04:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ad620 con 0x56376a434410 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63981af160 con 0x56376a43ecb0 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63a084a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63981adcf0 con 0x56376a433af0 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43894/0 (socket says 172.21.15.17:43894) 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 -- 172.21.15.17:0/4262613950 learned_addr learned my addr 172.21.15.17:0/4262613950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f6396ffd640 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 -- 172.21.15.17:0/4262613950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 msgr2=0x56376a43c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 -- 172.21.15.17:0/4262613950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 msgr2=0x56376a4566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.134+0000 7f63977fe640 1 -- 172.21.15.17:0/4262613950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376a43a0b0 con 0x56376a434410 2024-09-16T01:04:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63977fe640 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f638801b8d0 tx=0x7f63880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea66c26057357b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f637d7fa640 1 -- 172.21.15.17:0/4262613950 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388033030 con 0x56376a434410 2024-09-16T01:04:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f637d7fa640 1 -- 172.21.15.17:0/4262613950 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638800b810 con 0x56376a434410 2024-09-16T01:04:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f637d7fa640 1 -- 172.21.15.17:0/4262613950 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638801f070 con 0x56376a434410 2024-09-16T01:04:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 -- 172.21.15.17:0/4262613950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 msgr2=0x56376a43daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f638801b8d0 tx=0x7f63880107a0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 -- 172.21.15.17:0/4262613950 shutdown_connections 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a4566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a434410 0x56376a43daf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 --2- 172.21.15.17:0/4262613950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a433af0 0x56376a43c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.135+0000 7f63a084a740 1 -- 172.21.15.17:0/4262613950 >> 172.21.15.17:0/4262613950 conn(0x56376a430060 msgr2=0x56376a43d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- 172.21.15.17:0/4262613950 shutdown_connections 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- 172.21.15.17:0/4262613950 wait complete. 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- start start 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 Processor -- start 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a434410 0x56376a4426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a442be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63981aea90 con 0x56376a433af0 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ae3c0 con 0x56376a43ecb0 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ab600 con 0x56376a434410 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f63a084a740 10 client.0 _ll_register_callbacks cb 0x7f638c00c4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.136+0000 7f6396ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43900/0 (socket says 172.21.15.17:43900) 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 -- 172.21.15.17:0/2491266339 learned_addr learned my addr 172.21.15.17:0/2491266339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 -- 172.21.15.17:0/2491266339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a434410 msgr2=0x56376a4426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a434410 0x56376a4426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 -- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 msgr2=0x56376a442be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a442be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 -- 172.21.15.17:0/2491266339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56376a443410 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6396ffd640 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f638c0058c0 tx=0x7f638c011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8df6a19a3fa8d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c011e70 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f638800b810 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f638c01c030 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f638c030050 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f63a084a740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.137+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56376a4b9640 con 0x56376a433af0 2024-09-16T01:04:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638800b810 con 0x56376a433af0 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f638c0218a0 con 0x56376a433af0 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 20 client.15483 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a4b9d90 0x56376a4bc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 4 client.15483 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56376a39fd70 con 0x56376a4b9d90 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63977fe640 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a4b9d90 0x56376a4bc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f6376ffd640 10 client.15483 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.138+0000 7f63977fe640 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a4b9d90 0x56376a4bc1f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c5ad7814ebf560 server_cookie=5e67b456db440d95 in_seq=0 out_seq=0 2024-09-16T01:04:11.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f6376ffd640 1 -- 172.21.15.17:0/2491266339 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56376a39fd70 con 0x56376a4b9d90 2024-09-16T01:04:11.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f6376ffd640 10 client.15483 handle_command_reply: tid=0 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 client.15483 shutdown 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 msgr2=0x56376a447330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f638c0058c0 tx=0x7f638c011c80 comp rx=0 tx=0).stop 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 shutdown_connections 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56376a4b9d90 0x56376a4bc1f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56376a43ecb0 0x56376a442be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56376a434410 0x56376a4426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f6376ffd640 0 client.15483 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 --2- 172.21.15.17:0/2491266339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56376a433af0 0x56376a447330 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 >> 172.21.15.17:0/2491266339 conn(0x56376a430060 msgr2=0x56376a435d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 shutdown_connections 2024-09-16T01:04:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 1 -- 172.21.15.17:0/2491266339 wait complete. 2024-09-16T01:04:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f63a084a740 20 client.15483 trim_cache size 0 max 16384 2024-09-16T01:04:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:04:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:04:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:04:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:04:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 msgr2=0x7f63800a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 0x7f63800a59a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f63900bcd70 tx=0x7f63900b2500 comp rx=0 tx=0).stop 2024-09-16T01:04:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 msgr2=0x7f639819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f639002ae70 tx=0x7f639002f5d0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 shutdown_connections 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f63800a34e0 0x7f63800a59a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f639810c0b0 0x7f639819cb30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6398103600 0x7f63981987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 --2- 172.21.15.17:0/84282411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6398102ce0 0x7f6398198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 >> 172.21.15.17:0/84282411 conn(0x7f6398077990 msgr2=0x7f63980fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.154+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 shutdown_connections 2024-09-16T01:04:11.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:11.155+0000 7f639daac640 1 -- 172.21.15.17:0/84282411 wait complete. 2024-09-16T01:04:11.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:11 smithi017 ceph-mon[31211]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:11 smithi088 ceph-mon[34093]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:12.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:11 smithi154 ceph-mon[34759]: pgmap v57: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:13 smithi017 ceph-mon[31211]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:13 smithi088 ceph-mon[34093]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:14.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:13 smithi154 ceph-mon[34759]: pgmap v58: 97 pgs: 97 active+clean; 2.0 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-16T01:04:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:15 smithi017 ceph-mon[31211]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 38 op/s 2024-09-16T01:04:15.945 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:15 smithi088 ceph-mon[34093]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 38 op/s 2024-09-16T01:04:15.956 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:15 smithi154 ceph-mon[34759]: pgmap v59: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 38 op/s 2024-09-16T01:04:17.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:17 smithi017 ceph-mon[31211]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:17 smithi088 ceph-mon[34093]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:17 smithi154 ceph-mon[34759]: pgmap v60: 97 pgs: 97 active+clean; 2.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:19 smithi017 ceph-mon[31211]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:19 smithi088 ceph-mon[34093]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:19 smithi154 ceph-mon[34759]: pgmap v61: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:21.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:21 smithi017 ceph-mon[31211]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:21 smithi088 ceph-mon[34093]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:21 smithi154 ceph-mon[34759]: pgmap v62: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:23 smithi088 ceph-mon[34093]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:23 smithi154 ceph-mon[34759]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:23 smithi017 ceph-mon[31211]: pgmap v63: 97 pgs: 97 active+clean; 2.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-16T01:04:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 -- 172.21.15.17:0/167699194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 msgr2=0x7fe0cc10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/167699194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc10bac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009900 tx=0x7fe0c002a480 comp rx=0 tx=0).stop 2024-09-16T01:04:24.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 -- 172.21.15.17:0/167699194 shutdown_connections 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/167699194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc10c110 0x7fe0cc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/167699194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc10bac0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/167699194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc102cc0 0x7fe0cc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 -- 172.21.15.17:0/167699194 >> 172.21.15.17:0/167699194 conn(0x7fe0cc0fc6b0 msgr2=0x7fe0cc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 -- 172.21.15.17:0/167699194 shutdown_connections 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.256+0000 7fe0d24f1640 1 -- 172.21.15.17:0/167699194 wait complete. 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.257+0000 7fe0d24f1640 1 Processor -- start 2024-09-16T01:04:24.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.257+0000 7fe0d24f1640 1 -- start start 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102cc0 0x7fe0cc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc10c110 0x7fe0cc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc111da0 con 0x7fe0cc1035e0 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc111c20 con 0x7fe0cc10c110 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d24f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc111f20 con 0x7fe0cc102cc0 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52888/0 (socket says 172.21.15.17:52888) 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 -- 172.21.15.17:0/3632142597 learned_addr learned my addr 172.21.15.17:0/3632142597 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102cc0 0x7fe0cc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc10c110 0x7fe0cc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 -- 172.21.15.17:0/3632142597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102cc0 msgr2=0x7fe0cc1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102cc0 0x7fe0cc1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 -- 172.21.15.17:0/3632142597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc10c110 msgr2=0x7fe0cc19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc10c110 0x7fe0cc19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 -- 172.21.15.17:0/3632142597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc19d2b0 con 0x7fe0cc1035e0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.258+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006010 tx=0x7fe0c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.259+0000 7fe0c97fa640 1 -- 172.21.15.17:0/3632142597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c003f030 con 0x7fe0cc1035e0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.259+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc19d540 con 0x7fe0cc1035e0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.259+0000 7fe0c97fa640 1 -- 172.21.15.17:0/3632142597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c0003800 con 0x7fe0cc1035e0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.259+0000 7fe0c97fa640 1 -- 172.21.15.17:0/3632142597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0035070 con 0x7fe0cc1035e0 2024-09-16T01:04:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.259+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc1a4e30 con 0x7fe0cc1035e0 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.261+0000 7fe0c97fa640 1 -- 172.21.15.17:0/3632142597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe0c0031af0 con 0x7fe0cc1035e0 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.261+0000 7fe0d528f740 1 Processor -- start 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.261+0000 7fe0d528f740 1 -- start start 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.261+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.261+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d528f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5586ba8302f0 con 0x5586ba8cbaf0 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d528f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5586ba7d8270 con 0x5586ba8d6cb0 2024-09-16T01:04:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d528f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5586ba82c2b0 con 0x5586ba8cc410 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52902/0 (socket says 172.21.15.17:52902) 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/3079340941 learned_addr learned my addr 172.21.15.17:0/3079340941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0c97fa640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 0x7fe0b40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/3079340941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 msgr2=0x5586ba8d6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/3079340941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 msgr2=0x5586ba8d90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/3079340941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ba7d7340 con 0x5586ba8cbaf0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 0x7fe0b40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0c97fa640 1 -- 172.21.15.17:0/3632142597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0c00f0540 con 0x7fe0cc1035e0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.262+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400af50 tx=0x7fe0c400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca73a7f7b4659432 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0b27fc640 1 -- 172.21.15.17:0/3079340941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401ac60 con 0x5586ba8cbaf0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0b27fc640 1 -- 172.21.15.17:0/3079340941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c401ae00 con 0x5586ba8cbaf0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0b27fc640 1 -- 172.21.15.17:0/3079340941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400d540 con 0x5586ba8cbaf0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 -- 172.21.15.17:0/3079340941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 msgr2=0x5586ba8cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400af50 tx=0x7fe0c400f850 comp rx=0 tx=0).stop 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 0x7fe0b40a5920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4020000 tx=0x7fe0c401c030 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 -- 172.21.15.17:0/3079340941 shutdown_connections 2024-09-16T01:04:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 --2- 172.21.15.17:0/3079340941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8cbed0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.263+0000 7fe0d528f740 1 -- 172.21.15.17:0/3079340941 >> 172.21.15.17:0/3079340941 conn(0x5586ba8c8060 msgr2=0x5586ba8c8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- 172.21.15.17:0/3079340941 shutdown_connections 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- 172.21.15.17:0/3079340941 wait complete. 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- start start 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 Processor -- start 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5586ba8d9880 con 0x5586ba8cbaf0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5586ba7b9290 con 0x5586ba8d6cb0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5586ba8d9a00 con 0x5586ba8cc410 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.264+0000 7fe0d528f740 10 client.0 _ll_register_callbacks cb 0x5586ba7ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52916/0 (socket says 172.21.15.17:52916) 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 -- 172.21.15.17:0/2779246053 learned_addr learned my addr 172.21.15.17:0/2779246053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 -- 172.21.15.17:0/2779246053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 msgr2=0x5586ba8d4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 -- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 msgr2=0x5586ba8d4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 -- 172.21.15.17:0/2779246053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ba543210 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc010820 tx=0x7fe0bc010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b6a1cf7b9bc2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00fb10 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0bc00fcb0 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c401ae00 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.265+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc005020 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 10 client.15495 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586ba60f620 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c401ae00 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0bc022430 con 0x5586ba8cbaf0 2024-09-16T01:04:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 20 client.15495 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba8e6c80 0x5586ba8e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 4 client.15495 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586ba83da20 con 0x5586ba8e6c80 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.266+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba8e6c80 0x5586ba8e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.267+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba8e6c80 0x5586ba8e90d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19503747dd7a2e6e server_cookie=ede9f7057f0cfe44 in_seq=0 out_seq=0 2024-09-16T01:04:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.267+0000 7fe0ab7fe640 10 client.15495 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:24.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.267+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/2779246053 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586ba83da20 con 0x5586ba8e6c80 2024-09-16T01:04:24.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.267+0000 7fe0ab7fe640 10 client.15495 handle_command_reply: tid=0 2024-09-16T01:04:24.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.267+0000 7fe0d528f740 1 client.15495 shutdown 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 msgr2=0x5586ba8d3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc010820 tx=0x7fe0bc010ce0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 shutdown_connections 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba8e6c80 0x5586ba8e90d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0ab7fe640 0 client.15495 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 --2- 172.21.15.17:0/2779246053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8d3bc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 >> 172.21.15.17:0/2779246053 conn(0x5586ba8c8060 msgr2=0x5586ba8c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 shutdown_connections 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 1 -- 172.21.15.17:0/2779246053 wait complete. 2024-09-16T01:04:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.268+0000 7fe0d528f740 20 client.15495 trim_cache size 0 max 16384 2024-09-16T01:04:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 Processor -- start 2024-09-16T01:04:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 -- start start 2024-09-16T01:04:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 0x5586ba8ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1ad690 con 0x5586ba8d6cb0 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1af1d0 con 0x5586ba8cbaf0 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d528f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1add60 con 0x5586ba8cc410 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 0x5586ba8ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52922/0 (socket says 172.21.15.17:52922) 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/1178714733 learned_addr learned my addr 172.21.15.17:0/1178714733 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 0x5586ba8ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:41716/0 (socket says 172.21.15.17:41716) 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/1178714733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 msgr2=0x5586ba8d4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/1178714733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 msgr2=0x5586ba8ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 0x5586ba8ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.283+0000 7fe0d0a8e640 1 -- 172.21.15.17:0/1178714733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ba8cb920 con 0x5586ba8d6cb0 2024-09-16T01:04:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4014fd0 tx=0x7fe0c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a76673e3d36ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0b1ffb640 1 -- 172.21.15.17:0/1178714733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4034070 con 0x5586ba8d6cb0 2024-09-16T01:04:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0b1ffb640 1 -- 172.21.15.17:0/1178714733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c4012270 con 0x5586ba8d6cb0 2024-09-16T01:04:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0b1ffb640 1 -- 172.21.15.17:0/1178714733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4019370 con 0x5586ba8d6cb0 2024-09-16T01:04:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 -- 172.21.15.17:0/1178714733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 msgr2=0x5586ba8eea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4014fd0 tx=0x7fe0c4012000 comp rx=0 tx=0).stop 2024-09-16T01:04:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 -- 172.21.15.17:0/1178714733 shutdown_connections 2024-09-16T01:04:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8d6cb0 0x5586ba8eea30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1178714733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8cbaf0 0x5586ba8ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 -- 172.21.15.17:0/1178714733 >> 172.21.15.17:0/1178714733 conn(0x5586ba8c8060 msgr2=0x5586ba8d5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 -- 172.21.15.17:0/1178714733 shutdown_connections 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.284+0000 7fe0d528f740 1 -- 172.21.15.17:0/1178714733 wait complete. 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 -- start start 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 Processor -- start 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1aeb00 con 0x5586ba8cbaf0 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1ae430 con 0x5586ba8d6cb0 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1ab670 con 0x5586ba8cc410 2024-09-16T01:04:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0d528f740 10 client.0 _ll_register_callbacks cb 0x7fe0bc00a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52924/0 (socket says 172.21.15.17:52924) 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.285+0000 7fe0cbfff640 1 -- 172.21.15.17:0/1726683512 learned_addr learned my addr 172.21.15.17:0/1726683512 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 -- 172.21.15.17:0/1726683512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 msgr2=0x5586ba8d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 -- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 msgr2=0x5586ba8d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 -- 172.21.15.17:0/1726683512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ba950a00 con 0x5586ba8cbaf0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0d0a8e640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0cbfff640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0107f0 tx=0x7fe0bc022660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89afde50cbd53ed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc02f020 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0bc00fb10 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c4012270 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc03a050 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0d528f740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.286+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586ba951bb0 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c4012270 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0bc0049d0 con 0x5586ba8cbaf0 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 20 client.15501 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba952350 0x5586ba954770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 4 client.15501 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:04:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586ba837d70 con 0x5586ba952350 2024-09-16T01:04:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.287+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba952350 0x5586ba954770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.288+0000 7fe0cb7fe640 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba952350 0x5586ba954770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22178ec7e8e0026f server_cookie=49efab5f03fa78e6 in_seq=0 out_seq=0 2024-09-16T01:04:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.288+0000 7fe0ab7fe640 10 client.15501 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.303+0000 7fe0ab7fe640 1 -- 172.21.15.17:0/1726683512 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586ba837d70 con 0x5586ba952350 2024-09-16T01:04:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.303+0000 7fe0ab7fe640 10 client.15501 handle_command_reply: tid=0 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.303+0000 7fe0d528f740 1 client.15501 shutdown 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 msgr2=0x5586ba8df570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0107f0 tx=0x7fe0bc022660 comp rx=0 tx=0).stop 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 shutdown_connections 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5586ba952350 0x5586ba954770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5586ba8d6cb0 0x5586ba8d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586ba8cc410 0x5586ba8d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 --2- 172.21.15.17:0/1726683512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5586ba8cbaf0 0x5586ba8df570 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0ab7fe640 0 client.15501 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 >> 172.21.15.17:0/1726683512 conn(0x5586ba8c8060 msgr2=0x5586ba8c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 shutdown_connections 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 1 -- 172.21.15.17:0/1726683512 wait complete. 2024-09-16T01:04:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d528f740 20 client.15501 trim_cache size 0 max 16384 2024-09-16T01:04:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:04:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:04:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:04:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 msgr2=0x7fe0b40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 0x7fe0b40a5920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4020000 tx=0x7fe0c401c030 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 msgr2=0x7fe0cc198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.304+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006010 tx=0x7fe0c00042f0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 shutdown_connections 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe0b40a3460 0x7fe0b40a5920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0cc10c110 0x7fe0cc19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0cc1035e0 0x7fe0cc198800 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 --2- 172.21.15.17:0/3632142597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102cc0 0x7fe0cc1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 >> 172.21.15.17:0/3632142597 conn(0x7fe0cc0fc6b0 msgr2=0x7fe0cc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 shutdown_connections 2024-09-16T01:04:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:24.305+0000 7fe0d24f1640 1 -- 172.21.15.17:0/3632142597 wait complete. 2024-09-16T01:04:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:25 smithi088 ceph-mon[34093]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:25 smithi154 ceph-mon[34759]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:25 smithi017 ceph-mon[31211]: pgmap v64: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 23 op/s 2024-09-16T01:04:28.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:27 smithi088 ceph-mon[34093]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:28.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:27 smithi154 ceph-mon[34759]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:28.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:27 smithi017 ceph-mon[31211]: pgmap v65: 97 pgs: 97 active+clean; 2.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:28.989 INFO:tasks.workunit.client.0.smithi017.stdout:1/600: open fd = 3 2024-09-16T01:04:28.989 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.989 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/600: open fd = 3 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:3/600: open fd = 3 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:4/600: open fd = 3 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:5/600: open fd = 3 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:6/600: open fd = 3 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:7/600: open fd = 3 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/600: open fd = 3 2024-09-16T01:04:28.991 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/600: open fd = 3 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:10/600: open fd = 3 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:11/600: open fd = 3 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:12/600: open fd = 3 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:13/600: open fd = 3 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.993 INFO:tasks.workunit.client.0.smithi017.stdout:14/600: open fd = 3 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:15/600: open fd = 3 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:16/600: open fd = 3 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:17/600: open fd = 3 2024-09-16T01:04:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:18/600: open fd = 3 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:19/600: open fd = 3 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:20/600: open fd = 3 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.995 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:21/600: open fd = 3 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:22/600: open fd = 3 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:23/600: open fd = 3 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:24/600: open fd = 3 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:25/600: open fd = 3 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:26/600: open fd = 3 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:27/600: open fd = 3 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.997 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:28/600: open fd = 3 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:29/600: open fd = 3 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:30/600: open fd = 3 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:31/600: open fd = 3 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:32/600: open fd = 3 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:33/600: open fd = 3 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:34/600: open fd = 3 2024-09-16T01:04:28.999 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:35/600: open fd = 3 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:36/600: open fd = 3 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:37/600: open fd = 3 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:38/600: open fd = 3 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:39/600: open fd = 3 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:40/600: open fd = 3 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:41/600: open fd = 3 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:42/600: open fd = 3 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:43/600: open fd = 3 2024-09-16T01:04:29.002 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:44/600: open fd = 3 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:45/600: open fd = 3 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.003 INFO:tasks.workunit.client.0.smithi017.stdout:46/600: open fd = 3 2024-09-16T01:04:29.004 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.004 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.004 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.004 INFO:tasks.workunit.client.0.smithi017.stdout:47/600: open fd = 3 2024-09-16T01:04:29.004 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:48/600: open fd = 3 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:49/600: open fd = 3 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.005 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:50/600: open fd = 3 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:51/600: open fd = 3 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:52/600: open fd = 3 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:53/600: open fd = 3 2024-09-16T01:04:29.006 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:54/600: open fd = 3 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:55/600: open fd = 3 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:56/600: open fd = 3 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:57/600: open fd = 3 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:58/600: open fd = 3 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:59/600: open fd = 3 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.008 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:60/600: open fd = 3 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:61/600: open fd = 3 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:62/600: open fd = 3 2024-09-16T01:04:29.009 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:63/600: open fd = 3 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:04:29.010 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:04:29.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:29.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:28 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:28 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:04:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:29.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:28 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:30.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:29 smithi088 ceph-mon[34093]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:30.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:29 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:30.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:29 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:30.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:29 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:29 smithi154 ceph-mon[34759]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:29 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:29 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:30.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:29 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:29 smithi017 ceph-mon[31211]: pgmap v66: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:29 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:04:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:29 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:04:30.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:29 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:04:32.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:31 smithi088 ceph-mon[34093]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:31 smithi154 ceph-mon[34759]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:31 smithi017 ceph-mon[31211]: pgmap v67: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:33 smithi088 ceph-mon[34093]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:33 smithi154 ceph-mon[34759]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:33 smithi017 ceph-mon[31211]: pgmap v68: 97 pgs: 97 active+clean; 2.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:35 smithi088 ceph-mon[34093]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:35 smithi154 ceph-mon[34759]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:36.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:35 smithi017 ceph-mon[31211]: pgmap v69: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-16T01:04:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/116152135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 msgr2=0x7f1ac010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/116152135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac010bb20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009900 tx=0x7f1aac02a480 comp rx=0 tx=0).stop 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/116152135 shutdown_connections 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/116152135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac010c0f0 0x7f1ac010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/116152135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac010bb20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/116152135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac0102d20 0x7f1ac0103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.405+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/116152135 >> 172.21.15.17:0/116152135 conn(0x7f1ac00fc6b0 msgr2=0x7f1ac00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/116152135 shutdown_connections 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/116152135 wait complete. 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 Processor -- start 2024-09-16T01:04:37.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- start start 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0102d20 0x7f1ac0100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac010c0f0 0x7f1ac01013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0111df0 con 0x7f1ac0103640 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0111c70 con 0x7f1ac0102d20 2024-09-16T01:04:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.406+0000 7f1ac6fe4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0111f70 con 0x7f1ac010c0f0 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58112/0 (socket says 172.21.15.17:58112) 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 -- 172.21.15.17:0/1314881450 learned_addr learned my addr 172.21.15.17:0/1314881450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0102d20 0x7f1ac0100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1ac5581640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac010c0f0 0x7f1ac01013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 -- 172.21.15.17:0/1314881450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac010c0f0 msgr2=0x7f1ac01013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac010c0f0 0x7f1ac01013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 -- 172.21.15.17:0/1314881450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0102d20 msgr2=0x7f1ac0100970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0102d20 0x7f1ac0100970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 -- 172.21.15.17:0/1314881450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac01a67e0 con 0x7f1ac0103640 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abffff640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1aac005ab0 tx=0x7f1aac003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abdffb640 1 -- 172.21.15.17:0/1314881450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac03f070 con 0x7f1ac0103640 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abdffb640 1 -- 172.21.15.17:0/1314881450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1aac031d60 con 0x7f1ac0103640 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac01a6a70 con 0x7f1ac0103640 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.407+0000 7f1abdffb640 1 -- 172.21.15.17:0/1314881450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac035030 con 0x7f1ac0103640 2024-09-16T01:04:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.408+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac01a6fb0 con 0x7f1ac0103640 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.410+0000 7f1abdffb640 1 -- 172.21.15.17:0/1314881450 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1aac042070 con 0x7f1ac0103640 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.410+0000 7f1ac9e59740 1 Processor -- start 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.410+0000 7f1ac9e59740 1 -- start start 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc7095ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abdffb640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 0x7f1ab00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc70a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fbc6ffa2f0 con 0x55fbc7096410 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fbc6fa2270 con 0x55fbc70a0cb0 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbc6ff62b0 con 0x55fbc7095af0 2024-09-16T01:04:37.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 0x7f1ab00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abdffb640 1 -- 172.21.15.17:0/1314881450 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1aac0f05b0 con 0x7f1ac0103640 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58126/0 (socket says 172.21.15.17:58126) 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 -- 172.21.15.17:0/3249009532 learned_addr learned my addr 172.21.15.17:0/3249009532 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac5581640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc7095ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac5581640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc70a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 -- 172.21.15.17:0/3249009532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 msgr2=0x55fbc7095ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc7095ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 -- 172.21.15.17:0/3249009532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 msgr2=0x55fbc70a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc70a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 -- 172.21.15.17:0/3249009532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc6fa1340 con 0x55fbc7096410 2024-09-16T01:04:37.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac5581640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc7095ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1abffff640 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b8cc0 tx=0x7f1aac036b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebd4993df5eb406 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.411+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 0x7f1ab00a59a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005fd0 tx=0x7f1ab400b390 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1aaaffd640 1 -- 172.21.15.17:0/3249009532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac049050 con 0x55fbc7096410 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1aaaffd640 1 -- 172.21.15.17:0/3249009532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1aac03be50 con 0x55fbc7096410 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1aaaffd640 1 -- 172.21.15.17:0/3249009532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0c54d0 con 0x55fbc7096410 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3249009532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 msgr2=0x55fbc70a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b8cc0 tx=0x7f1aac036b60 comp rx=0 tx=0).stop 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3249009532 shutdown_connections 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc70a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc70a0770 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3249009532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc7095ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.412+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3249009532 >> 172.21.15.17:0/3249009532 conn(0x55fbc7092060 msgr2=0x55fbc7092440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3249009532 shutdown_connections 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3249009532 wait complete. 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- start start 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 Processor -- start 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc709dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 0x55fbc709e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fbc70a3640 con 0x55fbc70a0cb0 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fbc6f83290 con 0x55fbc7095af0 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.413+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbc70a37c0 con 0x55fbc7096410 2024-09-16T01:04:37.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac9e59740 10 client.0 _ll_register_callbacks cb 0x55fbc6fb4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58130/0 (socket says 172.21.15.17:58130) 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 -- 172.21.15.17:0/1199103032 learned_addr learned my addr 172.21.15.17:0/1199103032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc709dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1abffff640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 0x55fbc709e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 -- 172.21.15.17:0/1199103032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 msgr2=0x55fbc709e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 0x55fbc709e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 -- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 msgr2=0x55fbc709dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc709dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 -- 172.21.15.17:0/1199103032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc6d0d210 con 0x55fbc70a0cb0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1abffff640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 0x55fbc709e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac5581640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8004040 tx=0x7f1ab8004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49482caf1df1a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8004d20 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1ab8012930 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aac03be50 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ab8012b30 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac9e59740 10 client.15513 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.414+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbc6dd9620 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1aac03be50 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1ab8019030 con 0x55fbc70a0cb0 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 20 client.15513 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc70b09a0 0x55fbc70b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 4 client.15513 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbc7007a20 con 0x55fbc70b09a0 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.415+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc70b09a0 0x55fbc70b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.416+0000 7f1a9ffff640 10 client.15513 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.416+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc70b09a0 0x55fbc70b2db0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9148caf03ee61b97 server_cookie=d824a4013a88602 in_seq=0 out_seq=0 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.416+0000 7f1a9ffff640 1 -- 172.21.15.17:0/1199103032 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbc7007a20 con 0x55fbc70b09a0 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.416+0000 7f1a9ffff640 10 client.15513 handle_command_reply: tid=0 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.416+0000 7f1ac9e59740 1 client.15513 shutdown 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 msgr2=0x55fbc709e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8004040 tx=0x7f1ab8004500 comp rx=0 tx=0).stop 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 shutdown_connections 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc70b09a0 0x55fbc70b2db0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc70a0cb0 0x55fbc709e6c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7096410 0x55fbc709e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1a9ffff640 0 client.15513 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/1199103032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc709dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 >> 172.21.15.17:0/1199103032 conn(0x55fbc7092060 msgr2=0x55fbc7097dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 shutdown_connections 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 1 -- 172.21.15.17:0/1199103032 wait complete. 2024-09-16T01:04:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.417+0000 7f1ac9e59740 20 client.15513 trim_cache size 0 max 16384 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 Processor -- start 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 -- start start 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc7098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc70a0cb0 0x55fbc70b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01af860 con 0x55fbc7096410 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01b13a0 con 0x55fbc7095af0 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01aff30 con 0x55fbc70a0cb0 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58146/0 (socket says 172.21.15.17:58146) 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 -- 172.21.15.17:0/2852267591 learned_addr learned my addr 172.21.15.17:0/2852267591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc7098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1ac5581640 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc70a0cb0 0x55fbc70b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 -- 172.21.15.17:0/2852267591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc70a0cb0 msgr2=0x55fbc70b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc70a0cb0 0x55fbc70b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 -- 172.21.15.17:0/2852267591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 msgr2=0x55fbc7098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc7098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 -- 172.21.15.17:0/2852267591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc70b3430 con 0x55fbc7096410 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.432+0000 7f1abffff640 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b9230 tx=0x7f1aac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87690e8d66d2f3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1aaa7fc640 1 -- 172.21.15.17:0/2852267591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac049030 con 0x55fbc7096410 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1aaa7fc640 1 -- 172.21.15.17:0/2852267591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1aac03be50 con 0x55fbc7096410 2024-09-16T01:04:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1aaa7fc640 1 -- 172.21.15.17:0/2852267591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac03b5f0 con 0x55fbc7096410 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 -- 172.21.15.17:0/2852267591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 msgr2=0x55fbc709e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b9230 tx=0x7f1aac009260 comp rx=0 tx=0).stop 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 -- 172.21.15.17:0/2852267591 shutdown_connections 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc70a0cb0 0x55fbc70b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709e4f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/2852267591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc7095af0 0x55fbc7098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 -- 172.21.15.17:0/2852267591 >> 172.21.15.17:0/2852267591 conn(0x55fbc7092060 msgr2=0x55fbc709fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 -- 172.21.15.17:0/2852267591 shutdown_connections 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.433+0000 7f1ac9e59740 1 -- 172.21.15.17:0/2852267591 wait complete. 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 -- start start 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 Processor -- start 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc70a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc709ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01b0cd0 con 0x55fbc7096410 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01b0600 con 0x55fbc70a0cb0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01ad840 con 0x55fbc7095af0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac9e59740 10 client.0 _ll_register_callbacks cb 0x7f1ab8009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1abffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58156/0 (socket says 172.21.15.17:58156) 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1abffff640 1 -- 172.21.15.17:0/3526428227 learned_addr learned my addr 172.21.15.17:0/3526428227 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc70a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.434+0000 7f1ac5581640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc709ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 -- 172.21.15.17:0/3526428227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 msgr2=0x55fbc70a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc70a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 -- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 msgr2=0x55fbc709ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc709ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 -- 172.21.15.17:0/3526428227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc709b5e0 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac5581640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc709ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1abffff640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0bc560 tx=0x7f1aac009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18716d0b1bcb12e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac049070 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1aac0edf50 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aac03be50 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1aac0bcf60 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbc7123e80 con 0x55fbc7096410 2024-09-16T01:04:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1aac03be50 con 0x55fbc7096410 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1aac0f0110 con 0x55fbc7096410 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 20 client.15519 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc71241c0 0x55fbc71265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 4 client.15519 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.435+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbc7001d70 con 0x55fbc71241c0 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.436+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc71241c0 0x55fbc71265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.436+0000 7f1a9ffff640 10 client.15519 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.436+0000 7f1ac4d80640 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc71241c0 0x55fbc71265b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62695e105d9be00 server_cookie=4ba4e0debcbc3001 in_seq=0 out_seq=0 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.449+0000 7f1a9ffff640 1 -- 172.21.15.17:0/3526428227 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fbc7001d70 con 0x55fbc71241c0 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.449+0000 7f1a9ffff640 10 client.15519 handle_command_reply: tid=0 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.449+0000 7f1ac9e59740 1 client.15519 shutdown 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 msgr2=0x55fbc709a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0bc560 tx=0x7f1aac009630 comp rx=0 tx=0).stop 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 shutdown_connections 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fbc71241c0 0x55fbc71265b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fbc70a0cb0 0x55fbc709ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbc7096410 0x55fbc709a910 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 --2- 172.21.15.17:0/3526428227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbc7095af0 0x55fbc70a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1a9ffff640 0 client.15519 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 >> 172.21.15.17:0/3526428227 conn(0x55fbc7092060 msgr2=0x55fbc709f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 shutdown_connections 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 1 -- 172.21.15.17:0/3526428227 wait complete. 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.450+0000 7f1ac9e59740 20 client.15519 trim_cache size 0 max 16384 2024-09-16T01:04:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:04:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:04:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:04:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:04:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 msgr2=0x7f1ab00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 0x7f1ab00a59a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005fd0 tx=0x7f1ab400b390 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 msgr2=0x7f1ac0100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1aac005ab0 tx=0x7f1aac003cd0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 shutdown_connections 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1ab00a34e0 0x7f1ab00a59a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac010c0f0 0x7f1ac01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ac0103640 0x7f1ac0100eb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 --2- 172.21.15.17:0/1314881450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0102d20 0x7f1ac0100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 >> 172.21.15.17:0/1314881450 conn(0x7f1ac00fc6b0 msgr2=0x7f1ac00fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 shutdown_connections 2024-09-16T01:04:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:37.451+0000 7f1ac6fe4640 1 -- 172.21.15.17:0/1314881450 wait complete. 2024-09-16T01:04:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:37 smithi088 ceph-mon[34093]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:37 smithi154 ceph-mon[34759]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:38.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:37 smithi017 ceph-mon[31211]: pgmap v70: 97 pgs: 97 active+clean; 2.5 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:40.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:39 smithi088 ceph-mon[34093]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 25 op/s 2024-09-16T01:04:40.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:39 smithi154 ceph-mon[34759]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 25 op/s 2024-09-16T01:04:40.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:39 smithi017 ceph-mon[31211]: pgmap v71: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 25 op/s 2024-09-16T01:04:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:41 smithi088 ceph-mon[34093]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:42.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:41 smithi154 ceph-mon[34759]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:42.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:41 smithi017 ceph-mon[31211]: pgmap v72: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:43.989 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:43 smithi017 ceph-mon[31211]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:44.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:43 smithi088 ceph-mon[34093]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:44.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:43 smithi154 ceph-mon[34759]: pgmap v73: 97 pgs: 97 active+clean; 2.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:46.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:45 smithi088 ceph-mon[34093]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:46.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:45 smithi154 ceph-mon[34759]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:46.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:45 smithi017 ceph-mon[31211]: pgmap v74: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:47 smithi088 ceph-mon[34093]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:47 smithi154 ceph-mon[34759]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:47 smithi017 ceph-mon[31211]: pgmap v75: 97 pgs: 97 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-16T01:04:50.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:49 smithi088 ceph-mon[34093]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:50.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:49 smithi154 ceph-mon[34759]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:50.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:49 smithi017 ceph-mon[31211]: pgmap v76: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 22 op/s 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/3597504466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec1036a0 msgr2=0x7fc3ec10bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/3597504466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec10bb80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009900 tx=0x7fc3d402a480 comp rx=0 tx=0).stop 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/3597504466 shutdown_connections 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/3597504466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec10e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/3597504466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec10bb80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/3597504466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec102d80 0x7fc3ec103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/3597504466 >> 172.21.15.17:0/3597504466 conn(0x7fc3ec0fc6b0 msgr2=0x7fc3ec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/3597504466 shutdown_connections 2024-09-16T01:04:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.550+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/3597504466 wait complete. 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 Processor -- start 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 -- start start 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec111df0 con 0x7fc3ec102d80 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec111c70 con 0x7fc3ec1036a0 2024-09-16T01:04:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3f0ee4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec111f70 con 0x7fc3ec10c150 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55194/0 (socket says 172.21.15.17:55194) 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2857139690 learned_addr learned my addr 172.21.15.17:0/2857139690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.551+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2857139690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 msgr2=0x7fc3ec101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2857139690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1036a0 msgr2=0x7fc3ec100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2857139690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1a6830 con 0x7fc3ec102d80 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d950 tx=0x7fc3dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3e37fe640 1 -- 172.21.15.17:0/2857139690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc017070 con 0x7fc3ec102d80 2024-09-16T01:04:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec1a6b20 con 0x7fc3ec102d80 2024-09-16T01:04:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3e37fe640 1 -- 172.21.15.17:0/2857139690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3dc009c30 con 0x7fc3ec102d80 2024-09-16T01:04:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3e37fe640 1 -- 172.21.15.17:0/2857139690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00f620 con 0x7fc3ec102d80 2024-09-16T01:04:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.552+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1a7040 con 0x7fc3ec102d80 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.554+0000 7fc3e37fe640 1 -- 172.21.15.17:0/2857139690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc3dc0109a0 con 0x7fc3ec102d80 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 Processor -- start 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 -- start start 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc49ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bbae2f0 con 0x55ca4bc4a410 2024-09-16T01:04:50.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bb56270 con 0x55ca4bc54cb0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bbaa2b0 con 0x55ca4bc49af0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3e37fe640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 0x7fc3d80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55196/0 (socket says 172.21.15.17:55196) 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.555+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2399382789 learned_addr learned my addr 172.21.15.17:0/2399382789 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 0x7fc3d80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc49ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e37fe640 1 -- 172.21.15.17:0/2857139690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc3dc0cf980 con 0x7fc3ec102d80 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2399382789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 msgr2=0x55ca4bc49ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc49ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2399382789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 msgr2=0x55ca4bc570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 -- 172.21.15.17:0/2399382789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4bb55340 con 0x55ca4bc4a410 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc09bbc0 tx=0x7fc3dc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8211115655a5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 0x7fc3d80a5920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005fd0 tx=0x7fc3e400a2f0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e0ff9640 1 -- 172.21.15.17:0/2399382789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc020070 con 0x55ca4bc4a410 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e0ff9640 1 -- 172.21.15.17:0/2399382789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3dc09c330 con 0x55ca4bc4a410 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.556+0000 7fc3e0ff9640 1 -- 172.21.15.17:0/2399382789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc098440 con 0x55ca4bc4a410 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- 172.21.15.17:0/2399382789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 msgr2=0x55ca4bc54770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc09bbc0 tx=0x7fc3dc00bf60 comp rx=0 tx=0).stop 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- 172.21.15.17:0/2399382789 shutdown_connections 2024-09-16T01:04:50.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc4a410 0x55ca4bc54770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/2399382789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc49ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- 172.21.15.17:0/2399382789 >> 172.21.15.17:0/2399382789 conn(0x55ca4bc46060 msgr2=0x55ca4bc46440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- 172.21.15.17:0/2399382789 shutdown_connections 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- 172.21.15.17:0/2399382789 wait complete. 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.557+0000 7fc3f3c83740 1 -- start start 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 Processor -- start 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc52170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bc57880 con 0x55ca4bc49af0 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bb37290 con 0x55ca4bc54cb0 2024-09-16T01:04:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca4bc57a00 con 0x55ca4bc4a410 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3f3c83740 10 client.0 _ll_register_callbacks cb 0x55ca4bb68140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55208/0 (socket says 172.21.15.17:55208) 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 -- 172.21.15.17:0/3807677312 learned_addr learned my addr 172.21.15.17:0/3807677312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc52170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 -- 172.21.15.17:0/3807677312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 msgr2=0x55ca4bc52170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc52170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 -- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 msgr2=0x55ca4bc526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3ea59c640 1 -- 172.21.15.17:0/3807677312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4b8c1210 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.558+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc52170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc098600 tx=0x7fc3dc0a4a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dd669fcb8849b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc020070 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc3dc0a4410 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3dc09c330 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3dc0cd530 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 10 client.15531 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca4b98d620 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3dc09c330 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3dc010580 con 0x55ca4bc49af0 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 10 client.15531 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 20 client.15531 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bc64b20 0x55ca4bc66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 4 client.15531 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.559+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca4bbbba20 con 0x55ca4bc64b20 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.560+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bc64b20 0x55ca4bc66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.560+0000 7fc3d1ffb640 10 client.15531 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.560+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bc64b20 0x55ca4bc66f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af63768c9871ca9 server_cookie=8f7d28d006129ada in_seq=0 out_seq=0 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/3807677312 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca4bbbba20 con 0x55ca4bc64b20 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3d1ffb640 10 client.15531 handle_command_reply: tid=0 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 client.15531 shutdown 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 msgr2=0x55ca4bc51c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc098600 tx=0x7fc3dc0a4a10 comp rx=0 tx=0).stop 2024-09-16T01:04:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 shutdown_connections 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bc64b20 0x55ca4bc66f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc52170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3d1ffb640 0 client.15531 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/3807677312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc51c30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 >> 172.21.15.17:0/3807677312 conn(0x55ca4bc46060 msgr2=0x55ca4bc4bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 shutdown_connections 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 1 -- 172.21.15.17:0/3807677312 wait complete. 2024-09-16T01:04:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.561+0000 7fc3f3c83740 20 client.15531 trim_cache size 0 max 16384 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 Processor -- start 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 -- start start 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc4a410 0x55ca4bc69f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1af8a0 con 0x55ca4bc54cb0 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1b13e0 con 0x55ca4bc4a410 2024-09-16T01:04:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1aff70 con 0x55ca4bc49af0 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55212/0 (socket says 172.21.15.17:55212) 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 -- 172.21.15.17:0/222555505 learned_addr learned my addr 172.21.15.17:0/222555505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc4a410 0x55ca4bc69f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 -- 172.21.15.17:0/222555505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 msgr2=0x55ca4bc524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 -- 172.21.15.17:0/222555505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc4a410 msgr2=0x55ca4bc69f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc4a410 0x55ca4bc69f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 -- 172.21.15.17:0/222555505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4bc46d30 con 0x55ca4bc54cb0 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:04:50.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.576+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4012170 tx=0x7fc3e4005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a900381df6ded12 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3d3fff640 1 -- 172.21.15.17:0/222555505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e402b070 con 0x55ca4bc54cb0 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3d3fff640 1 -- 172.21.15.17:0/222555505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e40123e0 con 0x55ca4bc54cb0 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3d3fff640 1 -- 172.21.15.17:0/222555505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4026410 con 0x55ca4bc54cb0 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 -- 172.21.15.17:0/222555505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 msgr2=0x55ca4bc6a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4012170 tx=0x7fc3e4005c80 comp rx=0 tx=0).stop 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 -- 172.21.15.17:0/222555505 shutdown_connections 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc54cb0 0x55ca4bc6a470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc4a410 0x55ca4bc69f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/222555505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc49af0 0x55ca4bc524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 -- 172.21.15.17:0/222555505 >> 172.21.15.17:0/222555505 conn(0x55ca4bc46060 msgr2=0x55ca4bc53cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 -- 172.21.15.17:0/222555505 shutdown_connections 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.577+0000 7fc3f3c83740 1 -- 172.21.15.17:0/222555505 wait complete. 2024-09-16T01:04:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 -- start start 2024-09-16T01:04:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 Processor -- start 2024-09-16T01:04:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bcce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1b0d10 con 0x55ca4bc49af0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1b0640 con 0x55ca4bc54cb0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec1ad880 con 0x55ca4bc4a410 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3f3c83740 10 client.0 _ll_register_callbacks cb 0x7fc3d4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55220/0 (socket says 172.21.15.17:55220) 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3ea59c640 1 -- 172.21.15.17:0/1945371144 learned_addr learned my addr 172.21.15.17:0/1945371144 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bcce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.578+0000 7fc3ea59c640 1 -- 172.21.15.17:0/1945371144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 msgr2=0x55ca4bc689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ea59c640 1 -- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 msgr2=0x55ca4bcce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:04:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bcce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ea59c640 1 -- 172.21.15.17:0/1945371144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4bccea50 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ead9d640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bcce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3ea59c640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0cfd40 tx=0x7fc3dc009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c45c23c600bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc020070 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc3dc0860f0 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3e40123e0 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3dc09ba00 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca4bccea50 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e40123e0 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3dc09aaf0 con 0x55ca4bc49af0 2024-09-16T01:04:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 20 client.15537 populate_metadata read hostname 'smithi017' 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bcd0040 0x55ca4bcd2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 4 client.15537 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.579+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca4bbb5d70 con 0x55ca4bcd0040 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.580+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bcd0040 0x55ca4bcd2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.580+0000 7fc3d1ffb640 10 client.15537 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.580+0000 7fc3e9d9b640 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bcd0040 0x55ca4bcd2430 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97eb6f2663f13c01 server_cookie=a421fa95d50fa543 in_seq=0 out_seq=0 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3d1ffb640 1 -- 172.21.15.17:0/1945371144 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca4bbb5d70 con 0x55ca4bcd0040 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3d1ffb640 10 client.15537 handle_command_reply: tid=0 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 client.15537 shutdown 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 msgr2=0x55ca4bc68460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0cfd40 tx=0x7fc3dc009f20 comp rx=0 tx=0).stop 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 shutdown_connections 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca4bcd0040 0x55ca4bcd2430 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca4bc54cb0 0x55ca4bcce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3d1ffb640 0 client.15537 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca4bc4a410 0x55ca4bc689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 --2- 172.21.15.17:0/1945371144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4bc49af0 0x55ca4bc68460 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 >> 172.21.15.17:0/1945371144 conn(0x55ca4bc46060 msgr2=0x55ca4bc449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 shutdown_connections 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 1 -- 172.21.15.17:0/1945371144 wait complete. 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.596+0000 7fc3f3c83740 20 client.15537 trim_cache size 0 max 16384 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 msgr2=0x7fc3d80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 0x7fc3d80a5920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4005fd0 tx=0x7fc3e400a2f0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 msgr2=0x7fc3ec1009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d950 tx=0x7fc3dc00de10 comp rx=0 tx=0).stop 2024-09-16T01:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 shutdown_connections 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fc3d80a3460 0x7fc3d80a5920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3ec10c150 0x7fc3ec101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1036a0 0x7fc3ec100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 --2- 172.21.15.17:0/2857139690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3ec102d80 0x7fc3ec1009d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 >> 172.21.15.17:0/2857139690 conn(0x7fc3ec0fc6b0 msgr2=0x7fc3ec0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 shutdown_connections 2024-09-16T01:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:04:50.597+0000 7fc3f0ee4640 1 -- 172.21.15.17:0/2857139690 wait complete. 2024-09-16T01:04:52.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:51 smithi088 ceph-mon[34093]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:52.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:51 smithi154 ceph-mon[34759]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:52.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:51 smithi017 ceph-mon[31211]: pgmap v77: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:53.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:53 smithi088 ceph-mon[34093]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:53.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:53 smithi154 ceph-mon[34759]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:53 smithi017 ceph-mon[31211]: pgmap v78: 97 pgs: 97 active+clean; 2.8 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-16T01:04:55.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:55 smithi088 ceph-mon[34093]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:04:55.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:55 smithi154 ceph-mon[34759]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:04:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:55 smithi017 ceph-mon[31211]: pgmap v79: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:04:57.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:57 smithi088 ceph-mon[34093]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:57.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:57 smithi154 ceph-mon[34759]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:57.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:57 smithi017 ceph-mon[31211]: pgmap v80: 97 pgs: 97 active+clean; 2.9 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:04:59.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:04:59 smithi088 ceph-mon[34093]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:04:59.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:04:59 smithi154 ceph-mon[34759]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:04:59.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:04:59 smithi017 ceph-mon[31211]: pgmap v81: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-16T01:05:01.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:01 smithi088 ceph-mon[34093]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:01.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:01 smithi154 ceph-mon[34759]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:01.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:01 smithi017 ceph-mon[31211]: pgmap v82: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:03.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:03 smithi088 ceph-mon[34093]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:03.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:03 smithi154 ceph-mon[34759]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:03 smithi017 ceph-mon[31211]: pgmap v83: 97 pgs: 97 active+clean; 3.0 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-16T01:05:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 -- 172.21.15.17:0/1492579216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 msgr2=0x7fe1dc100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1492579216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc100cb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009ca0 tx=0x7fe1cc02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 -- 172.21.15.17:0/1492579216 shutdown_connections 2024-09-16T01:05:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1492579216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 0x7fe1dc110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1492579216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1492579216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc100cb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 -- 172.21.15.17:0/1492579216 >> 172.21.15.17:0/1492579216 conn(0x7fe1dc0fc6b0 msgr2=0x7fe1dc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 -- 172.21.15.17:0/1492579216 shutdown_connections 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.697+0000 7fe1e3386640 1 -- 172.21.15.17:0/1492579216 wait complete. 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 Processor -- start 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 -- start start 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 0x7fe1dc19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc113fb0 con 0x7fe1dc1008d0 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc113e30 con 0x7fe1dc10e480 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e3386640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc114130 con 0x7fe1dc101280 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58748/0 (socket says 172.21.15.17:58748) 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 -- 172.21.15.17:0/1924315974 learned_addr learned my addr 172.21.15.17:0/1924315974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1923640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 0x7fe1dc19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e0921640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 -- 172.21.15.17:0/1924315974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 msgr2=0x7fe1dc19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 -- 172.21.15.17:0/1924315974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 msgr2=0x7fe1dc19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.698+0000 7fe1e1122640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 0x7fe1dc19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1e1122640 1 -- 172.21.15.17:0/1924315974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc19f470 con 0x7fe1dc1008d0 2024-09-16T01:05:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1e0921640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1e1122640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc02ade0 tx=0x7fe1cc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1da7fc640 1 -- 172.21.15.17:0/1924315974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc003b70 con 0x7fe1dc1008d0 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1da7fc640 1 -- 172.21.15.17:0/1924315974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1cc003d10 con 0x7fe1dc1008d0 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc19f700 con 0x7fe1dc1008d0 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1da7fc640 1 -- 172.21.15.17:0/1924315974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc030b80 con 0x7fe1dc1008d0 2024-09-16T01:05:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.699+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc1a6ff0 con 0x7fe1dc1008d0 2024-09-16T01:05:03.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.701+0000 7fe1da7fc640 1 -- 172.21.15.17:0/1924315974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe1cc004040 con 0x7fe1dc1008d0 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 Processor -- start 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 -- start start 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa108af0 0x5647aa108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa109410 0x5647aa113770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647aa06d2f0 con 0x5647aa113cb0 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5647aa015270 con 0x5647aa109410 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647aa0692b0 con 0x5647aa108af0 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e0921640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1da7fc640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 0x7fe1c40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e1122640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa109410 0x5647aa113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e0921640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58752/0 (socket says 172.21.15.17:58752) 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e0921640 1 -- 172.21.15.17:0/1133274640 learned_addr learned my addr 172.21.15.17:0/1133274640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e1923640 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa108af0 0x5647aa108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.702+0000 7fe1e1923640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 0x7fe1c40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 -- 172.21.15.17:0/1133274640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa108af0 msgr2=0x5647aa108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa108af0 0x5647aa108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1da7fc640 1 -- 172.21.15.17:0/1924315974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe1cc0f0fb0 con 0x7fe1dc1008d0 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 -- 172.21.15.17:0/1133274640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa109410 msgr2=0x5647aa113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa109410 0x5647aa113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 -- 172.21.15.17:0/1133274640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647aa014340 con 0x5647aa113cb0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e0921640 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009ce0 tx=0x7fe1d00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b382b3b9c7a0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1e1923640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 0x7fe1c40a5920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4005f60 tx=0x7fe1d4005f90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1c37fe640 1 -- 172.21.15.17:0/1133274640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0012450 con 0x5647aa113cb0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1c37fe640 1 -- 172.21.15.17:0/1133274640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1d0012aa0 con 0x5647aa113cb0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.703+0000 7fe1c37fe640 1 -- 172.21.15.17:0/1133274640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000fb70 con 0x5647aa113cb0 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- 172.21.15.17:0/1133274640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 msgr2=0x5647aa1160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009ce0 tx=0x7fe1d00117b0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- 172.21.15.17:0/1133274640 shutdown_connections 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa1160a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa109410 0x5647aa113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/1133274640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa108af0 0x5647aa108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- 172.21.15.17:0/1133274640 >> 172.21.15.17:0/1133274640 conn(0x5647aa105060 msgr2=0x5647aa105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- 172.21.15.17:0/1133274640 shutdown_connections 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- 172.21.15.17:0/1133274640 wait complete. 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 -- start start 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.704+0000 7fe1e61fe740 1 Processor -- start 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa110b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa111040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647aa116880 con 0x5647aa113cb0 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5647a9ff6290 con 0x5647aa108af0 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647aa116a00 con 0x5647aa109410 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e61fe740 10 client.0 _ll_register_callbacks cb 0x5647aa027140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58754/0 (socket says 172.21.15.17:58754) 2024-09-16T01:05:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 -- 172.21.15.17:0/4206981368 learned_addr learned my addr 172.21.15.17:0/4206981368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e0921640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa111040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1122640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 -- 172.21.15.17:0/4206981368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 msgr2=0x5647aa111040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa111040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 -- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 msgr2=0x5647aa110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.705+0000 7fe1e1923640 1 -- 172.21.15.17:0/4206981368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a9d80210 con 0x5647aa113cb0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e1923640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40045a0 tx=0x7fe1d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9de2fc30cd4f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011230 con 0x5647aa113cb0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe1d4003b70 con 0x5647aa113cb0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d0012aa0 con 0x5647aa113cb0 2024-09-16T01:05:03.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1d4011e10 con 0x5647aa113cb0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 10 client.15549 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647a9e4c620 con 0x5647aa113cb0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1d0012aa0 con 0x5647aa113cb0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe1d401d040 con 0x5647aa113cb0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 20 client.15549 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa123b70 0x5647aa125fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 4 client.15549 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.706+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647aa07aa20 con 0x5647aa123b70 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.707+0000 7fe1e1122640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa123b70 0x5647aa125fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.707+0000 7fe1e1122640 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa123b70 0x5647aa125fc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f54b3332630f23e server_cookie=a4ec1044789277a9 in_seq=0 out_seq=0 2024-09-16T01:05:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.707+0000 7fe1c0ff9640 10 client.15549 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/4206981368 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647aa07aa20 con 0x5647aa123b70 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1c0ff9640 10 client.15549 handle_command_reply: tid=0 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 client.15549 shutdown 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 msgr2=0x5647aa111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40045a0 tx=0x7fe1d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 shutdown_connections 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa123b70 0x5647aa125fc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa111580 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1c0ff9640 0 client.15549 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa111040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/4206981368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 >> 172.21.15.17:0/4206981368 conn(0x5647aa105060 msgr2=0x5647aa10ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 shutdown_connections 2024-09-16T01:05:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 1 -- 172.21.15.17:0/4206981368 wait complete. 2024-09-16T01:05:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.708+0000 7fe1e61fe740 20 client.15549 trim_cache size 0 max 16384 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 Processor -- start 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 -- start start 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa1113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa12b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1af840 con 0x5647aa113cb0 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1b1380 con 0x5647aa108af0 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.723+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1aff10 con 0x5647aa109410 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58760/0 (socket says 172.21.15.17:58760) 2024-09-16T01:05:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 -- 172.21.15.17:0/3751448620 learned_addr learned my addr 172.21.15.17:0/3751448620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa1113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 -- 172.21.15.17:0/3751448620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 msgr2=0x5647aa12b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e0921640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa12b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa12b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 -- 172.21.15.17:0/3751448620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 msgr2=0x5647aa1113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa1113b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 -- 172.21.15.17:0/3751448620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647aa104e90 con 0x5647aa113cb0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa1113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009690 tx=0x7fe1d4009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4673201746b45a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1c2ffd640 1 -- 172.21.15.17:0/3751448620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011030 con 0x5647aa113cb0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1c2ffd640 1 -- 172.21.15.17:0/3751448620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1d4038020 con 0x5647aa113cb0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.724+0000 7fe1c2ffd640 1 -- 172.21.15.17:0/3751448620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4005290 con 0x5647aa113cb0 2024-09-16T01:05:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3751448620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 msgr2=0x5647aa12be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009690 tx=0x7fe1d4009620 comp rx=0 tx=0).stop 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3751448620 shutdown_connections 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa12be10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa12b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3751448620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa1113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3751448620 >> 172.21.15.17:0/3751448620 conn(0x5647aa105060 msgr2=0x5647aa112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3751448620 shutdown_connections 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3751448620 wait complete. 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 -- start start 2024-09-16T01:05:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.725+0000 7fe1e61fe740 1 Processor -- start 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa11c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa1178d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1b0cb0 con 0x5647aa113cb0 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1b05e0 con 0x5647aa108af0 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1ad820 con 0x5647aa109410 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e61fe740 10 client.0 _ll_register_callbacks cb 0x7fe1d4009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58762/0 (socket says 172.21.15.17:58762) 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 -- 172.21.15.17:0/3655021737 learned_addr learned my addr 172.21.15.17:0/3655021737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e0921640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa1178d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa11c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 -- 172.21.15.17:0/3655021737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 msgr2=0x5647aa1178d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa1178d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 -- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 msgr2=0x5647aa11c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa11c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 -- 172.21.15.17:0/3655021737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647aa18d8a0 con 0x5647aa113cb0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa11c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1e1923640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40044f0 tx=0x7fe1d4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f49525c105785fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.726+0000 7fe1c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4003c90 con 0x5647aa113cb0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe1d4003e30 con 0x5647aa113cb0 2024-09-16T01:05:03.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d4038020 con 0x5647aa113cb0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1d4005040 con 0x5647aa113cb0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647aa18e9b0 con 0x5647aa113cb0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1d4038020 con 0x5647aa113cb0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe1d401d030 con 0x5647aa113cb0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 20 client.15555 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa18efc0 0x5647aa1913b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 4 client.15555 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.727+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647aa074d70 con 0x5647aa18efc0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.728+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa18efc0 0x5647aa1913b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.728+0000 7fe1e1122640 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa18efc0 0x5647aa1913b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53046e3643af1b02 server_cookie=b7420fc1c72b9d3f in_seq=0 out_seq=0 2024-09-16T01:05:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.728+0000 7fe1c0ff9640 10 client.15555 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1c0ff9640 1 -- 172.21.15.17:0/3655021737 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647aa074d70 con 0x5647aa18efc0 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1c0ff9640 10 client.15555 handle_command_reply: tid=0 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 client.15555 shutdown 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 msgr2=0x5647aa118060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40044f0 tx=0x7fe1d4019040 comp rx=0 tx=0).stop 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 shutdown_connections 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5647aa18efc0 0x5647aa1913b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647aa113cb0 0x5647aa118060 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1c0ff9640 0 client.15555 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647aa109410 0x5647aa1178d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 --2- 172.21.15.17:0/3655021737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5647aa108af0 0x5647aa11c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 >> 172.21.15.17:0/3655021737 conn(0x5647aa105060 msgr2=0x5647aa10a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 shutdown_connections 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 1 -- 172.21.15.17:0/3655021737 wait complete. 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.744+0000 7fe1e61fe740 20 client.15555 trim_cache size 0 max 16384 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:05:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:05:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 msgr2=0x7fe1c40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 0x7fe1c40a5920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4005f60 tx=0x7fe1d4005f90 comp rx=0 tx=0).stop 2024-09-16T01:05:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 msgr2=0x7fe1dc19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc02ade0 tx=0x7fe1cc032ff0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 shutdown_connections 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe1c40a3460 0x7fe1c40a5920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1dc10e480 0x7fe1dc19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1dc101280 0x7fe1dc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 --2- 172.21.15.17:0/1924315974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1dc1008d0 0x7fe1dc19a480 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 >> 172.21.15.17:0/1924315974 conn(0x7fe1dc0fc6b0 msgr2=0x7fe1dc0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 shutdown_connections 2024-09-16T01:05:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:03.745+0000 7fe1e3386640 1 -- 172.21.15.17:0/1924315974 wait complete. 2024-09-16T01:05:05.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:05 smithi088 ceph-mon[34093]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 37 op/s 2024-09-16T01:05:05.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:05 smithi154 ceph-mon[34759]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 37 op/s 2024-09-16T01:05:05.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:05 smithi017 ceph-mon[31211]: pgmap v84: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 37 op/s 2024-09-16T01:05:07.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:07 smithi088 ceph-mon[34093]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 28 op/s 2024-09-16T01:05:07.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:07 smithi154 ceph-mon[34759]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 28 op/s 2024-09-16T01:05:07.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:07 smithi017 ceph-mon[31211]: pgmap v85: 97 pgs: 97 active+clean; 3.1 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 28 op/s 2024-09-16T01:05:09.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:09 smithi088 ceph-mon[34093]: pgmap v86: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 37 op/s 2024-09-16T01:05:09.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:09 smithi154 ceph-mon[34759]: pgmap v86: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 37 op/s 2024-09-16T01:05:09.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:09 smithi017 ceph-mon[31211]: pgmap v86: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 37 op/s 2024-09-16T01:05:11.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:11 smithi088 ceph-mon[34093]: pgmap v87: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:11.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:11 smithi154 ceph-mon[34759]: pgmap v87: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:11.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:11 smithi017 ceph-mon[31211]: pgmap v87: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:13 smithi088 ceph-mon[34093]: pgmap v88: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:13 smithi154 ceph-mon[34759]: pgmap v88: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:13 smithi017 ceph-mon[31211]: pgmap v88: 97 pgs: 97 active+clean; 3.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:05:15.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:15 smithi154 ceph-mon[34759]: pgmap v89: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 57 KiB/s wr, 37 op/s 2024-09-16T01:05:15.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:15 smithi017 ceph-mon[31211]: pgmap v89: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 57 KiB/s wr, 37 op/s 2024-09-16T01:05:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:15 smithi088 ceph-mon[34093]: pgmap v89: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 57 KiB/s wr, 37 op/s 2024-09-16T01:05:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 -- 172.21.15.17:0/3055107197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 msgr2=0x7f81f810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 --2- 172.21.15.17:0/3055107197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f810bac0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009900 tx=0x7f81ec02a480 comp rx=0 tx=0).stop 2024-09-16T01:05:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 -- 172.21.15.17:0/3055107197 shutdown_connections 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 --2- 172.21.15.17:0/3055107197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 0x7f81f810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 --2- 172.21.15.17:0/3055107197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f810bac0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 --2- 172.21.15.17:0/3055107197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f81030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 -- 172.21.15.17:0/3055107197 >> 172.21.15.17:0/3055107197 conn(0x7f81f80fc6b0 msgr2=0x7f81f80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 -- 172.21.15.17:0/3055107197 shutdown_connections 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.845+0000 7f81fe754640 1 -- 172.21.15.17:0/3055107197 wait complete. 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.846+0000 7f81fe754640 1 Processor -- start 2024-09-16T01:05:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.846+0000 7f81fe754640 1 -- start start 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.846+0000 7f81fe754640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.846+0000 7f81fe754640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fe754640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 0x7f81f819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fe754640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111da0 con 0x7f81f81035e0 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fe754640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111c20 con 0x7f81f8102cc0 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fe754640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111f20 con 0x7f81f810c110 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56160/0 (socket says 172.21.15.17:56160) 2024-09-16T01:05:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 -- 172.21.15.17:0/1278762138 learned_addr learned my addr 172.21.15.17:0/1278762138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f7fff640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fccf1640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 0x7f81f819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 -- 172.21.15.17:0/1278762138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 msgr2=0x7f81f819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 0x7f81f819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 -- 172.21.15.17:0/1278762138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 msgr2=0x7f81f8198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f8198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 -- 172.21.15.17:0/1278762138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f819d250 con 0x7f81f81035e0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f7fff640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f77fe640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f81ec005940 tx=0x7f81ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f57fa640 1 -- 172.21.15.17:0/1278762138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec03f030 con 0x7f81f81035e0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81f57fa640 1 -- 172.21.15.17:0/1278762138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81ec003cb0 con 0x7f81f81035e0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.847+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f819d4e0 con 0x7f81f81035e0 2024-09-16T01:05:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.848+0000 7f81f57fa640 1 -- 172.21.15.17:0/1278762138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec035070 con 0x7f81f81035e0 2024-09-16T01:05:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.848+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f81a4dd0 con 0x7f81f81035e0 2024-09-16T01:05:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f81f57fa640 1 -- 172.21.15.17:0/1278762138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f81ec042030 con 0x7f81f81035e0 2024-09-16T01:05:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 Processor -- start 2024-09-16T01:05:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 -- start start 2024-09-16T01:05:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x56349657fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x56349658d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5634964e42f0 con 0x563496580410 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56349648c270 con 0x56349657faf0 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.850+0000 7f82015c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5634964e02b0 con 0x56349658acb0 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56168/0 (socket says 172.21.15.17:56168) 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 -- 172.21.15.17:0/26308323 learned_addr learned my addr 172.21.15.17:0/26308323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f77fe640 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x56349658d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f57fa640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 0x7f81e00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81fccf1640 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x56349657fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 -- 172.21.15.17:0/26308323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 msgr2=0x56349658d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x56349658d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 -- 172.21.15.17:0/26308323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 msgr2=0x56349657fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x56349657fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81fccf1640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 0x7f81e00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 -- 172.21.15.17:0/26308323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349648b340 con 0x563496580410 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f57fa640 1 -- 172.21.15.17:0/1278762138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f81ec0f04f0 con 0x7f81f81035e0 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81f7fff640 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f81e800bd40 tx=0x7f81e800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6507728603ffa00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81de7fc640 1 -- 172.21.15.17:0/26308323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8015070 con 0x563496580410 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81fccf1640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 0x7f81e00a59a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009fd0 tx=0x7f81f0005bd0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81de7fc640 1 -- 172.21.15.17:0/26308323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81e800be30 con 0x563496580410 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.851+0000 7f81de7fc640 1 -- 172.21.15.17:0/26308323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8011930 con 0x563496580410 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 -- 172.21.15.17:0/26308323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 msgr2=0x56349658a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f81e800bd40 tx=0x7f81e800f730 comp rx=0 tx=0).stop 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 -- 172.21.15.17:0/26308323 shutdown_connections 2024-09-16T01:05:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x56349658d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x56349658a770 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 --2- 172.21.15.17:0/26308323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x56349657fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 -- 172.21.15.17:0/26308323 >> 172.21.15.17:0/26308323 conn(0x56349657c060 msgr2=0x56349657c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 -- 172.21.15.17:0/26308323 shutdown_connections 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.852+0000 7f82015c8740 1 -- 172.21.15.17:0/26308323 wait complete. 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 -- start start 2024-09-16T01:05:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 Processor -- start 2024-09-16T01:05:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x563496587b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x563496588590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56349658d880 con 0x563496580410 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56349646d290 con 0x56349657faf0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56349658da00 con 0x56349658acb0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f82015c8740 10 client.0 _ll_register_callbacks cb 0x56349649e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56170/0 (socket says 172.21.15.17:56170) 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f81f77fe640 1 -- 172.21.15.17:0/2311504378 learned_addr learned my addr 172.21.15.17:0/2311504378 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.853+0000 7f81f7fff640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x563496587b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81fccf1640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x563496588590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 -- 172.21.15.17:0/2311504378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 msgr2=0x563496588590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x563496588590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 -- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 msgr2=0x563496587b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x563496587b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 -- 172.21.15.17:0/2311504378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634961f7210 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81f77fe640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b8c60 tx=0x7f81ec0b8440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f168d4f5ed4b3adf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec049070 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f81ec003800 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e800be30 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81ec005d50 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f82015c8740 10 client.15567 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634962c3620 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.854+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81e800be30 con 0x563496580410 2024-09-16T01:05:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f81ec0bca60 con 0x563496580410 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 10 client.15567 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 20 client.15567 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56349659aaf0 0x56349659cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 4 client.15567 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634964f1a20 con 0x56349659aaf0 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.855+0000 7f81f7fff640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56349659aaf0 0x56349659cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f81d77fe640 10 client.15567 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f81f7fff640 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56349659aaf0 0x56349659cfb0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef63ace0b44aa215 server_cookie=8a9aea90d6d25aa2 in_seq=0 out_seq=0 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f81d77fe640 1 -- 172.21.15.17:0/2311504378 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634964f1a20 con 0x56349659aaf0 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f81d77fe640 10 client.15567 handle_command_reply: tid=0 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f82015c8740 1 client.15567 shutdown 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 msgr2=0x563496588050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.856+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b8c60 tx=0x7f81ec0b8440 comp rx=0 tx=0).stop 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 shutdown_connections 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56349659aaf0 0x56349659cfb0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349658acb0 0x563496588590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x563496588050 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 --2- 172.21.15.17:0/2311504378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x563496587b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 >> 172.21.15.17:0/2311504378 conn(0x56349657c060 msgr2=0x563496581dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f81d77fe640 0 client.15567 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 shutdown_connections 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 1 -- 172.21.15.17:0/2311504378 wait complete. 2024-09-16T01:05:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.857+0000 7f82015c8740 20 client.15567 trim_cache size 0 max 16384 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.871+0000 7f82015c8740 1 Processor -- start 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.871+0000 7f82015c8740 1 -- start start 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.871+0000 7f82015c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x5634965883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.871+0000 7f82015c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 0x563496589a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.871+0000 7f82015c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f82015c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81ad5c0 con 0x56349658acb0 2024-09-16T01:05:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f82015c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81af100 con 0x56349657faf0 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f82015c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81adc90 con 0x563496580410 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56174/0 (socket says 172.21.15.17:56174) 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 -- 172.21.15.17:0/58205212 learned_addr learned my addr 172.21.15.17:0/58205212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81f7fff640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x5634965883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81f77fe640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 0x563496589a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 -- 172.21.15.17:0/58205212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 msgr2=0x563496589a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 0x563496589a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 -- 172.21.15.17:0/58205212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 msgr2=0x5634965883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x5634965883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 -- 172.21.15.17:0/58205212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349657be90 con 0x56349658acb0 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81f77fe640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 0x563496589a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81fccf1640 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f81f00107e0 tx=0x7f81f00096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6a22c8127f70b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81ddffb640 1 -- 172.21.15.17:0/58205212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0010d60 con 0x56349658acb0 2024-09-16T01:05:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81ddffb640 1 -- 172.21.15.17:0/58205212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81f0024070 con 0x56349658acb0 2024-09-16T01:05:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.872+0000 7f81ddffb640 1 -- 172.21.15.17:0/58205212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0029c50 con 0x56349658acb0 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- 172.21.15.17:0/58205212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 msgr2=0x5634965a28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f81f00107e0 tx=0x7f81f00096c0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- 172.21.15.17:0/58205212 shutdown_connections 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56349658acb0 0x5634965a28c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563496580410 0x563496589a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 --2- 172.21.15.17:0/58205212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349657faf0 0x5634965883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- 172.21.15.17:0/58205212 >> 172.21.15.17:0/58205212 conn(0x56349657c060 msgr2=0x563496589370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- 172.21.15.17:0/58205212 shutdown_connections 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- 172.21.15.17:0/58205212 wait complete. 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.873+0000 7f82015c8740 1 -- start start 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 Processor -- start 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349657faf0 0x5634965933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349658acb0 0x563496584d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81aea30 con 0x563496580410 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81ae360 con 0x56349658acb0 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81ab5a0 con 0x56349657faf0 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f82015c8740 10 client.0 _ll_register_callbacks cb 0x7f81ec005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56182/0 (socket says 172.21.15.17:56182) 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 -- 172.21.15.17:0/308853307 learned_addr learned my addr 172.21.15.17:0/308853307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81fccf1640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349658acb0 0x563496584d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f7fff640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349657faf0 0x5634965933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 -- 172.21.15.17:0/308853307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349657faf0 msgr2=0x5634965933b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349657faf0 0x5634965933b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 -- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349658acb0 msgr2=0x563496584d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349658acb0 0x563496584d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.874+0000 7f81f77fe640 1 -- 172.21.15.17:0/308853307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563496585560 con 0x563496580410 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81f77fe640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f81ec003fd0 tx=0x7f81ec003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94056b988fa286f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec049040 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f81ec03bb40 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81f0024070 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81ec0044e0 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563496605800 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81f0024070 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f81ec0bbc50 con 0x563496580410 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 20 client.15573 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563496605d90 0x563496608180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 4 client.15573 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:05:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.875+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634964ebd70 con 0x563496605d90 2024-09-16T01:05:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.876+0000 7f81f7fff640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563496605d90 0x563496608180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.876+0000 7f81f7fff640 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563496605d90 0x563496608180 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55c28733556bcdf4 server_cookie=1bcf327690b797ee in_seq=0 out_seq=0 2024-09-16T01:05:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.876+0000 7f81d77fe640 10 client.15573 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.891+0000 7f81d77fe640 1 -- 172.21.15.17:0/308853307 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634964ebd70 con 0x563496605d90 2024-09-16T01:05:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f81d77fe640 10 client.15573 handle_command_reply: tid=0 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 client.15573 shutdown 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 msgr2=0x5634965847f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f81ec003fd0 tx=0x7f81ec003a30 comp rx=0 tx=0).stop 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 shutdown_connections 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x563496605d90 0x563496608180 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56349658acb0 0x563496584d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563496580410 0x5634965847f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f81d77fe640 0 client.15573 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 --2- 172.21.15.17:0/308853307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56349657faf0 0x5634965933b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 >> 172.21.15.17:0/308853307 conn(0x56349657c060 msgr2=0x563496589370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 shutdown_connections 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 1 -- 172.21.15.17:0/308853307 wait complete. 2024-09-16T01:05:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f82015c8740 20 client.15573 trim_cache size 0 max 16384 2024-09-16T01:05:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:05:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:05:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:05:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.892+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 msgr2=0x7f81e00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 0x7f81e00a59a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009fd0 tx=0x7f81f0005bd0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 msgr2=0x7f81f81987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f81ec005940 tx=0x7f81ec0042f0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 shutdown_connections 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f81e00a34e0 0x7f81e00a59a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81f810c110 0x7f81f819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81f81035e0 0x7f81f81987a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 --2- 172.21.15.17:0/1278762138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81f8102cc0 0x7f81f8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 >> 172.21.15.17:0/1278762138 conn(0x7f81f80fc6b0 msgr2=0x7f81f80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 shutdown_connections 2024-09-16T01:05:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:16.893+0000 7f81fe754640 1 -- 172.21.15.17:0/1278762138 wait complete. 2024-09-16T01:05:17.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:17 smithi154 ceph-mon[34759]: pgmap v90: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:17.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:17 smithi017 ceph-mon[31211]: pgmap v90: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:17 smithi088 ceph-mon[34093]: pgmap v90: 97 pgs: 97 active+clean; 3.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:19.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:19 smithi154 ceph-mon[34759]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-16T01:05:19.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:19 smithi017 ceph-mon[31211]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-16T01:05:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:19 smithi088 ceph-mon[34093]: pgmap v91: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-16T01:05:21.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:21 smithi154 ceph-mon[34759]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:21.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:21 smithi017 ceph-mon[31211]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:21 smithi088 ceph-mon[34093]: pgmap v92: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:23.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:23 smithi017 ceph-mon[31211]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:23 smithi088 ceph-mon[34093]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:23 smithi154 ceph-mon[34759]: pgmap v93: 97 pgs: 97 active+clean; 3.5 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:25.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:25 smithi017 ceph-mon[31211]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:25 smithi088 ceph-mon[34093]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:25 smithi154 ceph-mon[34759]: pgmap v94: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:27.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:27 smithi017 ceph-mon[31211]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:27 smithi088 ceph-mon[34093]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:27 smithi154 ceph-mon[34759]: pgmap v95: 97 pgs: 97 active+clean; 3.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:29.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:29 smithi017 ceph-mon[31211]: pgmap v96: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:29.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:29 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:05:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:29 smithi088 ceph-mon[34093]: pgmap v96: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:29 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:05:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:29 smithi154 ceph-mon[34759]: pgmap v96: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:29 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3083348574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4106a00 msgr2=0x7f3eb4106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3083348574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4106a00 0x7f3eb4106de0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009930 tx=0x7f3eb002a420 comp rx=0 tx=0).stop 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3083348574 shutdown_connections 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3083348574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb4101390 0x7f3eb410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3083348574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41009f0 0x7f3eb4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3083348574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4106a00 0x7f3eb4106de0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3083348574 >> 172.21.15.17:0/3083348574 conn(0x7f3eb40fc6b0 msgr2=0x7f3eb40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3083348574 shutdown_connections 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.984+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3083348574 wait complete. 2024-09-16T01:05:29.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 Processor -- start 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 -- start start 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb41009f0 0x7f3eb4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb4106a00 0x7f3eb4199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110cf0 con 0x7f3eb4101390 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110b70 con 0x7f3eb4106a00 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3ebbfbe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4110e70 con 0x7f3eb41009f0 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49894/0 (socket says 172.21.15.17:49894) 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 -- 172.21.15.17:0/3773607362 learned_addr learned my addr 172.21.15.17:0/3773607362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb41009f0 0x7f3eb4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eba55b640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb4106a00 0x7f3eb4199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 -- 172.21.15.17:0/3773607362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb41009f0 msgr2=0x7f3eb4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb41009f0 0x7f3eb4199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 -- 172.21.15.17:0/3773607362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb4106a00 msgr2=0x7f3eb4199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb4106a00 0x7f3eb4199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.985+0000 7f3eb9559640 1 -- 172.21.15.17:0/3773607362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb41a4600 con 0x7f3eb4101390 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3eb9559640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d950 tx=0x7f3ea400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3eaaffd640 1 -- 172.21.15.17:0/3773607362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4017070 con 0x7f3eb4101390 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3eaaffd640 1 -- 172.21.15.17:0/3773607362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ea4009c30 con 0x7f3eb4101390 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb41a48f0 con 0x7f3eb4101390 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3eaaffd640 1 -- 172.21.15.17:0/3773607362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400f620 con 0x7f3eb4101390 2024-09-16T01:05:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.986+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb41a4e40 con 0x7f3eb4101390 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.988+0000 7f3ebee30740 1 Processor -- start 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.988+0000 7f3eaaffd640 1 -- 172.21.15.17:0/3773607362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3ea40109a0 con 0x7f3eb4101390 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 -- start start 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 0x55d90f76b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f76e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d90f6c52f0 con 0x55d90f760af0 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d90f66d270 con 0x55d90f761410 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3ebee30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d90f6c12b0 con 0x55d90f76bcb0 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49900/0 (socket says 172.21.15.17:49900) 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 -- 172.21.15.17:0/1295646104 learned_addr learned my addr 172.21.15.17:0/1295646104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eb9559640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f76e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 0x55d90f76b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eaaffd640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 0x7f3ea00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 -- 172.21.15.17:0/1295646104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 msgr2=0x55d90f76e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f76e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 -- 172.21.15.17:0/1295646104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 msgr2=0x55d90f76b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 0x55d90f76b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eba55b640 1 -- 172.21.15.17:0/1295646104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90f66c340 con 0x55d90f760af0 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.989+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 0x55d90f76b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3eaaffd640 1 -- 172.21.15.17:0/3773607362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3ea40cf890 con 0x7f3eb4101390 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3eba55b640 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3eac007ec0 tx=0x7f3eac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0dfb9cafcdb71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3eba55b640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 0x7f3ea00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3e9ffff640 1 -- 172.21.15.17:0/1295646104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac010ac0 con 0x55d90f760af0 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3e9ffff640 1 -- 172.21.15.17:0/1295646104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3eac01add0 con 0x55d90f760af0 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.990+0000 7f3e9ffff640 1 -- 172.21.15.17:0/1295646104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac019bb0 con 0x55d90f760af0 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- 172.21.15.17:0/1295646104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 msgr2=0x55d90f760ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3eba55b640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 0x7f3ea00a5920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3eac01e000 tx=0x7f3eac01f000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3eac007ec0 tx=0x7f3eac00f790 comp rx=0 tx=0).stop 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- 172.21.15.17:0/1295646104 shutdown_connections 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f76e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f761410 0x55d90f76b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1295646104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f760af0 0x55d90f760ed0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- 172.21.15.17:0/1295646104 >> 172.21.15.17:0/1295646104 conn(0x55d90f75d060 msgr2=0x55d90f75d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- 172.21.15.17:0/1295646104 shutdown_connections 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- 172.21.15.17:0/1295646104 wait complete. 2024-09-16T01:05:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 -- start start 2024-09-16T01:05:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.991+0000 7f3ebee30740 1 Processor -- start 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f76b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f769090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d90f76e880 con 0x55d90f761410 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d90f64e290 con 0x55d90f76bcb0 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d90f76ea00 con 0x55d90f760af0 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3ebee30740 10 client.0 _ll_register_callbacks cb 0x55d90f67f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49904/0 (socket says 172.21.15.17:49904) 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 -- 172.21.15.17:0/756878218 learned_addr learned my addr 172.21.15.17:0/756878218 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f76b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eba55b640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f769090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 -- 172.21.15.17:0/756878218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 msgr2=0x55d90f76b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f76b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 -- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 msgr2=0x55d90f769090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f769090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 -- 172.21.15.17:0/756878218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90f3d8210 con 0x55d90f761410 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3eb9559640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea409bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231d161d88ba2458 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.992+0000 7f3e9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4020070 con 0x55d90f761410 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3ea409b0a0 con 0x55d90f761410 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eac01add0 con 0x55d90f761410 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ea40cd490 con 0x55d90f761410 2024-09-16T01:05:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 10 client.15585 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d90f4a4620 con 0x55d90f761410 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3eac01add0 con 0x55d90f761410 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ea40979a0 con 0x55d90f761410 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 10 client.15585 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 20 client.15585 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7843e0 0x55d90f7867d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 4 client.15585 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d90f6d2a20 con 0x55d90f7843e0 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.993+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7843e0 0x55d90f7867d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.994+0000 7f3e9d7fa640 10 client.15585 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.994+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7843e0 0x55d90f7867d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9587fb05cf00c6c server_cookie=109e087fac08060d in_seq=0 out_seq=0 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.994+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/756878218 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d90f6d2a20 con 0x55d90f7843e0 2024-09-16T01:05:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.994+0000 7f3e9d7fa640 10 client.15585 handle_command_reply: tid=0 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.994+0000 7f3ebee30740 1 client.15585 shutdown 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 msgr2=0x55d90f768b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea409bb20 comp rx=0 tx=0).stop 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 shutdown_connections 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7843e0 0x55d90f7867d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f769090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f768b50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3e9d7fa640 0 client.15585 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 --2- 172.21.15.17:0/756878218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f76b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 >> 172.21.15.17:0/756878218 conn(0x55d90f75d060 msgr2=0x55d90f762dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 shutdown_connections 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 1 -- 172.21.15.17:0/756878218 wait complete. 2024-09-16T01:05:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:29.995+0000 7f3ebee30740 20 client.15585 trim_cache size 0 max 16384 2024-09-16T01:05:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 Processor -- start 2024-09-16T01:05:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 -- start start 2024-09-16T01:05:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f760af0 0x55d90f771370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f78c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ab510 con 0x55d90f761410 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ad050 con 0x55d90f760af0 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3ebee30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41abbe0 con 0x55d90f76bcb0 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49910/0 (socket says 172.21.15.17:49910) 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.009+0000 7f3eb9559640 1 -- 172.21.15.17:0/414088391 learned_addr learned my addr 172.21.15.17:0/414088391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f760af0 0x55d90f771370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 -- 172.21.15.17:0/414088391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 msgr2=0x55d90f78c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f78c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 -- 172.21.15.17:0/414088391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f760af0 msgr2=0x55d90f771370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f760af0 0x55d90f771370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 -- 172.21.15.17:0/414088391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90f786b40 con 0x55d90f761410 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3eb9559640 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40980b0 tx=0x7f3ea4005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f67f0b7c43f401 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3e9f7fe640 1 -- 172.21.15.17:0/414088391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40b8030 con 0x55d90f761410 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3e9f7fe640 1 -- 172.21.15.17:0/414088391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ea409bc50 con 0x55d90f761410 2024-09-16T01:05:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.010+0000 7f3e9f7fe640 1 -- 172.21.15.17:0/414088391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea409b0a0 con 0x55d90f761410 2024-09-16T01:05:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- 172.21.15.17:0/414088391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 msgr2=0x55d90f78c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40980b0 tx=0x7f3ea4005a70 comp rx=0 tx=0).stop 2024-09-16T01:05:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- 172.21.15.17:0/414088391 shutdown_connections 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f76bcb0 0x55d90f78c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f78c000 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- 172.21.15.17:0/414088391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f760af0 0x55d90f771370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- 172.21.15.17:0/414088391 >> 172.21.15.17:0/414088391 conn(0x55d90f75d060 msgr2=0x55d90f770c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- 172.21.15.17:0/414088391 shutdown_connections 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- 172.21.15.17:0/414088391 wait complete. 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- start start 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 Processor -- start 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f77ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f7edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ac980 con 0x55d90f761410 2024-09-16T01:05:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41ac2b0 con 0x55d90f76bcb0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41a94f0 con 0x55d90f760af0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.011+0000 7f3ebee30740 10 client.0 _ll_register_callbacks cb 0x7f3ea400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49914/0 (socket says 172.21.15.17:49914) 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 -- 172.21.15.17:0/1261791077 learned_addr learned my addr 172.21.15.17:0/1261791077 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eba55b640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f7edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f77ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 -- 172.21.15.17:0/1261791077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 msgr2=0x55d90f77ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f77ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 -- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 msgr2=0x55d90f7edfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f7edfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 -- 172.21.15.17:0/1261791077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90f7ee510 con 0x55d90f761410 2024-09-16T01:05:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eba55b640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f7edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3eb9559640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea40cd540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c157b542c51ec388 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3e9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40b8030 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3ea40ba2c0 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ea409bc50 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ea409b5b0 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3ebee30740 10 client.15591 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.012+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d90f7ef790 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ea409bc50 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ea409b1c0 con 0x55d90f761410 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 10 client.15591 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 20 client.15591 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7efc60 0x55d90f7f2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 4 client.15591 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:05:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d90f6ccd70 con 0x55d90f7efc60 2024-09-16T01:05:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7efc60 0x55d90f7f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3e9d7fa640 10 client.15591 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.013+0000 7f3eb9d5a640 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7efc60 0x55d90f7f2050 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1954b64b2bc5aff6 server_cookie=63b9933dc9feb6d0 in_seq=0 out_seq=0 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3e9d7fa640 1 -- 172.21.15.17:0/1261791077 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d90f6ccd70 con 0x55d90f7efc60 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3e9d7fa640 10 client.15591 handle_command_reply: tid=0 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 client.15591 shutdown 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 msgr2=0x55d90f77d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea40cd540 comp rx=0 tx=0).stop 2024-09-16T01:05:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 shutdown_connections 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d90f7efc60 0x55d90f7f2050 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d90f76bcb0 0x55d90f7edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d90f761410 0x55d90f77d3f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3e9d7fa640 0 client.15591 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 --2- 172.21.15.17:0/1261791077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d90f760af0 0x55d90f77ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.026+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 >> 172.21.15.17:0/1261791077 conn(0x55d90f75d060 msgr2=0x55d90f75c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 shutdown_connections 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebee30740 1 -- 172.21.15.17:0/1261791077 wait complete. 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebee30740 20 client.15591 trim_cache size 0 max 16384 2024-09-16T01:05:30.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:05:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:05:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:05:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:05:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 msgr2=0x7f3ea00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:30.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 0x7f3ea00a5920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3eac01e000 tx=0x7f3eac01f000 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 msgr2=0x7f3eb4199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d950 tx=0x7f3ea400de10 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 shutdown_connections 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ea00a3460 0x7f3ea00a5920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb4106a00 0x7f3eb4199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3eb4101390 0x7f3eb4199740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 --2- 172.21.15.17:0/3773607362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3eb41009f0 0x7f3eb4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 >> 172.21.15.17:0/3773607362 conn(0x7f3eb40fc6b0 msgr2=0x7f3eb40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 shutdown_connections 2024-09-16T01:05:30.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:30.027+0000 7f3ebbfbe640 1 -- 172.21.15.17:0/3773607362 wait complete. 2024-09-16T01:05:30.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:05:30.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:05:30.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:05:30.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:05:30.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:05:30.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:05:30.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:05:30.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:05:30.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:05:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:31 smithi088 ceph-mon[34093]: pgmap v97: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:31 smithi154 ceph-mon[34759]: pgmap v97: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:31.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:31 smithi017 ceph-mon[31211]: pgmap v97: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:32.527 INFO:tasks.workunit.client.0.smithi017.stdout:64/600: open fd = 3 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:65/600: open fd = 3 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.528 INFO:tasks.workunit.client.0.smithi017.stdout:66/600: open fd = 3 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:67/600: open fd = 3 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.529 INFO:tasks.workunit.client.0.smithi017.stdout:68/600: open fd = 3 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:69/600: open fd = 3 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.530 INFO:tasks.workunit.client.0.smithi017.stdout:70/600: open fd = 3 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:71/600: open fd = 3 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.531 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:72/600: open fd = 3 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.532 INFO:tasks.workunit.client.0.smithi017.stdout:73/600: open fd = 3 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:74/600: open fd = 3 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:75/600: open fd = 3 2024-09-16T01:05:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:76/600: open fd = 3 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:77/600: open fd = 3 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.534 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:78/600: open fd = 3 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:79/600: open fd = 3 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:80/600: open fd = 3 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:81/600: open fd = 3 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.536 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.537 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.537 INFO:tasks.workunit.client.0.smithi017.stdout:82/600: open fd = 3 2024-09-16T01:05:32.537 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.537 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.537 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:83/600: open fd = 3 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:84/600: open fd = 3 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:85/600: open fd = 3 2024-09-16T01:05:32.538 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:86/600: open fd = 3 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:87/600: open fd = 3 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.539 INFO:tasks.workunit.client.0.smithi017.stdout:88/600: open fd = 3 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:89/600: open fd = 3 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:90/600: open fd = 3 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.540 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:91/600: open fd = 3 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:92/600: open fd = 3 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:93/600: open fd = 3 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:94/600: open fd = 3 2024-09-16T01:05:32.541 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:95/600: open fd = 3 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:96/600: open fd = 3 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:97/600: open fd = 3 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.542 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:98/600: open fd = 3 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:99/600: open fd = 3 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:100/600: open fd = 3 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:101/600: open fd = 3 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.543 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:102/600: open fd = 3 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:103/600: open fd = 3 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:104/600: open fd = 3 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.544 INFO:tasks.workunit.client.0.smithi017.stdout:105/600: open fd = 3 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:106/600: open fd = 3 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:107/600: open fd = 3 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:108/600: open fd = 3 2024-09-16T01:05:32.545 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:109/600: open fd = 3 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:110/600: open fd = 3 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:111/600: open fd = 3 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.546 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:112/600: open fd = 3 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:113/600: open fd = 3 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:114/600: open fd = 3 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:115/600: open fd = 3 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.547 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:116/600: open fd = 3 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:117/600: open fd = 3 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:118/600: open fd = 3 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.548 INFO:tasks.workunit.client.0.smithi017.stdout:119/600: open fd = 3 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:120/600: open fd = 3 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:121/600: open fd = 3 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:122/600: open fd = 3 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.549 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:123/600: open fd = 3 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:124/600: open fd = 3 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:125/600: open fd = 3 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:126/600: open fd = 3 2024-09-16T01:05:32.550 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:05:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:33 smithi088 ceph-mon[34093]: pgmap v98: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:33.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:33 smithi154 ceph-mon[34759]: pgmap v98: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:33.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:33 smithi017 ceph-mon[31211]: pgmap v98: 97 pgs: 97 active+clean; 3.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:35 smithi088 ceph-mon[34093]: pgmap v99: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:35 smithi154 ceph-mon[34759]: pgmap v99: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:35 smithi017 ceph-mon[31211]: pgmap v99: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:37 smithi088 ceph-mon[34093]: pgmap v100: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:37 smithi154 ceph-mon[34759]: pgmap v100: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:37 smithi017 ceph-mon[31211]: pgmap v100: 97 pgs: 97 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:39 smithi088 ceph-mon[34093]: pgmap v101: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:39 smithi154 ceph-mon[34759]: pgmap v101: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:39 smithi017 ceph-mon[31211]: pgmap v101: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:41 smithi088 ceph-mon[34093]: pgmap v102: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:41 smithi154 ceph-mon[34759]: pgmap v102: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:41 smithi017 ceph-mon[31211]: pgmap v102: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- 172.21.15.17:0/382264553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a81008d0 msgr2=0x7f83a8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 --2- 172.21.15.17:0/382264553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a81008d0 0x7f83a8100cb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009900 tx=0x7f83a002a3f0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- 172.21.15.17:0/382264553 shutdown_connections 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 --2- 172.21.15.17:0/382264553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a810e480 0x7f83a8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 --2- 172.21.15.17:0/382264553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a8101280 0x7f83a810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 --2- 172.21.15.17:0/382264553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a81008d0 0x7f83a8100cb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- 172.21.15.17:0/382264553 >> 172.21.15.17:0/382264553 conn(0x7f83a80fc6b0 msgr2=0x7f83a80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- 172.21.15.17:0/382264553 shutdown_connections 2024-09-16T01:05:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- 172.21.15.17:0/382264553 wait complete. 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 Processor -- start 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.128+0000 7f83afc47640 1 -- start start 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a81008d0 0x7f83a819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 0x7f83a819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8113fb0 con 0x7f83a810e480 2024-09-16T01:05:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8113e30 con 0x7f83a8101280 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8114130 con 0x7f83a81008d0 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42290/0 (socket says 172.21.15.17:42290) 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 -- 172.21.15.17:0/1642579210 learned_addr learned my addr 172.21.15.17:0/1642579210 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a81008d0 0x7f83a819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 0x7f83a819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 -- 172.21.15.17:0/1642579210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a81008d0 msgr2=0x7f83a819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a81008d0 0x7f83a819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 -- 172.21.15.17:0/1642579210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 msgr2=0x7f83a819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 0x7f83a819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 -- 172.21.15.17:0/1642579210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a819f470 con 0x7f83a810e480 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 0x7f83a819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83ae1e4640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f839800eb40 tx=0x7f839800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83a6ffd640 1 -- 172.21.15.17:0/1642579210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398004b20 con 0x7f83a810e480 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83a6ffd640 1 -- 172.21.15.17:0/1642579210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8398004cc0 con 0x7f83a810e480 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a819f760 con 0x7f83a810e480 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83a6ffd640 1 -- 172.21.15.17:0/1642579210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83980107b0 con 0x7f83a810e480 2024-09-16T01:05:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.130+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a81a6ff0 con 0x7f83a810e480 2024-09-16T01:05:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.132+0000 7f83a6ffd640 1 -- 172.21.15.17:0/1642579210 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8398005020 con 0x7f83a810e480 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 Processor -- start 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 -- start start 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55905683daf0 0x55905683ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x559056848770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5590567a22f0 con 0x559056848cb0 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55905674a270 con 0x55905683e410 2024-09-16T01:05:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83b29de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55905679e2b0 con 0x55905683daf0 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83a6ffd640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 0x7f83900a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83ad1e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83ad1e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42292/0 (socket says 172.21.15.17:42292) 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83ad1e2640 1 -- 172.21.15.17:0/3611610121 learned_addr learned my addr 172.21.15.17:0/3611610121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x559056848770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.133+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55905683daf0 0x55905683ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ae1e4640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 0x7f83900a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83a6ffd640 1 -- 172.21.15.17:0/1642579210 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f83980d04b0 con 0x7f83a810e480 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 -- 172.21.15.17:0/3611610121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55905683daf0 msgr2=0x55905683ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55905683daf0 0x55905683ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 -- 172.21.15.17:0/3611610121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 msgr2=0x559056848770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x559056848770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 -- 172.21.15.17:0/3611610121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559056749340 con 0x559056848cb0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x559056848770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ae1e4640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 0x7f83900a59a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f839809c460 tx=0x7f8398097040 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f839c014a30 tx=0x7f839c00c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a8a01794aca60a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f838ffff640 1 -- 172.21.15.17:0/3611610121 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0142d0 con 0x559056848cb0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f838ffff640 1 -- 172.21.15.17:0/3611610121 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f839c0054d0 con 0x559056848cb0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.134+0000 7f838ffff640 1 -- 172.21.15.17:0/3611610121 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0047a0 con 0x559056848cb0 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 -- 172.21.15.17:0/3611610121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 msgr2=0x55905684b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f839c014a30 tx=0x7f839c00c570 comp rx=0 tx=0).stop 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 -- 172.21.15.17:0/3611610121 shutdown_connections 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559056848cb0 0x55905684b0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x559056848770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 --2- 172.21.15.17:0/3611610121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55905683daf0 0x55905683ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 -- 172.21.15.17:0/3611610121 >> 172.21.15.17:0/3611610121 conn(0x55905683a060 msgr2=0x55905683a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 -- 172.21.15.17:0/3611610121 shutdown_connections 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.135+0000 7f83b29de740 1 -- 172.21.15.17:0/3611610121 wait complete. 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 -- start start 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 Processor -- start 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x559056845ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056846620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55905684b880 con 0x55905683e410 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55905672b290 con 0x55905683daf0 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55905684ba00 con 0x559056848cb0 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83b29de740 10 client.0 _ll_register_callbacks cb 0x55905675c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83ad9e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83ad9e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42302/0 (socket says 172.21.15.17:42302) 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1213316917 learned_addr learned my addr 172.21.15.17:0/1213316917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.136+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x559056845ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056846620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1213316917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 msgr2=0x559056846620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056846620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 msgr2=0x559056845ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x559056845ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1213316917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590564b5210 con 0x55905683e410 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009900 tx=0x7f83a0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9ca39bcd023939 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f838d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0035040 con 0x55905683e410 2024-09-16T01:05:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f83a00317a0 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c0054d0 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f83a0004040 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83b29de740 10 client.15603 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.137+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559056581620 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f839c0054d0 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83a00047e0 con 0x55905683e410 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 10 client.15603 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 20 client.15603 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559056858bb0 0x55905685afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 4 client.15603 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590567afa20 con 0x559056858bb0 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559056858bb0 0x55905685afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f838d7fa640 10 client.15603 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.138+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559056858bb0 0x55905685afa0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36da554e94c48fc1 server_cookie=455719a91d503393 in_seq=0 out_seq=0 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.139+0000 7f838d7fa640 1 -- 172.21.15.17:0/1213316917 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590567afa20 con 0x559056858bb0 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.139+0000 7f838d7fa640 10 client.15603 handle_command_reply: tid=0 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.139+0000 7f83b29de740 1 client.15603 shutdown 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 msgr2=0x5590568460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009900 tx=0x7f83a0009650 comp rx=0 tx=0).stop 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 shutdown_connections 2024-09-16T01:05:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559056858bb0 0x55905685afa0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056846620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x5590568460e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 --2- 172.21.15.17:0/1213316917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x559056845ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f838d7fa640 0 client.15603 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 >> 172.21.15.17:0/1213316917 conn(0x55905683a060 msgr2=0x55905683fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 shutdown_connections 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 1 -- 172.21.15.17:0/1213316917 wait complete. 2024-09-16T01:05:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.140+0000 7f83b29de740 20 client.15603 trim_cache size 0 max 16384 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.154+0000 7f83b29de740 1 Processor -- start 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.154+0000 7f83b29de740 1 -- start start 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x5590568608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056860df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81af7f0 con 0x55905683daf0 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81b1330 con 0x55905683e410 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83b29de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81afec0 con 0x559056848cb0 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42304/0 (socket says 172.21.15.17:42304) 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 -- 172.21.15.17:0/2660440325 learned_addr learned my addr 172.21.15.17:0/2660440325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 -- 172.21.15.17:0/2660440325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 msgr2=0x559056860df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056860df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 -- 172.21.15.17:0/2660440325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 msgr2=0x5590568608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x5590568608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 -- 172.21.15.17:0/2660440325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559056839e90 con 0x55905683daf0 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f839c00f730 tx=0x7f839c00c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fac890fb23866e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.155+0000 7f838f7fe640 1 -- 172.21.15.17:0/2660440325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c032070 con 0x55905683daf0 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f838f7fe640 1 -- 172.21.15.17:0/2660440325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f839c00fbb0 con 0x55905683daf0 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f838f7fe640 1 -- 172.21.15.17:0/2660440325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c02d9e0 con 0x55905683daf0 2024-09-16T01:05:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 -- 172.21.15.17:0/2660440325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 msgr2=0x559056846450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f839c00f730 tx=0x7f839c00c4d0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 -- 172.21.15.17:0/2660440325 shutdown_connections 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x559056860df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683e410 0x5590568608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 --2- 172.21.15.17:0/2660440325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683daf0 0x559056846450 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 -- 172.21.15.17:0/2660440325 >> 172.21.15.17:0/2660440325 conn(0x55905683a060 msgr2=0x559056847c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 -- 172.21.15.17:0/2660440325 shutdown_connections 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.156+0000 7f83b29de740 1 -- 172.21.15.17:0/2660440325 wait complete. 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 -- start start 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 Processor -- start 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x5590568512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x55905684cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81b0c60 con 0x55905683e410 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81b0590 con 0x55905683daf0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83a81ad7d0 con 0x559056848cb0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83b29de740 10 client.0 _ll_register_callbacks cb 0x7f83a0005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83ad9e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83ad9e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42310/0 (socket says 172.21.15.17:42310) 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1472031214 learned_addr learned my addr 172.21.15.17:0/1472031214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x55905684cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.157+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x5590568512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1472031214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 msgr2=0x55905684cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x55905684cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 msgr2=0x5590568512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x5590568512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 -- 172.21.15.17:0/1472031214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905684d380 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x5590568512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83ad9e3640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009850 tx=0x7f83a00092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf5805575a6adcc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0035030 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f83a00046c0 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c00fbb0 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f83a00048c0 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83b29de740 10 client.15609 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590568c37a0 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f839c00fbb0 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.158+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83a0005100 con 0x55905683e410 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 10 client.15609 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 20 client.15609 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5590568c3e70 0x5590568c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 4 client.15609 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590567a9d70 con 0x5590568c3e70 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5590568c3e70 0x5590568c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f838d7fa640 10 client.15609 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.159+0000 7f83ad1e2640 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5590568c3e70 0x5590568c6290 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fdc6fb1a2e1d8cb server_cookie=f9b579558b8fa57d in_seq=0 out_seq=0 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f838d7fa640 1 -- 172.21.15.17:0/1472031214 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590567a9d70 con 0x5590568c3e70 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f838d7fa640 10 client.15609 handle_command_reply: tid=0 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 client.15609 shutdown 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 msgr2=0x55905684c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009850 tx=0x7f83a00092b0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 shutdown_connections 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5590568c3e70 0x5590568c6290 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559056848cb0 0x55905684cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905683e410 0x55905684c610 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f838d7fa640 0 client.15609 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 --2- 172.21.15.17:0/1472031214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55905683daf0 0x5590568512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 >> 172.21.15.17:0/1472031214 conn(0x55905683a060 msgr2=0x559056847400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 shutdown_connections 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 1 -- 172.21.15.17:0/1472031214 wait complete. 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83b29de740 20 client.15609 trim_cache size 0 max 16384 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:05:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:05:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 msgr2=0x7f83900a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 0x7f83900a59a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f839809c460 tx=0x7f8398097040 comp rx=0 tx=0).stop 2024-09-16T01:05:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 msgr2=0x7f83a819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f839800eb40 tx=0x7f839800c2d0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 shutdown_connections 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f83900a34e0 0x7f83900a59a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83a810e480 0x7f83a819ed40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83a8101280 0x7f83a819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 --2- 172.21.15.17:0/1642579210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a81008d0 0x7f83a819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 >> 172.21.15.17:0/1642579210 conn(0x7f83a80fc6b0 msgr2=0x7f83a80feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 shutdown_connections 2024-09-16T01:05:43.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:43.177+0000 7f83afc47640 1 -- 172.21.15.17:0/1642579210 wait complete. 2024-09-16T01:05:43.740 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:43 smithi017 ceph-mon[31211]: pgmap v103: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:43.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:43 smithi088 ceph-mon[34093]: pgmap v103: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:43.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:43 smithi154 ceph-mon[34759]: pgmap v103: 97 pgs: 97 active+clean; 3.9 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:05:45.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:45 smithi088 ceph-mon[34093]: pgmap v104: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:45 smithi154 ceph-mon[34759]: pgmap v104: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:45 smithi017 ceph-mon[31211]: pgmap v104: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:47 smithi088 ceph-mon[34093]: pgmap v105: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:47 smithi154 ceph-mon[34759]: pgmap v105: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:47 smithi017 ceph-mon[31211]: pgmap v105: 97 pgs: 97 active+clean; 4.0 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-16T01:05:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:49 smithi088 ceph-mon[34093]: pgmap v106: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:49 smithi154 ceph-mon[34759]: pgmap v106: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:49.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:49 smithi017 ceph-mon[31211]: pgmap v106: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-16T01:05:51.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:51 smithi088 ceph-mon[34093]: pgmap v107: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:51 smithi154 ceph-mon[34759]: pgmap v107: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:51.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:51 smithi017 ceph-mon[31211]: pgmap v107: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:53 smithi088 ceph-mon[34093]: pgmap v108: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:53.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:53 smithi154 ceph-mon[34759]: pgmap v108: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:53 smithi017 ceph-mon[31211]: pgmap v108: 97 pgs: 97 active+clean; 4.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:55.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:55 smithi088 ceph-mon[34093]: pgmap v109: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:55.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:55 smithi154 ceph-mon[34759]: pgmap v109: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:55 smithi017 ceph-mon[31211]: pgmap v109: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-09-16T01:05:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 -- 172.21.15.17:0/3573657807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67441035e0 msgr2=0x7f674410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 --2- 172.21.15.17:0/3573657807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67441035e0 0x7f674410bac0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6738009900 tx=0x7f673802a480 comp rx=0 tx=0).stop 2024-09-16T01:05:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 -- 172.21.15.17:0/3573657807 shutdown_connections 2024-09-16T01:05:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 --2- 172.21.15.17:0/3573657807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f674410c110 0x7f674410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 --2- 172.21.15.17:0/3573657807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67441035e0 0x7f674410bac0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 --2- 172.21.15.17:0/3573657807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6744102cc0 0x7f67441030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 -- 172.21.15.17:0/3573657807 >> 172.21.15.17:0/3573657807 conn(0x7f67440fc6b0 msgr2=0x7f67440fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 -- 172.21.15.17:0/3573657807 shutdown_connections 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.278+0000 7f67496f1640 1 -- 172.21.15.17:0/3573657807 wait complete. 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 Processor -- start 2024-09-16T01:05:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 -- start start 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67441035e0 0x7f67441988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 0x7f674419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6744111da0 con 0x7f6744102cc0 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6744111c20 con 0x7f67441035e0 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67496f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6744111f20 con 0x7f674410c110 2024-09-16T01:05:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58818/0 (socket says 172.21.15.17:58818) 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f6742ffd640 1 -- 172.21.15.17:0/776041167 learned_addr learned my addr 172.21.15.17:0/776041167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67427fc640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67441035e0 0x7f67441988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.279+0000 7f67437fe640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 0x7f674419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 -- 172.21.15.17:0/776041167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 msgr2=0x7f674419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 0x7f674419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 -- 172.21.15.17:0/776041167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67441035e0 msgr2=0x7f67441988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67441035e0 0x7f67441988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 -- 172.21.15.17:0/776041167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674419d350 con 0x7f6744102cc0 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f67437fe640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 0x7f674419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f6742ffd640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f673400e9f0 tx=0x7f673400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f672bfff640 1 -- 172.21.15.17:0/776041167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673400cd80 con 0x7f6744102cc0 2024-09-16T01:05:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f672bfff640 1 -- 172.21.15.17:0/776041167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67340054d0 con 0x7f6744102cc0 2024-09-16T01:05:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f672bfff640 1 -- 172.21.15.17:0/776041167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734010490 con 0x7f6744102cc0 2024-09-16T01:05:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674419d640 con 0x7f6744102cc0 2024-09-16T01:05:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.280+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441a4ed0 con 0x7f6744102cc0 2024-09-16T01:05:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f672bfff640 1 -- 172.21.15.17:0/776041167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6734005020 con 0x7f6744102cc0 2024-09-16T01:05:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 Processor -- start 2024-09-16T01:05:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 -- start start 2024-09-16T01:05:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7179ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed71870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fed70de2f0 con 0x55fed717a410 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fed7086270 con 0x55fed7184cb0 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f674c493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fed70da2b0 con 0x55fed7179af0 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58826/0 (socket says 172.21.15.17:58826) 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f6742ffd640 1 -- 172.21.15.17:0/3253842239 learned_addr learned my addr 172.21.15.17:0/3253842239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f672bfff640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 0x7f672c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f67427fc640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed71870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.283+0000 7f67437fe640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7179ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67437fe640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 0x7f672c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f672bfff640 1 -- 172.21.15.17:0/776041167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f67340d0100 con 0x7f6744102cc0 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 -- 172.21.15.17:0/3253842239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 msgr2=0x55fed7179ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7179ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 -- 172.21.15.17:0/3253842239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 msgr2=0x55fed71870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed71870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 -- 172.21.15.17:0/3253842239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed7085340 con 0x55fed717a410 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67437fe640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7179ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67427fc640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed71870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:05:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f673409c110 tx=0x7f6734009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b87adca63405b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67297fa640 1 -- 172.21.15.17:0/3253842239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673409bd70 con 0x55fed717a410 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67437fe640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 0x7f672c0a5920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f673c009370 tx=0x7f673c009240 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67297fa640 1 -- 172.21.15.17:0/3253842239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6734005310 con 0x55fed717a410 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.284+0000 7f67297fa640 1 -- 172.21.15.17:0/3253842239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340a07c0 con 0x55fed717a410 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- 172.21.15.17:0/3253842239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 msgr2=0x55fed7184770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f673409c110 tx=0x7f6734009310 comp rx=0 tx=0).stop 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- 172.21.15.17:0/3253842239 shutdown_connections 2024-09-16T01:05:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed71870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed717a410 0x55fed7184770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 --2- 172.21.15.17:0/3253842239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7179ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- 172.21.15.17:0/3253842239 >> 172.21.15.17:0/3253842239 conn(0x55fed7176060 msgr2=0x55fed7176440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- 172.21.15.17:0/3253842239 shutdown_connections 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- 172.21.15.17:0/3253842239 wait complete. 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 -- start start 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.285+0000 7f674c493740 1 Processor -- start 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7181c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7182180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fed7187880 con 0x55fed7184cb0 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55fed7067290 con 0x55fed717a410 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fed7187a00 con 0x55fed7179af0 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f674c493740 10 client.0 _ll_register_callbacks cb 0x55fed7098140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58836/0 (socket says 172.21.15.17:58836) 2024-09-16T01:05:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 -- 172.21.15.17:0/128300923 learned_addr learned my addr 172.21.15.17:0/128300923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f6742ffd640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7181c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67427fc640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7182180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 -- 172.21.15.17:0/128300923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 msgr2=0x55fed7181c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7181c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 -- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 msgr2=0x55fed7182180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7182180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 -- 172.21.15.17:0/128300923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed6df1210 con 0x55fed7184cb0 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67427fc640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7182180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:05:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f67437fe640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f673c016350 tx=0x7f673c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f712aad678d4f513 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.286+0000 7f6726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c026030 con 0x55fed7184cb0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f673c003970 con 0x55fed7184cb0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fed70eba20 con 0x55fed7184cb0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f673c030050 con 0x55fed7184cb0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fed6ebd620 con 0x55fed7184cb0 2024-09-16T01:05:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55fed70eba20 con 0x55fed7184cb0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f673c0041b0 con 0x55fed7184cb0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 20 client.15621 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed7194ca0 0x55fed71970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 4 client.15621 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.287+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fed70e5d70 con 0x55fed7194ca0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.288+0000 7f6742ffd640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed7194ca0 0x55fed71970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.288+0000 7f6742ffd640 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed7194ca0 0x55fed71970d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3442c43b45b7e49b server_cookie=735c1323766a7156 in_seq=0 out_seq=0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.288+0000 7f6726ff5640 10 client.15621 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f6726ff5640 1 -- 172.21.15.17:0/128300923 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fed70e5d70 con 0x55fed7194ca0 2024-09-16T01:05:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f6726ff5640 10 client.15621 handle_command_reply: tid=0 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 client.15621 shutdown 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 msgr2=0x55fed71826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f673c016350 tx=0x7f673c004a40 comp rx=0 tx=0).stop 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 shutdown_connections 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed7194ca0 0x55fed71970d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7184cb0 0x55fed71826c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7182180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f6726ff5640 0 client.15621 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 --2- 172.21.15.17:0/128300923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7179af0 0x55fed7181c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 >> 172.21.15.17:0/128300923 conn(0x55fed7176060 msgr2=0x55fed71751c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 shutdown_connections 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 1 -- 172.21.15.17:0/128300923 wait complete. 2024-09-16T01:05:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.289+0000 7f674c493740 20 client.15621 trim_cache size 0 max 16384 2024-09-16T01:05:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 Processor -- start 2024-09-16T01:05:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 -- start start 2024-09-16T01:05:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 0x55fed719ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed719cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67441ad6a0 con 0x55fed7179af0 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67441af1e0 con 0x55fed7184cb0 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f674c493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67441add70 con 0x55fed717a410 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58846/0 (socket says 172.21.15.17:58846) 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.304+0000 7f6742ffd640 1 -- 172.21.15.17:0/3613915705 learned_addr learned my addr 172.21.15.17:0/3613915705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f67437fe640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed719cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f67427fc640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 0x55fed719ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 -- 172.21.15.17:0/3613915705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 msgr2=0x55fed719ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 0x55fed719ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 -- 172.21.15.17:0/3613915705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 msgr2=0x55fed719cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed719cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 -- 172.21.15.17:0/3613915705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed7176cf0 con 0x55fed7179af0 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f67437fe640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed719cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f67427fc640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 0x55fed719ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f67340cd930 tx=0x7f67340097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32213ba47f2121c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6728ff9640 1 -- 172.21.15.17:0/3613915705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734005680 con 0x55fed7179af0 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6728ff9640 1 -- 172.21.15.17:0/3613915705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f673409cb10 con 0x55fed7179af0 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.305+0000 7f6728ff9640 1 -- 172.21.15.17:0/3613915705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340cdb00 con 0x55fed7179af0 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- 172.21.15.17:0/3613915705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 msgr2=0x55fed71824f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f67340cd930 tx=0x7f67340097a0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- 172.21.15.17:0/3613915705 shutdown_connections 2024-09-16T01:05:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed7184cb0 0x55fed719cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed717a410 0x55fed719ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- 172.21.15.17:0/3613915705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed71824f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- 172.21.15.17:0/3613915705 >> 172.21.15.17:0/3613915705 conn(0x55fed7176060 msgr2=0x55fed7183cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- 172.21.15.17:0/3613915705 shutdown_connections 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- 172.21.15.17:0/3613915705 wait complete. 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- start start 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 Processor -- start 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7188570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 0x55fed7188ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67441aeb10 con 0x55fed7179af0 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67441ae440 con 0x55fed717a410 2024-09-16T01:05:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67441ab680 con 0x55fed7184cb0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f674c493740 10 client.0 _ll_register_callbacks cb 0x7f673c011ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.306+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58850/0 (socket says 172.21.15.17:58850) 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 -- 172.21.15.17:0/3521431584 learned_addr learned my addr 172.21.15.17:0/3521431584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f67427fc640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7188570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f67437fe640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 0x55fed7188ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 -- 172.21.15.17:0/3521431584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 msgr2=0x55fed7188ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 0x55fed7188ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 -- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 msgr2=0x55fed7188570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7188570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 -- 172.21.15.17:0/3521431584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed7189120 con 0x55fed7179af0 2024-09-16T01:05:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f67437fe640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 0x55fed7188ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6742ffd640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6734098de0 tx=0x7f67340d04d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2587252b020463 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340a07c0 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f67340cdb00 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f673409cb10 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6734098a80 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f674c493740 10 client.15627 fetch_fsmap learned FSMap version 28 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.307+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fed71ff7f0 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f673409cb10 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f673409b860 con 0x55fed7179af0 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 10 client.15627 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 20 client.15627 populate_metadata read hostname 'smithi017' 2024-09-16T01:05:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed71ffa70 0x55fed7201e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:05:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 4 client.15627 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:05:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fed7062900 con 0x55fed71ffa70 2024-09-16T01:05:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f67427fc640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed71ffa70 0x55fed7201e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:05:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f6726ff5640 10 client.15627 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.308+0000 7f67427fc640 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed71ffa70 0x55fed7201e60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9d2960659a8735c server_cookie=ed3e5af67c96343e in_seq=0 out_seq=0 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f6726ff5640 1 -- 172.21.15.17:0/3521431584 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fed7062900 con 0x55fed71ffa70 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f6726ff5640 10 client.15627 handle_command_reply: tid=0 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 client.15627 shutdown 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 msgr2=0x55fed718d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6734098de0 tx=0x7f67340d04d0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 shutdown_connections 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55fed71ffa70 0x55fed7201e60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fed7184cb0 0x55fed7188ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55fed717a410 0x55fed7188570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 --2- 172.21.15.17:0/3521431584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fed7179af0 0x55fed718d250 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f6726ff5640 0 client.15627 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 >> 172.21.15.17:0/3521431584 conn(0x55fed7176060 msgr2=0x55fed717b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 shutdown_connections 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 1 -- 172.21.15.17:0/3521431584 wait complete. 2024-09-16T01:05:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.325+0000 7f674c493740 20 client.15627 trim_cache size 0 max 16384 2024-09-16T01:05:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:05:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:05:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:05:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:05:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 msgr2=0x7f672c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 0x7f672c0a5920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f673c009370 tx=0x7f673c009240 comp rx=0 tx=0).stop 2024-09-16T01:05:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 msgr2=0x7f6744198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f673400e9f0 tx=0x7f673400edf0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 shutdown_connections 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f672c0a3460 0x7f672c0a5920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f674410c110 0x7f674419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67441035e0 0x7f67441988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 --2- 172.21.15.17:0/776041167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744102cc0 0x7f6744198360 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:05:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 >> 172.21.15.17:0/776041167 conn(0x7f67440fc6b0 msgr2=0x7f67440fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:05:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 shutdown_connections 2024-09-16T01:05:56.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:05:56.326+0000 7f67496f1640 1 -- 172.21.15.17:0/776041167 wait complete. 2024-09-16T01:05:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:57 smithi088 ceph-mon[34093]: pgmap v110: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:57 smithi154 ceph-mon[34759]: pgmap v110: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:57 smithi017 ceph-mon[31211]: pgmap v110: 97 pgs: 97 active+clean; 4.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-16T01:05:59.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:05:59 smithi088 ceph-mon[34093]: pgmap v111: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 25 op/s 2024-09-16T01:05:59.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:05:59 smithi154 ceph-mon[34759]: pgmap v111: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 25 op/s 2024-09-16T01:05:59.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:05:59 smithi017 ceph-mon[31211]: pgmap v111: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 25 op/s 2024-09-16T01:06:01.904 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:01 smithi088 ceph-mon[34093]: pgmap v112: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:01.909 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:01 smithi154 ceph-mon[34759]: pgmap v112: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:01.942 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:01 smithi017 ceph-mon[31211]: pgmap v112: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:03.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:03 smithi088 ceph-mon[34093]: pgmap v113: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:03 smithi154 ceph-mon[34759]: pgmap v113: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:03 smithi017 ceph-mon[31211]: pgmap v113: 97 pgs: 97 active+clean; 4.4 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 16 op/s 2024-09-16T01:06:05.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:05 smithi088 ceph-mon[34093]: pgmap v114: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 37 op/s 2024-09-16T01:06:05.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:05 smithi154 ceph-mon[34759]: pgmap v114: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 37 op/s 2024-09-16T01:06:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:05 smithi017 ceph-mon[31211]: pgmap v114: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 37 op/s 2024-09-16T01:06:07.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:07 smithi088 ceph-mon[34093]: pgmap v115: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:06:07.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:07 smithi154 ceph-mon[34759]: pgmap v115: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:06:07.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:07 smithi017 ceph-mon[31211]: pgmap v115: 97 pgs: 97 active+clean; 4.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 -- 172.21.15.17:0/2117886589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef41069c0 msgr2=0x7f7ef4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 --2- 172.21.15.17:0/2117886589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef41069c0 0x7f7ef4106da0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009930 tx=0x7f7ef002a420 comp rx=0 tx=0).stop 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 -- 172.21.15.17:0/2117886589 shutdown_connections 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 --2- 172.21.15.17:0/2117886589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef4101350 0x7f7ef410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 --2- 172.21.15.17:0/2117886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41009b0 0x7f7ef4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 --2- 172.21.15.17:0/2117886589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef41069c0 0x7f7ef4106da0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 -- 172.21.15.17:0/2117886589 >> 172.21.15.17:0/2117886589 conn(0x7f7ef4077990 msgr2=0x7f7ef40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 -- 172.21.15.17:0/2117886589 shutdown_connections 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.426+0000 7f7efc56d640 1 -- 172.21.15.17:0/2117886589 wait complete. 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 Processor -- start 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 -- start start 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef41009b0 0x7f7ef40fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41069c0 0x7f7ef40fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4110cc0 con 0x7f7ef4101350 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4110b40 con 0x7f7ef41009b0 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efc56d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4110e40 con 0x7f7ef41069c0 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51538/0 (socket says 172.21.15.17:51538) 2024-09-16T01:06:09.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7ef9b08640 1 -- 172.21.15.17:0/305428817 learned_addr learned my addr 172.21.15.17:0/305428817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efa309640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef41009b0 0x7f7ef40fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.427+0000 7f7efab0a640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41069c0 0x7f7ef40fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 -- 172.21.15.17:0/305428817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41069c0 msgr2=0x7f7ef40fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41069c0 0x7f7ef40fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 -- 172.21.15.17:0/305428817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef41009b0 msgr2=0x7f7ef40fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef41009b0 0x7f7ef40fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 -- 172.21.15.17:0/305428817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef41a6700 con 0x7f7ef4101350 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400d950 tx=0x7f7ee400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7eeb7fe640 1 -- 172.21.15.17:0/305428817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4017030 con 0x7f7ef4101350 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7eeb7fe640 1 -- 172.21.15.17:0/305428817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee4004020 con 0x7f7ef4101350 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef41a69f0 con 0x7f7ef4101350 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7eeb7fe640 1 -- 172.21.15.17:0/305428817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40047a0 con 0x7f7ef4101350 2024-09-16T01:06:09.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.428+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef41a6f90 con 0x7f7ef4101350 2024-09-16T01:06:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.431+0000 7f7eeb7fe640 1 -- 172.21.15.17:0/305428817 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7ee40041d0 con 0x7f7ef4101350 2024-09-16T01:06:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.431+0000 7f7eff3e3740 1 Processor -- start 2024-09-16T01:06:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.431+0000 7f7eff3e3740 1 -- start start 2024-09-16T01:06:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a584ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d08a4e92f0 con 0x55d08a58fcb0 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d08a491270 con 0x55d08a584af0 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d08a4e52b0 con 0x55d08a585410 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51554/0 (socket says 172.21.15.17:51554) 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eeb7fe640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 0x7f7ee00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 -- 172.21.15.17:0/37428409 learned_addr learned my addr 172.21.15.17:0/37428409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7efab0a640 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a584ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7efab0a640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 0x7f7ee00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7eeb7fe640 1 -- 172.21.15.17:0/305428817 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ee40cf690 con 0x7f7ef4101350 2024-09-16T01:06:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 -- 172.21.15.17:0/37428409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 msgr2=0x55d08a58f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 -- 172.21.15.17:0/37428409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 msgr2=0x55d08a584ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a584ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.432+0000 7f7ef9b08640 1 -- 172.21.15.17:0/37428409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08a490340 con 0x55d08a58fcb0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7ee409b6a0 tx=0x7f7ee4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388fe6c97cb29010 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7efab0a640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 0x7f7ee00a59a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009fd0 tx=0x7f7eec009500 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7ee8bfe640 1 -- 172.21.15.17:0/37428409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee409c0a0 con 0x55d08a58fcb0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7ee8bfe640 1 -- 172.21.15.17:0/37428409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee409b9a0 con 0x55d08a58fcb0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7ee8bfe640 1 -- 172.21.15.17:0/37428409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4098010 con 0x55d08a58fcb0 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7eff3e3740 1 -- 172.21.15.17:0/37428409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 msgr2=0x55d08a5920a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.433+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7ee409b6a0 tx=0x7f7ee4000bc0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- 172.21.15.17:0/37428409 shutdown_connections 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5920a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/37428409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a584ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- 172.21.15.17:0/37428409 >> 172.21.15.17:0/37428409 conn(0x55d08a581060 msgr2=0x55d08a581440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- 172.21.15.17:0/37428409 shutdown_connections 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- 172.21.15.17:0/37428409 wait complete. 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- start start 2024-09-16T01:06:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 Processor -- start 2024-09-16T01:06:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a58cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a58d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d08a592820 con 0x55d08a58fcb0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d08a472290 con 0x55d08a584af0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d08a5929a0 con 0x55d08a585410 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7eff3e3740 10 client.0 _ll_register_callbacks cb 0x55d08a4a3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.434+0000 7f7efab0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a58d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a58cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efab0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a58d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51560/0 (socket says 172.21.15.17:51560) 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efab0a640 1 -- 172.21.15.17:0/566218159 learned_addr learned my addr 172.21.15.17:0/566218159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 -- 172.21.15.17:0/566218159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 msgr2=0x55d08a58d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 -- 172.21.15.17:0/566218159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 msgr2=0x55d08a58d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a58d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 -- 172.21.15.17:0/566218159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08a1fc210 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7efa309640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a58cc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009230 tx=0x7f7ef00043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe50a5f4483fed2d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0040070 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee409b9a0 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.435+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ef0005460 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ef004c050 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 10 client.25328 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d08a2c8620 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ee409b9a0 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ef00036f0 con 0x55d08a584af0 2024-09-16T01:06:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 10 client.25328 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 20 client.25328 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a5a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 4 client.25328 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d08a4f6a20 con 0x55d08a59fbc0 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.436+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a5a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.437+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a5a1fb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf2df16fc6105cf server_cookie=bc63a358f1669128 in_seq=0 out_seq=0 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.437+0000 7f7eddffb640 10 client.25328 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.437+0000 7f7eddffb640 1 -- 172.21.15.17:0/566218159 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d08a4f6a20 con 0x55d08a59fbc0 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.437+0000 7f7eddffb640 10 client.25328 handle_command_reply: tid=0 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 client.25328 shutdown 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 msgr2=0x55d08a58cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a58cc10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009230 tx=0x7f7ef00043b0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 shutdown_connections 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a5a1fb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a58d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eddffb640 0 client.25328 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/566218159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a58cc10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 >> 172.21.15.17:0/566218159 conn(0x55d08a581060 msgr2=0x55d08a586d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 shutdown_connections 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 1 -- 172.21.15.17:0/566218159 wait complete. 2024-09-16T01:06:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.438+0000 7f7eff3e3740 20 client.25328 trim_cache size 0 max 16384 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 Processor -- start 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 -- start start 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a587560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41af8e0 con 0x55d08a58fcb0 2024-09-16T01:06:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41b1420 con 0x55d08a584af0 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41affb0 con 0x55d08a585410 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51568/0 (socket says 172.21.15.17:51568) 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 -- 172.21.15.17:0/1901379971 learned_addr learned my addr 172.21.15.17:0/1901379971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efa309640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a587560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 -- 172.21.15.17:0/1901379971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 msgr2=0x55d08a58d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 -- 172.21.15.17:0/1901379971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 msgr2=0x55d08a587560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a587560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 -- 172.21.15.17:0/1901379971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08a58f760 con 0x55d08a58fcb0 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.453+0000 7f7efab0a640 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0039c0 tx=0x7f7eec012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797e9a64679bd36b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7edffff640 1 -- 172.21.15.17:0/1901379971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec019040 con 0x55d08a58fcb0 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7edffff640 1 -- 172.21.15.17:0/1901379971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7eec00fe70 con 0x55d08a58fcb0 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7edffff640 1 -- 172.21.15.17:0/1901379971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec022c80 con 0x55d08a58fcb0 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 -- 172.21.15.17:0/1901379971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 msgr2=0x55d08a5a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0039c0 tx=0x7f7eec012070 comp rx=0 tx=0).stop 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 -- 172.21.15.17:0/1901379971 shutdown_connections 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a58fcb0 0x55d08a5a78c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a585410 0x55d08a58d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/1901379971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a587560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 -- 172.21.15.17:0/1901379971 >> 172.21.15.17:0/1901379971 conn(0x55d08a581060 msgr2=0x55d08a58ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 -- 172.21.15.17:0/1901379971 shutdown_connections 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.454+0000 7f7eff3e3740 1 -- 172.21.15.17:0/1901379971 wait complete. 2024-09-16T01:06:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 -- start start 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 Processor -- start 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a598190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a58fcb0 0x55d08a5939f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41b0d50 con 0x55d08a585410 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41b0680 con 0x55d08a584af0 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41ad8c0 con 0x55d08a58fcb0 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7eff3e3740 10 client.0 _ll_register_callbacks cb 0x7f7ef0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51574/0 (socket says 172.21.15.17:51574) 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 -- 172.21.15.17:0/673022833 learned_addr learned my addr 172.21.15.17:0/673022833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7efa309640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a598190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7efab0a640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a58fcb0 0x55d08a5939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 -- 172.21.15.17:0/673022833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a58fcb0 msgr2=0x55d08a5939f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a58fcb0 0x55d08a5939f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 -- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 msgr2=0x55d08a598190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a598190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.455+0000 7f7ef9b08640 1 -- 172.21.15.17:0/673022833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08a594030 con 0x55d08a585410 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7ef9b08640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40cd410 tx=0x7f7ee40cf990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41156b7ec6705ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee409fd50 con 0x55d08a585410 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ee40cd090 con 0x55d08a585410 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eec00fe70 con 0x55d08a585410 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ee40a4610 con 0x55d08a585410 2024-09-16T01:06:09.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 10 client.15645 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d08a60a620 con 0x55d08a585410 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7eec00fe70 con 0x55d08a585410 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ee40976f0 con 0x55d08a585410 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 10 client.15645 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 10 client.15645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 20 client.15645 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a60c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 4 client.15645 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.456+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d08a4f0d70 con 0x55d08a59fbc0 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.457+0000 7f7efa309640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a60c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.457+0000 7f7eddffb640 10 client.15645 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.457+0000 7f7efa309640 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a60c9c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b6ae5ee00ac887 server_cookie=980c05301a237761 in_seq=0 out_seq=0 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eddffb640 1 -- 172.21.15.17:0/673022833 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d08a4f0d70 con 0x55d08a59fbc0 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eddffb640 10 client.15645 handle_command_reply: tid=0 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 client.15645 shutdown 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 msgr2=0x55d08a5934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40cd410 tx=0x7f7ee40cf990 comp rx=0 tx=0).stop 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 shutdown_connections 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d08a59fbc0 0x55d08a60c9c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d08a58fcb0 0x55d08a5939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eddffb640 0 client.15645 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d08a585410 0x55d08a5934b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 --2- 172.21.15.17:0/673022833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d08a584af0 0x55d08a598190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 >> 172.21.15.17:0/673022833 conn(0x55d08a581060 msgr2=0x55d08a57f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 shutdown_connections 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 1 -- 172.21.15.17:0/673022833 wait complete. 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.473+0000 7f7eff3e3740 20 client.15645 trim_cache size 0 max 16384 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:06:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:06:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 msgr2=0x7f7ee00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 0x7f7ee00a59a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009fd0 tx=0x7f7eec009500 comp rx=0 tx=0).stop 2024-09-16T01:06:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 msgr2=0x7f7ef40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400d950 tx=0x7f7ee400de10 comp rx=0 tx=0).stop 2024-09-16T01:06:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 shutdown_connections 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f7ee00a34e0 0x7f7ee00a59a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ef41069c0 0x7f7ef40fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef4101350 0x7f7ef40fd320 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 --2- 172.21.15.17:0/305428817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef41009b0 0x7f7ef40fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 >> 172.21.15.17:0/305428817 conn(0x7f7ef4077990 msgr2=0x7f7ef4069980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 shutdown_connections 2024-09-16T01:06:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:09.474+0000 7f7efc56d640 1 -- 172.21.15.17:0/305428817 wait complete. 2024-09-16T01:06:09.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:09 smithi088 ceph-mon[34093]: pgmap v116: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-16T01:06:09.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:09 smithi154 ceph-mon[34759]: pgmap v116: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-16T01:06:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:09 smithi017 ceph-mon[31211]: pgmap v116: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-16T01:06:11.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:11 smithi088 ceph-mon[34093]: pgmap v117: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:11.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:11 smithi154 ceph-mon[34759]: pgmap v117: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:11.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:11 smithi017 ceph-mon[31211]: pgmap v117: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:13 smithi088 ceph-mon[34093]: pgmap v118: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:13.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:13 smithi154 ceph-mon[34759]: pgmap v118: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:13 smithi017 ceph-mon[31211]: pgmap v118: 97 pgs: 97 active+clean; 4.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-16T01:06:15.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:15 smithi088 ceph-mon[34093]: pgmap v119: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 65 KiB/s wr, 38 op/s 2024-09-16T01:06:15.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:15 smithi154 ceph-mon[34759]: pgmap v119: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 65 KiB/s wr, 38 op/s 2024-09-16T01:06:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:15 smithi017 ceph-mon[31211]: pgmap v119: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 65 KiB/s wr, 38 op/s 2024-09-16T01:06:17.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:17 smithi088 ceph-mon[34093]: pgmap v120: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-16T01:06:17.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:17 smithi154 ceph-mon[34759]: pgmap v120: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-16T01:06:17.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:17 smithi017 ceph-mon[31211]: pgmap v120: 97 pgs: 97 active+clean; 4.9 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-16T01:06:19.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:19 smithi088 ceph-mon[34093]: pgmap v121: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:19 smithi154 ceph-mon[34759]: pgmap v121: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:19 smithi017 ceph-mon[31211]: pgmap v121: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:21.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:21 smithi088 ceph-mon[34093]: pgmap v122: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:21.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:21 smithi154 ceph-mon[34759]: pgmap v122: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:21.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:21 smithi017 ceph-mon[31211]: pgmap v122: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.574+0000 7ffb6e665640 1 -- 172.21.15.17:0/403476150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 msgr2=0x7ffb6810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.574+0000 7ffb6e665640 1 --2- 172.21.15.17:0/403476150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb6810d8c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009c10 tx=0x7ffb6002a6e0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 -- 172.21.15.17:0/403476150 shutdown_connections 2024-09-16T01:06:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 --2- 172.21.15.17:0/403476150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb6810d8c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 --2- 172.21.15.17:0/403476150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 0x7ffb68100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 --2- 172.21.15.17:0/403476150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 0x7ffb68106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 -- 172.21.15.17:0/403476150 >> 172.21.15.17:0/403476150 conn(0x7ffb680fc6b0 msgr2=0x7ffb680fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 -- 172.21.15.17:0/403476150 shutdown_connections 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 -- 172.21.15.17:0/403476150 wait complete. 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 Processor -- start 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.575+0000 7ffb6e665640 1 -- start start 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 0x7ffb681982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 0x7ffb6819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68111de0 con 0x7ffb68101390 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68111c60 con 0x7ffb681009f0 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68111f60 con 0x7ffb68106a00 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60502/0 (socket says 172.21.15.17:60502) 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1064920752 learned_addr learned my addr 172.21.15.17:0/1064920752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb67fff640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 0x7ffb681982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 0x7ffb6819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1064920752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 msgr2=0x7ffb6819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 0x7ffb6819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1064920752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 msgr2=0x7ffb681982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 0x7ffb681982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1064920752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6819d290 con 0x7ffb68101390 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e9c0 tx=0x7ffb5000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb65ffb640 1 -- 172.21.15.17:0/1064920752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000cde0 con 0x7ffb68101390 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb65ffb640 1 -- 172.21.15.17:0/1064920752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb500035f0 con 0x7ffb68101390 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb65ffb640 1 -- 172.21.15.17:0/1064920752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50010690 con 0x7ffb68101390 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.576+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6819d580 con 0x7ffb68101390 2024-09-16T01:06:22.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.577+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb681a4e10 con 0x7ffb68101390 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb65ffb640 1 -- 172.21.15.17:0/1064920752 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ffb500037a0 con 0x7ffb68101390 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 Processor -- start 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 -- start start 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1e9bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 0x5581a1eaab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5581a1e002f0 con 0x5581a1eab0c0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5581a1da8270 con 0x5581a1e9c2d0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.579+0000 7ffb71404740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5581a1dfc2b0 con 0x5581a1e9b9b0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60504/0 (socket says 172.21.15.17:60504) 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1125710504 learned_addr learned my addr 172.21.15.17:0/1125710504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb65ffb640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 0x7ffb540a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb67fff640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 0x5581a1eaab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1e9bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1125710504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 msgr2=0x5581a1e9bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1e9bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1125710504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 msgr2=0x5581a1eaab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 0x5581a1eaab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 -- 172.21.15.17:0/1125710504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a1da7340 con 0x5581a1eab0c0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1e9bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb67fff640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 0x5581a1eaab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 0x7ffb540a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb65ffb640 1 -- 172.21.15.17:0/1064920752 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ffb500d00e0 con 0x7ffb68101390 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb500cd7d0 tx=0x7ffb50020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b4d1710374c856 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.580+0000 7ffb5e7fc640 1 -- 172.21.15.17:0/1125710504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5009c1c0 con 0x5581a1eab0c0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb5e7fc640 1 -- 172.21.15.17:0/1125710504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb50003b10 con 0x5581a1eab0c0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb5e7fc640 1 -- 172.21.15.17:0/1125710504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5007c3a0 con 0x5581a1eab0c0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 -- 172.21.15.17:0/1125710504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 msgr2=0x5581a1ead4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 0x7ffb540a59a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb600303a0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb500cd7d0 tx=0x7ffb50020000 comp rx=0 tx=0).stop 2024-09-16T01:06:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 -- 172.21.15.17:0/1125710504 shutdown_connections 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1ead4b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9c2d0 0x5581a1eaab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 --2- 172.21.15.17:0/1125710504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1e9bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 -- 172.21.15.17:0/1125710504 >> 172.21.15.17:0/1125710504 conn(0x5581a1e98060 msgr2=0x5581a1e98440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 -- 172.21.15.17:0/1125710504 shutdown_connections 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.581+0000 7ffb71404740 1 -- 172.21.15.17:0/1125710504 wait complete. 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 -- start start 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 Processor -- start 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 0x5581a1ea8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5581a1eadc30 con 0x5581a1e9c2d0 2024-09-16T01:06:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5581a1d89290 con 0x5581a1eab0c0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5581a1eaddb0 con 0x5581a1e9b9b0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb71404740 10 client.0 _ll_register_callbacks cb 0x5581a1dba140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60514/0 (socket says 172.21.15.17:60514) 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.582+0000 7ffb5ffff640 1 -- 172.21.15.17:0/633994365 learned_addr learned my addr 172.21.15.17:0/633994365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb67fff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 0x5581a1ea8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 -- 172.21.15.17:0/633994365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 msgr2=0x5581a1ea8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 -- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 msgr2=0x5581a1ea8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 0x5581a1ea8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 -- 172.21.15.17:0/633994365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a1b13210 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 0x5581a1ea8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb67fff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb500a4b30 tx=0x7ffb5000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f91205383b8380 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb477fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5009bd50 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ffb5009a6f0 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5581a1e0da20 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb500b5050 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb71404740 10 client.15657 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5581a1bdf620 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.583+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5581a1e0da20 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb50098140 con 0x5581a1e9c2d0 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 10 client.15657 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 20 client.15657 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1ebae50 0x5581a1ebd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 4 client.15657 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581a1e07d70 con 0x5581a1ebae50 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.584+0000 7ffb67fff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1ebae50 0x5581a1ebd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.585+0000 7ffb477fe640 10 client.15657 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.585+0000 7ffb67fff640 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1ebae50 0x5581a1ebd240 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e55586270e6279a6 server_cookie=3062b50eff2fb844 in_seq=0 out_seq=0 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.585+0000 7ffb477fe640 1 -- 172.21.15.17:0/633994365 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581a1e07d70 con 0x5581a1ebae50 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.585+0000 7ffb477fe640 10 client.15657 handle_command_reply: tid=0 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.585+0000 7ffb71404740 1 client.15657 shutdown 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 msgr2=0x5581a1ea8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffb500a4b30 tx=0x7ffb5000c840 comp rx=0 tx=0).stop 2024-09-16T01:06:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 shutdown_connections 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1ebae50 0x5581a1ebd240 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1eab0c0 0x5581a1ea8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ea8550 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 --2- 172.21.15.17:0/633994365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb477fe640 0 client.15657 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 >> 172.21.15.17:0/633994365 conn(0x5581a1e98060 msgr2=0x5581a1e9ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 shutdown_connections 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 1 -- 172.21.15.17:0/633994365 wait complete. 2024-09-16T01:06:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.586+0000 7ffb71404740 20 client.15657 trim_cache size 0 max 16384 2024-09-16T01:06:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 Processor -- start 2024-09-16T01:06:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 -- start start 2024-09-16T01:06:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1eab0c0 0x5581a1ec2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681ab530 con 0x5581a1e9c2d0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681ad070 con 0x5581a1e9b9b0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb71404740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681abc00 con 0x5581a1eab0c0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60518/0 (socket says 172.21.15.17:60518) 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 -- 172.21.15.17:0/2532589851 learned_addr learned my addr 172.21.15.17:0/2532589851 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb67fff640 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1eab0c0 0x5581a1ec2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 -- 172.21.15.17:0/2532589851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1eab0c0 msgr2=0x5581a1ec2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1eab0c0 0x5581a1ec2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 -- 172.21.15.17:0/2532589851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 msgr2=0x5581a1ea9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.601+0000 7ffb5ffff640 1 -- 172.21.15.17:0/2532589851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a1e97e90 con 0x5581a1e9c2d0 2024-09-16T01:06:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffb500cde60 tx=0x7ffb50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f368a612ecfe5a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb5dffb640 1 -- 172.21.15.17:0/2532589851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500b9070 con 0x5581a1e9c2d0 2024-09-16T01:06:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb5dffb640 1 -- 172.21.15.17:0/2532589851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb5009caf0 con 0x5581a1e9c2d0 2024-09-16T01:06:22.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb5dffb640 1 -- 172.21.15.17:0/2532589851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5009bf30 con 0x5581a1e9c2d0 2024-09-16T01:06:22.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 -- 172.21.15.17:0/2532589851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 msgr2=0x5581a1ec2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffb500cde60 tx=0x7ffb50000bc0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 -- 172.21.15.17:0/2532589851 shutdown_connections 2024-09-16T01:06:22.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1eab0c0 0x5581a1ec2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1e9c2d0 0x5581a1ec2810 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 --2- 172.21.15.17:0/2532589851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1ea9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 -- 172.21.15.17:0/2532589851 >> 172.21.15.17:0/2532589851 conn(0x5581a1e98060 msgr2=0x5581a1ea9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 -- 172.21.15.17:0/2532589851 shutdown_connections 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.602+0000 7ffb71404740 1 -- 172.21.15.17:0/2532589851 wait complete. 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 -- start start 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 Processor -- start 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1eb3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9c2d0 0x5581a1eb38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681ac9a0 con 0x5581a1eab0c0 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681ac2d0 con 0x5581a1e9b9b0 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681a9510 con 0x5581a1e9c2d0 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb71404740 10 client.0 _ll_register_callbacks cb 0x7ffb500d3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb6cc02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb6cc02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60520/0 (socket says 172.21.15.17:60520) 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.603+0000 7ffb6cc02640 1 -- 172.21.15.17:0/2187526409 learned_addr learned my addr 172.21.15.17:0/2187526409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb5ffff640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9c2d0 0x5581a1eb38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb67fff640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1eb3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 -- 172.21.15.17:0/2187526409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9c2d0 msgr2=0x5581a1eb38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9c2d0 0x5581a1eb38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 -- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 msgr2=0x5581a1eb3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1eb3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 -- 172.21.15.17:0/2187526409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a1eaefb0 con 0x5581a1eab0c0 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb67fff640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1eb3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb6cc02640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009c10 tx=0x7ffb6002a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f1ff944fbf40b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb477fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60041040 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ffb60004040 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb5009caf0 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb60036040 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb71404740 10 client.15663 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.604+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5581a1f25390 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb5009caf0 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb60047040 con 0x5581a1eab0c0 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 10 client.15663 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 20 client.15663 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1f25b10 0x5581a1f27f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:22.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 4 client.15663 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:06:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581a1d84900 con 0x5581a1f25b10 2024-09-16T01:06:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb67fff640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1f25b10 0x5581a1f27f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb67fff640 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1f25b10 0x5581a1f27f30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7454b518f929e3cc server_cookie=2851b0d075187a6d in_seq=0 out_seq=0 2024-09-16T01:06:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.605+0000 7ffb477fe640 10 client.15663 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb477fe640 1 -- 172.21.15.17:0/2187526409 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581a1d84900 con 0x5581a1f25b10 2024-09-16T01:06:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb477fe640 10 client.15663 handle_command_reply: tid=0 2024-09-16T01:06:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 client.15663 shutdown 2024-09-16T01:06:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 msgr2=0x5581a1eae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009c10 tx=0x7ffb6002a6e0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 shutdown_connections 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5581a1f25b10 0x5581a1f27f30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581a1eab0c0 0x5581a1eae780 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb477fe640 0 client.15663 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581a1e9c2d0 0x5581a1eb38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 --2- 172.21.15.17:0/2187526409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5581a1e9b9b0 0x5581a1eb3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.621+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 >> 172.21.15.17:0/2187526409 conn(0x5581a1e98060 msgr2=0x5581a1eaa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 shutdown_connections 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb71404740 1 -- 172.21.15.17:0/2187526409 wait complete. 2024-09-16T01:06:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb71404740 20 client.15663 trim_cache size 0 max 16384 2024-09-16T01:06:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:06:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:06:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:06:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 msgr2=0x7ffb540a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 0x7ffb540a59a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb600303a0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 msgr2=0x7ffb681987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e9c0 tx=0x7ffb5000ee80 comp rx=0 tx=0).stop 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 shutdown_connections 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffb540a34e0 0x7ffb540a59a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb68106a00 0x7ffb6819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb68101390 0x7ffb681987e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 --2- 172.21.15.17:0/1064920752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb681009f0 0x7ffb681982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 >> 172.21.15.17:0/1064920752 conn(0x7ffb680fc6b0 msgr2=0x7ffb680fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 shutdown_connections 2024-09-16T01:06:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:22.622+0000 7ffb6e665640 1 -- 172.21.15.17:0/1064920752 wait complete. 2024-09-16T01:06:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:23 smithi088 ceph-mon[34093]: pgmap v123: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:23.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:23 smithi154 ceph-mon[34759]: pgmap v123: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:23 smithi017 ceph-mon[31211]: pgmap v123: 97 pgs: 97 active+clean; 5.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:25.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:25 smithi088 ceph-mon[34093]: pgmap v124: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-16T01:06:25.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:25 smithi154 ceph-mon[34759]: pgmap v124: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-16T01:06:25.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:25 smithi017 ceph-mon[31211]: pgmap v124: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-16T01:06:27.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:27 smithi088 ceph-mon[34093]: pgmap v125: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:27.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:27 smithi154 ceph-mon[34759]: pgmap v125: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:27.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:27 smithi017 ceph-mon[31211]: pgmap v125: 97 pgs: 97 active+clean; 5.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:29.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:29 smithi088 ceph-mon[34093]: pgmap v126: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-16T01:06:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:29 smithi154 ceph-mon[34759]: pgmap v126: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-16T01:06:29.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:29 smithi017 ceph-mon[31211]: pgmap v126: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-16T01:06:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:06:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:06:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:06:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:06:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:06:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:06:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:06:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:06:30.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:06:31.040 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:06:31.040 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:06:31.040 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:06:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:31 smithi088 ceph-mon[34093]: pgmap v127: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:31.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:31 smithi154 ceph-mon[34759]: pgmap v127: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:31.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:31 smithi017 ceph-mon[31211]: pgmap v127: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:33 smithi088 ceph-mon[34093]: pgmap v128: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:33.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:33 smithi154 ceph-mon[34759]: pgmap v128: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:33.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:33 smithi017 ceph-mon[31211]: pgmap v128: 97 pgs: 97 active+clean; 5.3 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:127/600: open fd = 3 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.063 INFO:tasks.workunit.client.0.smithi017.stdout:128/600: open fd = 3 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:129/600: open fd = 3 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:130/600: open fd = 3 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:131/600: open fd = 3 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.064 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:132/600: open fd = 3 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:133/600: open fd = 3 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:134/600: open fd = 3 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.065 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:135/600: open fd = 3 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:136/600: open fd = 3 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:137/600: open fd = 3 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.066 INFO:tasks.workunit.client.0.smithi017.stdout:138/600: open fd = 3 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:139/600: open fd = 3 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:140/600: open fd = 3 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.067 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:141/600: open fd = 3 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:142/600: open fd = 3 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:143/600: open fd = 3 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.068 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:144/600: open fd = 3 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:145/600: open fd = 3 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:146/600: open fd = 3 2024-09-16T01:06:35.069 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:147/600: open fd = 3 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:148/600: open fd = 3 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:149/600: open fd = 3 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.070 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:150/600: open fd = 3 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:151/600: open fd = 3 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:152/600: open fd = 3 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.071 INFO:tasks.workunit.client.0.smithi017.stdout:153/600: open fd = 3 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:154/600: open fd = 3 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:155/600: open fd = 3 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:156/600: open fd = 3 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.072 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:157/600: open fd = 3 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:158/600: open fd = 3 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:159/600: open fd = 3 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.073 INFO:tasks.workunit.client.0.smithi017.stdout:160/600: open fd = 3 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:161/600: open fd = 3 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:162/600: open fd = 3 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:163/600: open fd = 3 2024-09-16T01:06:35.074 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:164/600: open fd = 3 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:165/600: open fd = 3 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:166/600: open fd = 3 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.075 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:167/600: open fd = 3 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:168/600: open fd = 3 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:169/600: open fd = 3 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:170/600: open fd = 3 2024-09-16T01:06:35.076 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:171/600: open fd = 3 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:172/600: open fd = 3 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.077 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:173/600: open fd = 3 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:174/600: open fd = 3 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:175/600: open fd = 3 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.078 INFO:tasks.workunit.client.0.smithi017.stdout:176/600: open fd = 3 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:177/600: open fd = 3 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:178/600: open fd = 3 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:179/600: open fd = 3 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.079 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:180/600: open fd = 3 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:181/600: open fd = 3 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.080 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:182/600: open fd = 3 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:183/600: open fd = 3 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:184/600: open fd = 3 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.081 INFO:tasks.workunit.client.0.smithi017.stdout:185/600: open fd = 3 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:186/600: open fd = 3 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:187/600: open fd = 3 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:188/600: open fd = 3 2024-09-16T01:06:35.082 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.083 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:06:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 -- 172.21.15.17:0/389678989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90106a00 msgr2=0x7fee90106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 --2- 172.21.15.17:0/389678989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90106a00 0x7fee90106de0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee80009930 tx=0x7fee8002a420 comp rx=0 tx=0).stop 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 -- 172.21.15.17:0/389678989 shutdown_connections 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 --2- 172.21.15.17:0/389678989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90101390 0x7fee9010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 --2- 172.21.15.17:0/389678989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 0x7fee90100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 --2- 172.21.15.17:0/389678989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90106a00 0x7fee90106de0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.722+0000 7fee94874640 1 -- 172.21.15.17:0/389678989 >> 172.21.15.17:0/389678989 conn(0x7fee900fc6b0 msgr2=0x7fee900fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.723+0000 7fee94874640 1 -- 172.21.15.17:0/389678989 shutdown_connections 2024-09-16T01:06:35.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.723+0000 7fee94874640 1 -- 172.21.15.17:0/389678989 wait complete. 2024-09-16T01:06:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.723+0000 7fee94874640 1 Processor -- start 2024-09-16T01:06:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.723+0000 7fee94874640 1 -- start start 2024-09-16T01:06:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 0x7fee90199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90106a00 0x7fee901a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee90110cb0 con 0x7fee90101390 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee90110b30 con 0x7fee90106a00 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee94874640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee90110e30 con 0x7fee901009f0 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60826/0 (socket says 172.21.15.17:60826) 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 -- 172.21.15.17:0/3274416853 learned_addr learned my addr 172.21.15.17:0/3274416853 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90106a00 0x7fee901a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 0x7fee90199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 -- 172.21.15.17:0/3274416853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 msgr2=0x7fee90199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 0x7fee90199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 -- 172.21.15.17:0/3274416853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90106a00 msgr2=0x7fee901a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90106a00 0x7fee901a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 -- 172.21.15.17:0/3274416853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee901a46e0 con 0x7fee90101390 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.724+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee8400d950 tx=0x7fee8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.725+0000 7fee7f7fe640 1 -- 172.21.15.17:0/3274416853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84017070 con 0x7fee90101390 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.725+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee901a48b0 con 0x7fee90101390 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.725+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee901a4e20 con 0x7fee90101390 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.725+0000 7fee7f7fe640 1 -- 172.21.15.17:0/3274416853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee84009c30 con 0x7fee90101390 2024-09-16T01:06:35.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.725+0000 7fee7f7fe640 1 -- 172.21.15.17:0/3274416853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84020060 con 0x7fee90101390 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.727+0000 7fee97615740 1 Processor -- start 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 -- start start 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee7f7fe640 1 -- 172.21.15.17:0/3274416853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fee8400f620 con 0x7fee90101390 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 0x56118a9a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56118a8fa2f0 con 0x56118a995af0 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56118a8a2270 con 0x56118a9a0cb0 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee97615740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56118a8f62b0 con 0x56118a996410 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60828/0 (socket says 172.21.15.17:60828) 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3885217707 learned_addr learned my addr 172.21.15.17:0/3885217707 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 0x56118a9a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3885217707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 msgr2=0x56118a9a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3885217707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 msgr2=0x56118a9a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 0x56118a9a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3885217707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118a8a1340 con 0x56118a995af0 2024-09-16T01:06:35.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 0x56118a9a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee7f7fe640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 0x7fee780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.728+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee88009f50 tx=0x7fee880118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bd005733cf4a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.729+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 0x7fee780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.729+0000 7fee7cff9640 1 -- 172.21.15.17:0/3885217707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88004d20 con 0x56118a995af0 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.729+0000 7fee7cff9640 1 -- 172.21.15.17:0/3885217707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee88004050 con 0x56118a995af0 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.729+0000 7fee7f7fe640 1 -- 172.21.15.17:0/3274416853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fee840cf8e0 con 0x7fee90101390 2024-09-16T01:06:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.729+0000 7fee7cff9640 1 -- 172.21.15.17:0/3885217707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88005280 con 0x56118a995af0 2024-09-16T01:06:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- 172.21.15.17:0/3885217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 msgr2=0x56118a995ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 0x7fee780a5920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee80000c00 tx=0x7fee80005a20 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee88009f50 tx=0x7fee880118d0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- 172.21.15.17:0/3885217707 shutdown_connections 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a9a0cb0 0x56118a9a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 --2- 172.21.15.17:0/3885217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a995af0 0x56118a995ed0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- 172.21.15.17:0/3885217707 >> 172.21.15.17:0/3885217707 conn(0x56118a992060 msgr2=0x56118a992440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- 172.21.15.17:0/3885217707 shutdown_connections 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- 172.21.15.17:0/3885217707 wait complete. 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 -- start start 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.730+0000 7fee97615740 1 Processor -- start 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a99db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a9a0cb0 0x56118a99e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56118a9a3880 con 0x56118a996410 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56118a883290 con 0x56118a995af0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56118a9a3a00 con 0x56118a9a0cb0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 10 client.0 _ll_register_callbacks cb 0x56118a8b4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60838/0 (socket says 172.21.15.17:60838) 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 -- 172.21.15.17:0/2161111477 learned_addr learned my addr 172.21.15.17:0/2161111477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8e59c640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a99db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 -- 172.21.15.17:0/2161111477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a9a0cb0 msgr2=0x56118a99e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a9a0cb0 0x56118a99e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a9a0cb0 0x56118a99e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 -- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 msgr2=0x56118a99db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a99db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 -- 172.21.15.17:0/2161111477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118a60d210 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8e59c640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a99db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee84009610 tx=0x7fee8409ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382884bcf7a4d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee840cd480 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fee840860e0 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.731+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee88004050 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee8409c290 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 10 client.15675 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56118a6d9620 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee88004050 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee840978e0 con 0x56118a996410 2024-09-16T01:06:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 20 client.15675 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118a9b0c10 0x56118a9b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 4 client.15675 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56118a907a20 con 0x56118a9b0c10 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.732+0000 7fee8e59c640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118a9b0c10 0x56118a9b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.733+0000 7fee75ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.733+0000 7fee8e59c640 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118a9b0c10 0x56118a9b30b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c624eadc2ba556 server_cookie=a445436aed87b1f9 in_seq=0 out_seq=0 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.733+0000 7fee75ffb640 1 -- 172.21.15.17:0/2161111477 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56118a907a20 con 0x56118a9b0c10 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.733+0000 7fee75ffb640 10 client.15675 handle_command_reply: tid=0 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.733+0000 7fee97615740 1 client.15675 shutdown 2024-09-16T01:06:35.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 msgr2=0x56118a99e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee84009610 tx=0x7fee8409ba60 comp rx=0 tx=0).stop 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 shutdown_connections 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118a9b0c10 0x56118a9b30b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a9a0cb0 0x56118a99e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a996410 0x56118a99e060 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 --2- 172.21.15.17:0/2161111477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a99db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee75ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 >> 172.21.15.17:0/2161111477 conn(0x56118a992060 msgr2=0x56118a997d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 shutdown_connections 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 1 -- 172.21.15.17:0/2161111477 wait complete. 2024-09-16T01:06:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.734+0000 7fee97615740 20 client.15675 trim_cache size 0 max 16384 2024-09-16T01:06:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.748+0000 7fee97615740 1 Processor -- start 2024-09-16T01:06:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.748+0000 7fee97615740 1 -- start start 2024-09-16T01:06:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a995af0 0x56118a998560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a996410 0x56118a99e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000e6d0 con 0x56118a9a0cb0 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee70010210 con 0x56118a996410 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee97615740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000eda0 con 0x56118a995af0 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60854/0 (socket says 172.21.15.17:60854) 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 -- 172.21.15.17:0/2790643472 learned_addr learned my addr 172.21.15.17:0/2790643472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a996410 0x56118a99e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 -- 172.21.15.17:0/2790643472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a995af0 msgr2=0x56118a998560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a995af0 0x56118a998560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 -- 172.21.15.17:0/2790643472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a996410 msgr2=0x56118a99e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a996410 0x56118a99e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 -- 172.21.15.17:0/2790643472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118a991e90 con 0x56118a9a0cb0 2024-09-16T01:06:35.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fee88009cc0 tx=0x7fee88009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b6ad983fa4a997 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee77fff640 1 -- 172.21.15.17:0/2790643472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88027020 con 0x56118a9a0cb0 2024-09-16T01:06:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee77fff640 1 -- 172.21.15.17:0/2790643472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee88003d30 con 0x56118a9a0cb0 2024-09-16T01:06:35.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.749+0000 7fee77fff640 1 -- 172.21.15.17:0/2790643472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88023730 con 0x56118a9a0cb0 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- 172.21.15.17:0/2790643472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 msgr2=0x56118a9a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fee88009cc0 tx=0x7fee88009cf0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- 172.21.15.17:0/2790643472 shutdown_connections 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9a90a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a996410 0x56118a99e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 --2- 172.21.15.17:0/2790643472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a995af0 0x56118a998560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- 172.21.15.17:0/2790643472 >> 172.21.15.17:0/2790643472 conn(0x56118a992060 msgr2=0x56118a99fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- 172.21.15.17:0/2790643472 shutdown_connections 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- 172.21.15.17:0/2790643472 wait complete. 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 -- start start 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.750+0000 7fee97615740 1 Processor -- start 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a9b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000fb40 con 0x56118a9a0cb0 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000f470 con 0x56118a995af0 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee7000c6b0 con 0x56118a996410 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee97615740 10 client.0 _ll_register_callbacks cb 0x7fee84010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:35.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60862/0 (socket says 172.21.15.17:60862) 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3227214669 learned_addr learned my addr 172.21.15.17:0/3227214669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a9b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3227214669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 msgr2=0x56118a9b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 msgr2=0x56118a9b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a9b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 -- 172.21.15.17:0/3227214669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118aa1ea40 con 0x56118a9a0cb0 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8dd9b640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a9b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee8ed9d640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fee88005f40 tx=0x7fee880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c402a46b82e9e31f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.751+0000 7fee75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88035060 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fee880236e0 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee88003d30 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee88009480 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 10 client.15681 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56118aa1fd30 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee88003d30 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee8803ab10 con 0x56118a9a0cb0 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 10 client.15681 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 20 client.15681 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118aa20200 0x56118aa225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 4 client.15681 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:06:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56118a901d70 con 0x56118aa20200 2024-09-16T01:06:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.752+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118aa20200 0x56118aa225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.753+0000 7fee8e59c640 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118aa20200 0x56118aa225f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96c2efa755395f server_cookie=e82192114776ac28 in_seq=0 out_seq=0 2024-09-16T01:06:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.753+0000 7fee75ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee75ffb640 1 -- 172.21.15.17:0/3227214669 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56118a901d70 con 0x56118aa20200 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee75ffb640 10 client.15681 handle_command_reply: tid=0 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 client.15681 shutdown 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 msgr2=0x56118a9b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fee88005f40 tx=0x7fee880058a0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 shutdown_connections 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56118aa20200 0x56118aa225f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56118a9a0cb0 0x56118a9b9200 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56118a996410 0x56118a9b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 --2- 172.21.15.17:0/3227214669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56118a995af0 0x56118a9b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee75ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 >> 172.21.15.17:0/3227214669 conn(0x56118a992060 msgr2=0x56118a9909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 shutdown_connections 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 1 -- 172.21.15.17:0/3227214669 wait complete. 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.769+0000 7fee97615740 20 client.15681 trim_cache size 0 max 16384 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:06:35.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:06:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:06:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 msgr2=0x7fee780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 0x7fee780a5920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee80000c00 tx=0x7fee80005a20 comp rx=0 tx=0).stop 2024-09-16T01:06:35.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 msgr2=0x7fee90199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee8400d950 tx=0x7fee8400de10 comp rx=0 tx=0).stop 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 shutdown_connections 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fee780a3460 0x7fee780a5920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee90106a00 0x7fee901a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee90101390 0x7fee90199660 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 --2- 172.21.15.17:0/3274416853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee901009f0 0x7fee90199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 >> 172.21.15.17:0/3274416853 conn(0x7fee900fc6b0 msgr2=0x7fee900fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 shutdown_connections 2024-09-16T01:06:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:35.770+0000 7fee94874640 1 -- 172.21.15.17:0/3274416853 wait complete. 2024-09-16T01:06:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:35 smithi088 ceph-mon[34093]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-09-16T01:06:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:35 smithi154 ceph-mon[34759]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-09-16T01:06:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:35 smithi017 ceph-mon[31211]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 23 op/s 2024-09-16T01:06:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:37 smithi088 ceph-mon[34093]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-16T01:06:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:37 smithi154 ceph-mon[34759]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-16T01:06:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:37 smithi017 ceph-mon[31211]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-16T01:06:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:39 smithi088 ceph-mon[34093]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:39 smithi154 ceph-mon[34759]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:39 smithi017 ceph-mon[31211]: pgmap v131: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:41 smithi088 ceph-mon[34093]: pgmap v132: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:41.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:41 smithi154 ceph-mon[34759]: pgmap v132: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:41 smithi017 ceph-mon[31211]: pgmap v132: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:43.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:43 smithi088 ceph-mon[34093]: pgmap v133: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:43.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:43 smithi154 ceph-mon[34759]: pgmap v133: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:43 smithi017 ceph-mon[31211]: pgmap v133: 97 pgs: 97 active+clean; 1.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-16T01:06:45.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:45 smithi088 ceph-mon[34093]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:45 smithi154 ceph-mon[34759]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:45 smithi017 ceph-mon[31211]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 23 op/s 2024-09-16T01:06:47.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:47 smithi088 ceph-mon[34093]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:47 smithi154 ceph-mon[34759]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:47 smithi017 ceph-mon[31211]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 -- 172.21.15.17:0/3126930233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c10e310 msgr2=0x7f901c110760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 --2- 172.21.15.17:0/3126930233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c10e310 0x7f901c110760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9014009ca0 tx=0x7f901402a950 comp rx=0 tx=0).stop 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 -- 172.21.15.17:0/3126930233 shutdown_connections 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 --2- 172.21.15.17:0/3126930233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c10e310 0x7f901c110760 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 --2- 172.21.15.17:0/3126930233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 0x7f901c10ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 --2- 172.21.15.17:0/3126930233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c074620 0x7f901c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 -- 172.21.15.17:0/3126930233 >> 172.21.15.17:0/3126930233 conn(0x7f901c0fd7d0 msgr2=0x7f901c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 -- 172.21.15.17:0/3126930233 shutdown_connections 2024-09-16T01:06:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.870+0000 7f902218d640 1 -- 172.21.15.17:0/3126930233 wait complete. 2024-09-16T01:06:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 Processor -- start 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 -- start start 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 0x7f901c101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c10e310 0x7f901c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f901c113f30 con 0x7f901c074620 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f901c113db0 con 0x7f901c074f40 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f902218d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1140b0 con 0x7f901c10e310 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35866/0 (socket says 172.21.15.17:35866) 2024-09-16T01:06:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901b7fe640 1 -- 172.21.15.17:0/1330145345 learned_addr learned my addr 172.21.15.17:0/1330145345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901affd640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 0x7f901c101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901bfff640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c10e310 0x7f901c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.871+0000 7f901b7fe640 1 -- 172.21.15.17:0/1330145345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c10e310 msgr2=0x7f901c1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f901b7fe640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c10e310 0x7f901c1024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f901b7fe640 1 -- 172.21.15.17:0/1330145345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 msgr2=0x7f901c101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f901b7fe640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 0x7f901c101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f901b7fe640 1 -- 172.21.15.17:0/1330145345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1aaab0 con 0x7f901c074620 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f901b7fe640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c8c0 tx=0x7f900c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f9018ff9640 1 -- 172.21.15.17:0/1330145345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c004220 con 0x7f901c074620 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1aada0 con 0x7f901c074620 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f9018ff9640 1 -- 172.21.15.17:0/1330145345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f900c0043c0 con 0x7f901c074620 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f9018ff9640 1 -- 172.21.15.17:0/1330145345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c004a00 con 0x7f901c074620 2024-09-16T01:06:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.872+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1ab260 con 0x7f901c074620 2024-09-16T01:06:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.875+0000 7f9025002740 1 Processor -- start 2024-09-16T01:06:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.875+0000 7f9025002740 1 -- start start 2024-09-16T01:06:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.875+0000 7f9018ff9640 1 -- 172.21.15.17:0/1330145345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f900c0050b0 con 0x7f901c074620 2024-09-16T01:06:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 0x559401112770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x5594011150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55940106c2f0 con 0x559401107af0 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x559401014270 con 0x559401112cb0 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9025002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594010682b0 con 0x559401108410 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35876/0 (socket says 172.21.15.17:35876) 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 -- 172.21.15.17:0/2458809860 learned_addr learned my addr 172.21.15.17:0/2458809860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901b7fe640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 0x559401112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 -- 172.21.15.17:0/2458809860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 msgr2=0x559401112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901affd640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x5594011150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 0x559401112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 -- 172.21.15.17:0/2458809860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 msgr2=0x5594011150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x5594011150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 -- 172.21.15.17:0/2458809860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559401013340 con 0x559401107af0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901b7fe640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 0x559401112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901affd640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x5594011150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9018ff9640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 0x7f90040a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901bfff640 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9014009420 tx=0x7f9014009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acfa2017fecfcae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f901b7fe640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 0x7f90040a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.876+0000 7f9018ff9640 1 -- 172.21.15.17:0/1330145345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f900c0cf9d0 con 0x7f901c074620 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9001ffb640 1 -- 172.21.15.17:0/2458809860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014034050 con 0x559401107af0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9001ffb640 1 -- 172.21.15.17:0/2458809860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9014003e20 con 0x559401107af0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9001ffb640 1 -- 172.21.15.17:0/2458809860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90140042a0 con 0x559401107af0 2024-09-16T01:06:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 -- 172.21.15.17:0/2458809860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 msgr2=0x559401107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f901b7fe640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 0x7f90040a5920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f900c0cd200 tx=0x7f900c004570 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9014009420 tx=0x7f9014009a20 comp rx=0 tx=0).stop 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 -- 172.21.15.17:0/2458809860 shutdown_connections 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x5594011150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401108410 0x559401112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 --2- 172.21.15.17:0/2458809860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x559401107ed0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.877+0000 7f9025002740 1 -- 172.21.15.17:0/2458809860 >> 172.21.15.17:0/2458809860 conn(0x559401104060 msgr2=0x559401104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- 172.21.15.17:0/2458809860 shutdown_connections 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- 172.21.15.17:0/2458809860 wait complete. 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- start start 2024-09-16T01:06:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 Processor -- start 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401107af0 0x55940110fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x559401110580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559401115880 con 0x559401108410 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x559400ff5290 con 0x559401112cb0 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559401115a00 con 0x559401107af0 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.878+0000 7f9025002740 10 client.0 _ll_register_callbacks cb 0x559401026140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35878/0 (socket says 172.21.15.17:35878) 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 -- 172.21.15.17:0/2608781564 learned_addr learned my addr 172.21.15.17:0/2608781564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901bfff640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401107af0 0x55940110fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901bfff640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x559401110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 -- 172.21.15.17:0/2608781564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401107af0 msgr2=0x55940110fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401107af0 0x55940110fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 -- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 msgr2=0x559401110580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x559401110580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 -- 172.21.15.17:0/2608781564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559400d7f210 con 0x559401108410 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f901affd640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f901000b970 tx=0x7f901000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ba409f96eab1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f8ffaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901001b470 con 0x559401108410 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f901001b610 con 0x559401108410 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9014003e20 con 0x559401108410 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f901001b810 con 0x559401108410 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f9025002740 10 client.15693 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.879+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559400e4b620 con 0x559401108410 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9014003e20 con 0x559401108410 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9010012a90 con 0x559401108410 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 10 client.15693 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 20 client.15693 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559401122c50 0x559401125040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 4 client.15693 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559401079a20 con 0x559401122c50 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.880+0000 7f901bfff640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559401122c50 0x559401125040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.881+0000 7f901bfff640 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559401122c50 0x559401125040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab4dda00db124432 server_cookie=2017ba196b173a71 in_seq=0 out_seq=0 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.881+0000 7f8ffaffd640 10 client.15693 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.881+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2608781564 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559401079a20 con 0x559401122c50 2024-09-16T01:06:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.881+0000 7f8ffaffd640 10 client.15693 handle_command_reply: tid=0 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 client.15693 shutdown 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 msgr2=0x559401110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f901000b970 tx=0x7f901000be30 comp rx=0 tx=0).stop 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 shutdown_connections 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559401122c50 0x559401125040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401112cb0 0x559401110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401108410 0x559401110040 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f8ffaffd640 0 client.15693 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 --2- 172.21.15.17:0/2608781564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401107af0 0x55940110fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 >> 172.21.15.17:0/2608781564 conn(0x559401104060 msgr2=0x559401109d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 shutdown_connections 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 1 -- 172.21.15.17:0/2608781564 wait complete. 2024-09-16T01:06:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.882+0000 7f9025002740 20 client.15693 trim_cache size 0 max 16384 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 Processor -- start 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 -- start start 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x55940112a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x55940112ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b3bd0 con 0x559401107af0 2024-09-16T01:06:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b5710 con 0x559401108410 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f9025002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b42a0 con 0x559401112cb0 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35886/0 (socket says 172.21.15.17:35886) 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 -- 172.21.15.17:0/870454169 learned_addr learned my addr 172.21.15.17:0/870454169 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901affd640 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x55940112a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 -- 172.21.15.17:0/870454169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 msgr2=0x55940112ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x55940112ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 -- 172.21.15.17:0/870454169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 msgr2=0x55940112a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x55940112a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 -- 172.21.15.17:0/870454169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559401103e90 con 0x559401107af0 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901affd640 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x55940112a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.897+0000 7f901bfff640 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9014043000 tx=0x7f9014009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1aca0889227924 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f90017fa640 1 -- 172.21.15.17:0/870454169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014034040 con 0x559401107af0 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f90017fa640 1 -- 172.21.15.17:0/870454169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9014003970 con 0x559401107af0 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f90017fa640 1 -- 172.21.15.17:0/870454169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014004330 con 0x559401107af0 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 -- 172.21.15.17:0/870454169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 msgr2=0x5594011103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9014043000 tx=0x7f9014009a20 comp rx=0 tx=0).stop 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 -- 172.21.15.17:0/870454169 shutdown_connections 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x55940112ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x55940112a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 --2- 172.21.15.17:0/870454169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x5594011103b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 -- 172.21.15.17:0/870454169 >> 172.21.15.17:0/870454169 conn(0x559401104060 msgr2=0x559401111b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 -- 172.21.15.17:0/870454169 shutdown_connections 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.898+0000 7f9025002740 1 -- 172.21.15.17:0/870454169 wait complete. 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 -- start start 2024-09-16T01:06:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 Processor -- start 2024-09-16T01:06:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x559401116440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x559401116980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b5040 con 0x559401107af0 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b4970 con 0x559401108410 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901c1b1bb0 con 0x559401112cb0 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f9025002740 10 client.0 _ll_register_callbacks cb 0x7f9010004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35894/0 (socket says 172.21.15.17:35894) 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 -- 172.21.15.17:0/2817593602 learned_addr learned my addr 172.21.15.17:0/2817593602 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901affd640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x559401116440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 -- 172.21.15.17:0/2817593602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 msgr2=0x559401116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x559401116980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 -- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 msgr2=0x559401116440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.899+0000 7f901bfff640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x559401116440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f901bfff640 1 -- 172.21.15.17:0/2817593602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559401121730 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f901affd640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x559401116440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f901bfff640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f901402f8f0 tx=0x7f901402f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58f83902bf586b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901405d060 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9014003970 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9014003b20 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9014034040 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 10 client.15699 fetch_fsmap learned FSMap version 28 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55940118d390 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9014003970 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f901404b050 con 0x559401107af0 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 10 client.15699 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:06:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.900+0000 7f9025002740 20 client.15699 populate_metadata read hostname 'smithi017' 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55940118d620 0x55940118fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f9025002740 4 client.15699 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559401073d70 con 0x55940118d620 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f901affd640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55940118d620 0x55940118fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f8ffaffd640 10 client.15699 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.901+0000 7f901affd640 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55940118d620 0x55940118fa10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f5d918132b72d8 server_cookie=5fc10dfb77f86e5 in_seq=0 out_seq=0 2024-09-16T01:06:48.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.916+0000 7f8ffaffd640 1 -- 172.21.15.17:0/2817593602 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559401073d70 con 0x55940118d620 2024-09-16T01:06:48.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.916+0000 7f8ffaffd640 10 client.15699 handle_command_reply: tid=0 2024-09-16T01:06:48.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.916+0000 7f9025002740 1 client.15699 shutdown 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 msgr2=0x55940111b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f901402f8f0 tx=0x7f901402f920 comp rx=0 tx=0).stop 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 shutdown_connections 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55940118d620 0x55940118fa10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559401112cb0 0x559401116980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559401108410 0x559401116440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f8ffaffd640 0 client.15699 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 --2- 172.21.15.17:0/2817593602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559401107af0 0x55940111b120 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 >> 172.21.15.17:0/2817593602 conn(0x559401104060 msgr2=0x5594011029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 shutdown_connections 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 1 -- 172.21.15.17:0/2817593602 wait complete. 2024-09-16T01:06:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f9025002740 20 client.15699 trim_cache size 0 max 16384 2024-09-16T01:06:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:06:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:06:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:06:48.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 msgr2=0x7f90040a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 0x7f90040a5920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f900c0cd200 tx=0x7f900c004570 comp rx=0 tx=0).stop 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 msgr2=0x7f901c101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c8c0 tx=0x7f900c00cd80 comp rx=0 tx=0).stop 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 shutdown_connections 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f90040a3460 0x7f90040a5920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c10e310 0x7f901c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f901c074f40 0x7f901c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 --2- 172.21.15.17:0/1330145345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f901c074620 0x7f901c101a30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:06:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.917+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 >> 172.21.15.17:0/1330145345 conn(0x7f901c0fd7d0 msgr2=0x7f901c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:06:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.918+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 shutdown_connections 2024-09-16T01:06:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:06:48.918+0000 7f902218d640 1 -- 172.21.15.17:0/1330145345 wait complete. 2024-09-16T01:06:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:49 smithi088 ceph-mon[34093]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:49.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:49 smithi154 ceph-mon[34759]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:49.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:49 smithi017 ceph-mon[31211]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 23 op/s 2024-09-16T01:06:51.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:51 smithi088 ceph-mon[34093]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:51 smithi154 ceph-mon[34759]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:51.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:51 smithi017 ceph-mon[31211]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:53 smithi088 ceph-mon[34093]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:53 smithi154 ceph-mon[34759]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:53 smithi017 ceph-mon[31211]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-16T01:06:55.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:55 smithi088 ceph-mon[34093]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:06:55.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:55 smithi154 ceph-mon[34759]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:06:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:55 smithi017 ceph-mon[31211]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:06:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:57 smithi088 ceph-mon[34093]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:57 smithi154 ceph-mon[34759]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:57 smithi017 ceph-mon[31211]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:06:59.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:06:59 smithi088 ceph-mon[34093]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:06:59.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:06:59 smithi154 ceph-mon[34759]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:06:59.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:06:59 smithi017 ceph-mon[31211]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 23 op/s 2024-09-16T01:07:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:01 smithi088 ceph-mon[34093]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:01.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:01 smithi154 ceph-mon[34759]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:01.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:01 smithi017 ceph-mon[31211]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 -- 172.21.15.17:0/3699248903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 msgr2=0x7f58ec106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 --2- 172.21.15.17:0/3699248903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec106de0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009930 tx=0x7f58e802a420 comp rx=0 tx=0).stop 2024-09-16T01:07:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 -- 172.21.15.17:0/3699248903 shutdown_connections 2024-09-16T01:07:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 --2- 172.21.15.17:0/3699248903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec101390 0x7f58ec10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 --2- 172.21.15.17:0/3699248903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec1009f0 0x7f58ec100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 --2- 172.21.15.17:0/3699248903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec106de0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 -- 172.21.15.17:0/3699248903 >> 172.21.15.17:0/3699248903 conn(0x7f58ec0fc6b0 msgr2=0x7f58ec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 -- 172.21.15.17:0/3699248903 shutdown_connections 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 -- 172.21.15.17:0/3699248903 wait complete. 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.018+0000 7f58f3f81640 1 Processor -- start 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 -- start start 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec1009f0 0x7f58ec1025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec101390 0x7f58ec102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec110cf0 con 0x7f58ec106a00 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec110b70 con 0x7f58ec101390 2024-09-16T01:07:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f3f81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec110e70 con 0x7f58ec1009f0 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44316/0 (socket says 172.21.15.17:44316) 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 -- 172.21.15.17:0/1545603204 learned_addr learned my addr 172.21.15.17:0/1545603204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec1009f0 0x7f58ec1025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f151c640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec101390 0x7f58ec102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 -- 172.21.15.17:0/1545603204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec1009f0 msgr2=0x7f58ec1025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec1009f0 0x7f58ec1025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 -- 172.21.15.17:0/1545603204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec101390 msgr2=0x7f58ec102b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec101390 0x7f58ec102b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.019+0000 7f58f251e640 1 -- 172.21.15.17:0/1545603204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec1a6840 con 0x7f58ec106a00 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58f251e640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009fd0 tx=0x7f58e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58e2ffd640 1 -- 172.21.15.17:0/1545603204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4017070 con 0x7f58ec106a00 2024-09-16T01:07:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58e2ffd640 1 -- 172.21.15.17:0/1545603204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58e4003e20 con 0x7f58ec106a00 2024-09-16T01:07:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec1a6b30 con 0x7f58ec106a00 2024-09-16T01:07:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58e2ffd640 1 -- 172.21.15.17:0/1545603204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4010460 con 0x7f58ec106a00 2024-09-16T01:07:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.020+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec1a7030 con 0x7f58ec106a00 2024-09-16T01:07:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.022+0000 7f58e2ffd640 1 -- 172.21.15.17:0/1545603204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f58e4003970 con 0x7f58ec106a00 2024-09-16T01:07:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 Processor -- start 2024-09-16T01:07:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 -- start start 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x562159f96770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f96cb0 0x562159f990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562159ef02f0 con 0x562159f8baf0 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562159e98270 con 0x562159f8c410 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f6df4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562159eec2b0 con 0x562159f96cb0 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44328/0 (socket says 172.21.15.17:44328) 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f151c640 1 -- 172.21.15.17:0/1262288912 learned_addr learned my addr 172.21.15.17:0/1262288912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x562159f96770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.023+0000 7f58e2ffd640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 0x7f58d80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 -- 172.21.15.17:0/1262288912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f96cb0 msgr2=0x562159f990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f96cb0 0x562159f990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 -- 172.21.15.17:0/1262288912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 msgr2=0x562159f96770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x562159f96770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 -- 172.21.15.17:0/1262288912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562159e97340 con 0x562159f8baf0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f251e640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 0x7f58d80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58e2ffd640 1 -- 172.21.15.17:0/1545603204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f58e40cfa40 con 0x7f58ec106a00 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f151c640 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00bd40 tx=0x7f58dc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600401044daf01e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58d7fff640 1 -- 172.21.15.17:0/1262288912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01b470 con 0x562159f8baf0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58d7fff640 1 -- 172.21.15.17:0/1262288912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58dc016070 con 0x562159f8baf0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58d7fff640 1 -- 172.21.15.17:0/1262288912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc010750 con 0x562159f8baf0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.024+0000 7f58f251e640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 0x7f58d80a5920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58e40a4490 tx=0x7f58e4097a30 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- 172.21.15.17:0/1262288912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 msgr2=0x562159f8bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00bd40 tx=0x7f58dc0127c0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- 172.21.15.17:0/1262288912 shutdown_connections 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f96cb0 0x562159f990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x562159f96770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1262288912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f8baf0 0x562159f8bed0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- 172.21.15.17:0/1262288912 >> 172.21.15.17:0/1262288912 conn(0x562159f88060 msgr2=0x562159f88440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- 172.21.15.17:0/1262288912 shutdown_connections 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- 172.21.15.17:0/1262288912 wait complete. 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 -- start start 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.025+0000 7f58f6df4740 1 Processor -- start 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f93ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562159f99880 con 0x562159f96cb0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562159e79290 con 0x562159f8baf0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562159f99a00 con 0x562159f8c410 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f6df4740 10 client.0 _ll_register_callbacks cb 0x562159eaa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44332/0 (socket says 172.21.15.17:44332) 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 -- 172.21.15.17:0/2941432472 learned_addr learned my addr 172.21.15.17:0/2941432472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f93ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 -- 172.21.15.17:0/2941432472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 msgr2=0x562159f940e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f940e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 -- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 msgr2=0x562159f93ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f93ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.026+0000 7f58f151c640 1 -- 172.21.15.17:0/2941432472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562159c03210 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f151c640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58dc01b6c0 tx=0x7f58dc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea68a6334f4fe652 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01b930 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f58dc01bad0 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58dc016070 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58dc01bcd0 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 10 client.15711 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562159ccf620 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58dc016070 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58dc029020 con 0x562159f96cb0 2024-09-16T01:07:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 20 client.15711 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562159fa6af0 0x562159fa8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 4 client.15711 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.027+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562159efda20 con 0x562159fa6af0 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.028+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562159fa6af0 0x562159fa8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.028+0000 7f58d57fa640 10 client.15711 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.028+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562159fa6af0 0x562159fa8ee0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f924a6bbc609252 server_cookie=82a670f8efee22e3 in_seq=0 out_seq=0 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58d57fa640 1 -- 172.21.15.17:0/2941432472 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562159efda20 con 0x562159fa6af0 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58d57fa640 10 client.15711 handle_command_reply: tid=0 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 client.15711 shutdown 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 msgr2=0x562159f94620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58dc01b6c0 tx=0x7f58dc014040 comp rx=0 tx=0).stop 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 shutdown_connections 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562159fa6af0 0x562159fa8ee0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f94620 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f940e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 --2- 172.21.15.17:0/2941432472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f93ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58d57fa640 0 client.15711 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 >> 172.21.15.17:0/2941432472 conn(0x562159f88060 msgr2=0x562159f8ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 shutdown_connections 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 1 -- 172.21.15.17:0/2941432472 wait complete. 2024-09-16T01:07:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.029+0000 7f58f6df4740 20 client.15711 trim_cache size 0 max 16384 2024-09-16T01:07:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 Processor -- start 2024-09-16T01:07:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 -- start start 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f92450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f94450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1af930 con 0x562159f96cb0 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1b1470 con 0x562159f8baf0 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f6df4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1b0000 con 0x562159f8c410 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44334/0 (socket says 172.21.15.17:44334) 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f151c640 1 -- 172.21.15.17:0/1402799003 learned_addr learned my addr 172.21.15.17:0/1402799003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.044+0000 7f58f151c640 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f92450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 -- 172.21.15.17:0/1402799003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 msgr2=0x562159f94450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f94450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 -- 172.21.15.17:0/1402799003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 msgr2=0x562159f92450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f92450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 -- 172.21.15.17:0/1402799003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562159f87e90 con 0x562159f96cb0 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f151c640 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0346a0 tx=0x7f58dc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5929bdb2256b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58d77fe640 1 -- 172.21.15.17:0/1402799003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc005850 con 0x562159f96cb0 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58d77fe640 1 -- 172.21.15.17:0/1402799003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58dc016040 con 0x562159f96cb0 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58d77fe640 1 -- 172.21.15.17:0/1402799003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01bb30 con 0x562159f96cb0 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 -- 172.21.15.17:0/1402799003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 msgr2=0x562159fae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0346a0 tx=0x7f58dc001e70 comp rx=0 tx=0).stop 2024-09-16T01:07:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 -- 172.21.15.17:0/1402799003 shutdown_connections 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159fae590 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8c410 0x562159f94450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 --2- 172.21.15.17:0/1402799003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8baf0 0x562159f92450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.045+0000 7f58f6df4740 1 -- 172.21.15.17:0/1402799003 >> 172.21.15.17:0/1402799003 conn(0x562159f88060 msgr2=0x562159f95c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- 172.21.15.17:0/1402799003 shutdown_connections 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- 172.21.15.17:0/1402799003 wait complete. 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- start start 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 Processor -- start 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8baf0 0x56215a0098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x56215a009e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1b0da0 con 0x562159f96cb0 2024-09-16T01:07:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1b06d0 con 0x562159f8c410 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1ad910 con 0x562159f8baf0 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.046+0000 7f58f6df4740 10 client.0 _ll_register_callbacks cb 0x7f58dc00bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44336/0 (socket says 172.21.15.17:44336) 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 -- 172.21.15.17:0/173158407 learned_addr learned my addr 172.21.15.17:0/173158407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x56215a009e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 -- 172.21.15.17:0/173158407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8baf0 msgr2=0x56215a0098d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8baf0 0x56215a0098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 -- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 msgr2=0x56215a009e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x56215a009e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 -- 172.21.15.17:0/173158407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562159f88cf0 con 0x562159f96cb0 2024-09-16T01:07:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x56215a009e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f151c640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f58dc006010 tx=0x7f58dc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa55502404b3c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01b4e0 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58dc016040 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f58dc01b930 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58dc034a70 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f6df4740 10 client.15717 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.047+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56215a010ee0 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58dc016040 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58dc029040 con 0x562159f96cb0 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 10 client.15717 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 20 client.15717 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56215a011590 0x56215a013980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 4 client.15717 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:07:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562159f99520 con 0x56215a011590 2024-09-16T01:07:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56215a011590 0x56215a013980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58d57fa640 10 client.15717 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.048+0000 7f58f1d1d640 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56215a011590 0x56215a013980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2659ce210aaca1a server_cookie=e920aefd1d01cd66 in_seq=0 out_seq=0 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58d57fa640 1 -- 172.21.15.17:0/173158407 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562159f99520 con 0x56215a011590 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58d57fa640 10 client.15717 handle_command_reply: tid=0 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 client.15717 shutdown 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 msgr2=0x562159f9a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f58dc006010 tx=0x7f58dc0127c0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 shutdown_connections 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56215a011590 0x56215a013980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562159f96cb0 0x562159f9a270 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562159f8c410 0x56215a009e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58d57fa640 0 client.15717 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 --2- 172.21.15.17:0/173158407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562159f8baf0 0x56215a0098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 >> 172.21.15.17:0/173158407 conn(0x562159f88060 msgr2=0x562159f869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 shutdown_connections 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 1 -- 172.21.15.17:0/173158407 wait complete. 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.063+0000 7f58f6df4740 20 client.15717 trim_cache size 0 max 16384 2024-09-16T01:07:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:07:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:07:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:07:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 msgr2=0x7f58d80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 0x7f58d80a5920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58e40a4490 tx=0x7f58e4097a30 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 msgr2=0x7f58ec103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009fd0 tx=0x7f58e400b260 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 shutdown_connections 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f58d80a3460 0x7f58d80a5920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58ec106a00 0x7f58ec103040 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58ec101390 0x7f58ec102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 --2- 172.21.15.17:0/1545603204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58ec1009f0 0x7f58ec1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 >> 172.21.15.17:0/1545603204 conn(0x7f58ec0fc6b0 msgr2=0x7f58ec06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 shutdown_connections 2024-09-16T01:07:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:02.064+0000 7f58f3f81640 1 -- 172.21.15.17:0/1545603204 wait complete. 2024-09-16T01:07:03.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:03 smithi088 ceph-mon[34093]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:03.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:03 smithi154 ceph-mon[34759]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:03 smithi017 ceph-mon[31211]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-16T01:07:05.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:05 smithi088 ceph-mon[34093]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 40 op/s 2024-09-16T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:05 smithi154 ceph-mon[34759]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 40 op/s 2024-09-16T01:07:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:05 smithi017 ceph-mon[31211]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 73 KiB/s wr, 40 op/s 2024-09-16T01:07:07.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:07 smithi088 ceph-mon[34093]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-16T01:07:07.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:07 smithi154 ceph-mon[34759]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-16T01:07:07.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:07 smithi017 ceph-mon[31211]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-16T01:07:09.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:09 smithi088 ceph-mon[34093]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 68 KiB/s wr, 38 op/s 2024-09-16T01:07:09.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:09 smithi154 ceph-mon[34759]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 68 KiB/s wr, 38 op/s 2024-09-16T01:07:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:09 smithi017 ceph-mon[31211]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 68 KiB/s wr, 38 op/s 2024-09-16T01:07:11.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:11 smithi088 ceph-mon[34093]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:11.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:11 smithi154 ceph-mon[34759]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:11.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:11 smithi017 ceph-mon[31211]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:13.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:13 smithi088 ceph-mon[34093]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:13.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:13 smithi154 ceph-mon[34759]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:13 smithi017 ceph-mon[31211]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-16T01:07:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 -- 172.21.15.17:0/864963664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934101ad0 msgr2=0x7fe934101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/864963664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934101ad0 0x7fe934101f30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe924009930 tx=0x7fe92402a420 comp rx=0 tx=0).stop 2024-09-16T01:07:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 -- 172.21.15.17:0/864963664 shutdown_connections 2024-09-16T01:07:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/864963664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934102470 0x7fe93410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/864963664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934101ad0 0x7fe934101f30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/864963664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934107b70 0x7fe934107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 -- 172.21.15.17:0/864963664 >> 172.21.15.17:0/864963664 conn(0x7fe9340fd7d0 msgr2=0x7fe9340ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 -- 172.21.15.17:0/864963664 shutdown_connections 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.164+0000 7fe93b2ba640 1 -- 172.21.15.17:0/864963664 wait complete. 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 Processor -- start 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 -- start start 2024-09-16T01:07:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934101ad0 0x7fe934198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934102470 0x7fe9341987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111d90 con 0x7fe934107b70 2024-09-16T01:07:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111c10 con 0x7fe934102470 2024-09-16T01:07:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe93b2ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe934111f10 con 0x7fe934101ad0 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.165+0000 7fe939857640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39630/0 (socket says 172.21.15.17:39630) 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 -- 172.21.15.17:0/1148011140 learned_addr learned my addr 172.21.15.17:0/1148011140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939056640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934101ad0 0x7fe934198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe938855640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934102470 0x7fe9341987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 -- 172.21.15.17:0/1148011140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934101ad0 msgr2=0x7fe934198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934101ad0 0x7fe934198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 -- 172.21.15.17:0/1148011140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934102470 msgr2=0x7fe9341987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934102470 0x7fe9341987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 -- 172.21.15.17:0/1148011140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93419d250 con 0x7fe934107b70 2024-09-16T01:07:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe939857640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00cce0 tx=0x7fe92c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe92a7fc640 1 -- 172.21.15.17:0/1148011140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00f450 con 0x7fe934107b70 2024-09-16T01:07:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe92a7fc640 1 -- 172.21.15.17:0/1148011140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe92c00faa0 con 0x7fe934107b70 2024-09-16T01:07:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93419d540 con 0x7fe934107b70 2024-09-16T01:07:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe92a7fc640 1 -- 172.21.15.17:0/1148011140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c018b70 con 0x7fe934107b70 2024-09-16T01:07:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.166+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341a4dd0 con 0x7fe934107b70 2024-09-16T01:07:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.169+0000 7fe92a7fc640 1 -- 172.21.15.17:0/1148011140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe92c018d10 con 0x7fe934107b70 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.169+0000 7fe93e058740 1 Processor -- start 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.169+0000 7fe93e058740 1 -- start start 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4ae6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4af1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4af40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561fa4a4b2f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561fa49f3270 con 0x561fa4ae6af0 2024-09-16T01:07:15.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe93e058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561fa4a472b0 con 0x561fa4ae7410 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe92a7fc640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 0x7fe9200a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4af40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4af40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39642/0 (socket says 172.21.15.17:39642) 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe938855640 1 -- 172.21.15.17:0/2983163229 learned_addr learned my addr 172.21.15.17:0/2983163229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4af1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939857640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 0x7fe9200a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe938855640 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4ae6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe92a7fc640 1 -- 172.21.15.17:0/1148011140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe92c0d0030 con 0x7fe934107b70 2024-09-16T01:07:15.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 -- 172.21.15.17:0/2983163229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 msgr2=0x561fa4ae6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4ae6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 -- 172.21.15.17:0/2983163229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 msgr2=0x561fa4af40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4af40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 -- 172.21.15.17:0/2983163229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa49f2340 con 0x561fa4ae7410 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939857640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 0x7fe9200a59a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0cd860 tx=0x7fe92c0671d0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.170+0000 7fe939056640 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4af1770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe93000bb70 tx=0x7fe9300107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d2dce4c7fcf7941 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe91f7fe640 1 -- 172.21.15.17:0/2983163229 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93000be60 con 0x561fa4ae7410 2024-09-16T01:07:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe91f7fe640 1 -- 172.21.15.17:0/2983163229 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9300035f0 con 0x561fa4ae7410 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe91f7fe640 1 -- 172.21.15.17:0/2983163229 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300044e0 con 0x561fa4ae7410 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 -- 172.21.15.17:0/2983163229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 msgr2=0x561fa4af1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4af1770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe93000bb70 tx=0x7fe9300107a0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 -- 172.21.15.17:0/2983163229 shutdown_connections 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4af40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4af1770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 --2- 172.21.15.17:0/2983163229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4ae6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.171+0000 7fe93e058740 1 -- 172.21.15.17:0/2983163229 >> 172.21.15.17:0/2983163229 conn(0x561fa4ae3060 msgr2=0x561fa4ae3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- 172.21.15.17:0/2983163229 shutdown_connections 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- 172.21.15.17:0/2983163229 wait complete. 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- start start 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 Processor -- start 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4aeebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4aef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561fa4af4880 con 0x561fa4af1cb0 2024-09-16T01:07:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561fa49d4290 con 0x561fa4ae6af0 2024-09-16T01:07:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561fa4af4a00 con 0x561fa4ae7410 2024-09-16T01:07:15.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.172+0000 7fe93e058740 10 client.0 _ll_register_callbacks cb 0x561fa4a05140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39644/0 (socket says 172.21.15.17:39644) 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 -- 172.21.15.17:0/3876540884 learned_addr learned my addr 172.21.15.17:0/3876540884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4aeebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe939056640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4aef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 -- 172.21.15.17:0/3876540884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 msgr2=0x561fa4aef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4aef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 -- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 msgr2=0x561fa4aeebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4aeebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 -- 172.21.15.17:0/3876540884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa475e210 con 0x561fa4af1cb0 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe938855640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe924009230 tx=0x7fe92402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3940debcbebcde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe91cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924035070 con 0x561fa4af1cb0 2024-09-16T01:07:15.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe924004030 con 0x561fa4af1cb0 2024-09-16T01:07:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.173+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9300035f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe924004230 con 0x561fa4af1cb0 2024-09-16T01:07:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fa482a620 con 0x561fa4af1cb0 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9300035f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9240035f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 20 client.15729 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:15.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b06090 0x561fa4b08480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 4 client.15729 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fa4a58a20 con 0x561fa4b06090 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.174+0000 7fe939056640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b06090 0x561fa4b08480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.175+0000 7fe939056640 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b06090 0x561fa4b08480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2b288766372882f server_cookie=cd3a91e44b997c8e in_seq=0 out_seq=0 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.175+0000 7fe91cff9640 10 client.15729 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.175+0000 7fe91cff9640 1 -- 172.21.15.17:0/3876540884 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fa4a58a20 con 0x561fa4b06090 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.175+0000 7fe91cff9640 10 client.15729 handle_command_reply: tid=0 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.175+0000 7fe93e058740 1 client.15729 shutdown 2024-09-16T01:07:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 msgr2=0x561fa4aef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe924009230 tx=0x7fe92402a420 comp rx=0 tx=0).stop 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 shutdown_connections 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b06090 0x561fa4b08480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4aef630 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4aef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe91cff9640 0 client.15729 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 --2- 172.21.15.17:0/3876540884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae6af0 0x561fa4aeebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 >> 172.21.15.17:0/3876540884 conn(0x561fa4ae3060 msgr2=0x561fa4ae8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 shutdown_connections 2024-09-16T01:07:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 1 -- 172.21.15.17:0/3876540884 wait complete. 2024-09-16T01:07:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.176+0000 7fe93e058740 20 client.15729 trim_cache size 0 max 16384 2024-09-16T01:07:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 Processor -- start 2024-09-16T01:07:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 -- start start 2024-09-16T01:07:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4b0dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4af1cb0 0x561fa4b0e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341ab460 con 0x561fa4ae6af0 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341acfa0 con 0x561fa4af1cb0 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe93e058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341abb30 con 0x561fa4ae7410 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39650/0 (socket says 172.21.15.17:39650) 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 -- 172.21.15.17:0/2841033031 learned_addr learned my addr 172.21.15.17:0/2841033031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 -- 172.21.15.17:0/2841033031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 msgr2=0x561fa4b0dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4b0dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 -- 172.21.15.17:0/2841033031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4af1cb0 msgr2=0x561fa4b0e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4af1cb0 0x561fa4b0e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 -- 172.21.15.17:0/2841033031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa4ae6870 con 0x561fa4ae6af0 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe938855640 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe9240096c0 tx=0x7fe924000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d66c79d57dcd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.191+0000 7fe91effd640 1 -- 172.21.15.17:0/2841033031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924059040 con 0x561fa4ae6af0 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe91effd640 1 -- 172.21.15.17:0/2841033031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9240054f0 con 0x561fa4ae6af0 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe91effd640 1 -- 172.21.15.17:0/2841033031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924035040 con 0x561fa4ae6af0 2024-09-16T01:07:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- 172.21.15.17:0/2841033031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 msgr2=0x561fa4ae9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe9240096c0 tx=0x7fe924000bc0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- 172.21.15.17:0/2841033031 shutdown_connections 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4af1cb0 0x561fa4b0e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae7410 0x561fa4b0dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 --2- 172.21.15.17:0/2841033031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4ae6af0 0x561fa4ae9560 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- 172.21.15.17:0/2841033031 >> 172.21.15.17:0/2841033031 conn(0x561fa4ae3060 msgr2=0x561fa4af0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- 172.21.15.17:0/2841033031 shutdown_connections 2024-09-16T01:07:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- 172.21.15.17:0/2841033031 wait complete. 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.192+0000 7fe93e058740 1 -- start start 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 Processor -- start 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae6af0 0x561fa4afe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae7410 0x561fa4afe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341ac8d0 con 0x561fa4af1cb0 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341ac200 con 0x561fa4ae7410 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341a9460 con 0x561fa4ae6af0 2024-09-16T01:07:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe93e058740 10 client.0 _ll_register_callbacks cb 0x7fe924009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39666/0 (socket says 172.21.15.17:39666) 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 -- 172.21.15.17:0/953113977 learned_addr learned my addr 172.21.15.17:0/953113977 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae6af0 0x561fa4afe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe939056640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae7410 0x561fa4afe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 -- 172.21.15.17:0/953113977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae6af0 msgr2=0x561fa4afe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae6af0 0x561fa4afe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 -- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae7410 msgr2=0x561fa4afe6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae7410 0x561fa4afe6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.193+0000 7fe938855640 1 -- 172.21.15.17:0/953113977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa4afb690 con 0x561fa4af1cb0 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe938855640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe924003bb0 tx=0x7fe924003870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6642e589cb259f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:15.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924035070 con 0x561fa4af1cb0 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe9240056a0 con 0x561fa4af1cb0 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9240054f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe924041040 con 0x561fa4af1cb0 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fa4b71520 con 0x561fa4af1cb0 2024-09-16T01:07:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9240054f0 con 0x561fa4af1cb0 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe924004770 con 0x561fa4af1cb0 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 20 client.15735 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b71bc0 0x561fa4b73fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 4 client.15735 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.194+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fa4a52d70 con 0x561fa4b71bc0 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.195+0000 7fe939056640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b71bc0 0x561fa4b73fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.195+0000 7fe939056640 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b71bc0 0x561fa4b73fe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922e479af007654b server_cookie=89ab7d388ca87497 in_seq=0 out_seq=0 2024-09-16T01:07:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.195+0000 7fe91cff9640 10 client.15735 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe91cff9640 1 -- 172.21.15.17:0/953113977 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fa4a52d70 con 0x561fa4b71bc0 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe91cff9640 10 client.15735 handle_command_reply: tid=0 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 client.15735 shutdown 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 msgr2=0x561fa4afb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe924003bb0 tx=0x7fe924003870 comp rx=0 tx=0).stop 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 shutdown_connections 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561fa4b71bc0 0x561fa4b73fe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa4af1cb0 0x561fa4afb150 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe91cff9640 0 client.15735 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561fa4ae7410 0x561fa4afe6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 --2- 172.21.15.17:0/953113977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa4ae6af0 0x561fa4afe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 >> 172.21.15.17:0/953113977 conn(0x561fa4ae3060 msgr2=0x561fa4ae19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 shutdown_connections 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 1 -- 172.21.15.17:0/953113977 wait complete. 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93e058740 20 client.15735 trim_cache size 0 max 16384 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:07:15.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 msgr2=0x7fe9200a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 0x7fe9200a59a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0cd860 tx=0x7fe92c0671d0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 msgr2=0x7fe93419cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00cce0 tx=0x7fe92c00a620 comp rx=0 tx=0).stop 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 shutdown_connections 2024-09-16T01:07:15.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fe9200a34e0 0x7fe9200a59a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe934107b70 0x7fe93419cb20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.211+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe934102470 0x7fe9341987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.212+0000 7fe93b2ba640 1 --2- 172.21.15.17:0/1148011140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe934101ad0 0x7fe934198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.212+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 >> 172.21.15.17:0/1148011140 conn(0x7fe9340fd7d0 msgr2=0x7fe9340fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.212+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 shutdown_connections 2024-09-16T01:07:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:15.212+0000 7fe93b2ba640 1 -- 172.21.15.17:0/1148011140 wait complete. 2024-09-16T01:07:15.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:15 smithi088 ceph-mon[34093]: pgmap v149: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 70 KiB/s wr, 38 op/s 2024-09-16T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:15 smithi154 ceph-mon[34759]: pgmap v149: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 70 KiB/s wr, 38 op/s 2024-09-16T01:07:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:15 smithi017 ceph-mon[31211]: pgmap v149: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 70 KiB/s wr, 38 op/s 2024-09-16T01:07:17.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:17 smithi088 ceph-mon[34093]: pgmap v150: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-16T01:07:17.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:17 smithi154 ceph-mon[34759]: pgmap v150: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-16T01:07:17.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:17 smithi017 ceph-mon[31211]: pgmap v150: 97 pgs: 97 active+clean; 2.6 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-16T01:07:19.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:19 smithi088 ceph-mon[34093]: pgmap v151: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:19.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:19 smithi154 ceph-mon[34759]: pgmap v151: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:19.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:19 smithi017 ceph-mon[31211]: pgmap v151: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:21.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:21 smithi088 ceph-mon[34093]: pgmap v152: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:21 smithi154 ceph-mon[34759]: pgmap v152: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:21.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:21 smithi017 ceph-mon[31211]: pgmap v152: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:23.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:23 smithi088 ceph-mon[34093]: pgmap v153: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:23.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:23 smithi154 ceph-mon[34759]: pgmap v153: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:23.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:23 smithi017 ceph-mon[31211]: pgmap v153: 97 pgs: 97 active+clean; 2.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:25.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:25 smithi088 ceph-mon[34093]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:25.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:25 smithi154 ceph-mon[34759]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:25.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:25 smithi017 ceph-mon[31211]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:27.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:27 smithi088 ceph-mon[34093]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:27.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:27 smithi154 ceph-mon[34759]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:27.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:27 smithi017 ceph-mon[31211]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 -- 172.21.15.17:0/503142117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100fd0 msgr2=0x7f958c10d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 --2- 172.21.15.17:0/503142117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100fd0 0x7f958c10d030 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9584009cd0 tx=0x7f958402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 -- 172.21.15.17:0/503142117 shutdown_connections 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 --2- 172.21.15.17:0/503142117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100fd0 0x7f958c10d030 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 --2- 172.21.15.17:0/503142117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c100630 0x7f958c100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 --2- 172.21.15.17:0/503142117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c106220 0x7f958c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 -- 172.21.15.17:0/503142117 >> 172.21.15.17:0/503142117 conn(0x7f958c075ef0 msgr2=0x7f958c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 -- 172.21.15.17:0/503142117 shutdown_connections 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.312+0000 7f95947c6640 1 -- 172.21.15.17:0/503142117 wait complete. 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 Processor -- start 2024-09-16T01:07:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 -- start start 2024-09-16T01:07:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 0x7f958c197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c106220 0x7f958c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f958c110470 con 0x7f958c100630 2024-09-16T01:07:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1102f0 con 0x7f958c100fd0 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.313+0000 7f95947c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1105f0 con 0x7f958c106220 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39094/0 (socket says 172.21.15.17:39094) 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 -- 172.21.15.17:0/1438966062 learned_addr learned my addr 172.21.15.17:0/1438966062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9591d61640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 0x7f958c197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592d63640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c106220 0x7f958c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 -- 172.21.15.17:0/1438966062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c106220 msgr2=0x7f958c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c106220 0x7f958c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 -- 172.21.15.17:0/1438966062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 msgr2=0x7f958c197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 0x7f958c197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 -- 172.21.15.17:0/1438966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c19c2d0 con 0x7f958c100630 2024-09-16T01:07:28.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9591d61640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 0x7f958c197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f9592562640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f958800d950 tx=0x7f958800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f95837fe640 1 -- 172.21.15.17:0/1438966062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588017070 con 0x7f958c100630 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f95837fe640 1 -- 172.21.15.17:0/1438966062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9588009c30 con 0x7f958c100630 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c19c5c0 con 0x7f958c100630 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f95837fe640 1 -- 172.21.15.17:0/1438966062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958800f620 con 0x7f958c100630 2024-09-16T01:07:28.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.314+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c1a3e50 con 0x7f958c100630 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f95837fe640 1 -- 172.21.15.17:0/1438966062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f95880109a0 con 0x7f958c100630 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f9597637740 1 Processor -- start 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f9597637740 1 -- start start 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f9597637740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f9597637740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.317+0000 7f9597637740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9597637740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e33c4342f0 con 0x55e33c4d11a0 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9597637740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e33c3dc270 con 0x55e33c4cff60 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9597637740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e33c4302b0 con 0x55e33c4ded70 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39110/0 (socket says 172.21.15.17:39110) 2024-09-16T01:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 -- 172.21.15.17:0/3077375549 learned_addr learned my addr 172.21.15.17:0/3077375549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592562640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9591d61640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 -- 172.21.15.17:0/3077375549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 msgr2=0x55e33c4e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 -- 172.21.15.17:0/3077375549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 msgr2=0x55e33c4d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 -- 172.21.15.17:0/3077375549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33c3db340 con 0x55e33c4d11a0 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592562640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9591d61640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f95837fe640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 0x7f95780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592562640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 0x7f95780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f9592d63640 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9584035000 tx=0x7f9584009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7bea1b909e1b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.318+0000 7f95837fe640 1 -- 172.21.15.17:0/1438966062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f95880cf9d0 con 0x7f958c100630 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9580ff9640 1 -- 172.21.15.17:0/3077375549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584031a50 con 0x55e33c4d11a0 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9580ff9640 1 -- 172.21.15.17:0/3077375549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9584036040 con 0x55e33c4d11a0 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9580ff9640 1 -- 172.21.15.17:0/3077375549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840046e0 con 0x55e33c4d11a0 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 -- 172.21.15.17:0/3077375549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 msgr2=0x55e33c4cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9584035000 tx=0x7f9584009a20 comp rx=0 tx=0).stop 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9592562640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 0x7f95780a5920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95880cd200 tx=0x7f958800bf60 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 -- 172.21.15.17:0/3077375549 shutdown_connections 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 --2- 172.21.15.17:0/3077375549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4cf990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.319+0000 7f9597637740 1 -- 172.21.15.17:0/3077375549 >> 172.21.15.17:0/3077375549 conn(0x55e33c4cc060 msgr2=0x55e33c4cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- 172.21.15.17:0/3077375549 shutdown_connections 2024-09-16T01:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- 172.21.15.17:0/3077375549 wait complete. 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- start start 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 Processor -- start 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 0x55e33c4dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4ded70 0x55e33c4dc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e33c4e1c40 con 0x55e33c4d11a0 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e33c3bd290 con 0x55e33c4ded70 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e33c4e1dc0 con 0x55e33c4cff60 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9597637740 10 client.0 _ll_register_callbacks cb 0x55e33c3ee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9591d61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9591d61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39116/0 (socket says 172.21.15.17:39116) 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9591d61640 1 -- 172.21.15.17:0/2568845278 learned_addr learned my addr 172.21.15.17:0/2568845278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.320+0000 7f9592d63640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4ded70 0x55e33c4dc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9592d63640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 0x55e33c4dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 -- 172.21.15.17:0/2568845278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 msgr2=0x55e33c4dbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 0x55e33c4dbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 -- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4ded70 msgr2=0x55e33c4dc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4ded70 0x55e33c4dc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 -- 172.21.15.17:0/2568845278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33c147210 con 0x55e33c4d11a0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9592d63640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 0x55e33c4dbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9591d61640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e470 tx=0x7f957c00e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e041a69c6d8699 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c017020 con 0x55e33c4d11a0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f957c013610 con 0x55e33c4d11a0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9584036040 con 0x55e33c4d11a0 2024-09-16T01:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f957c022050 con 0x55e33c4d11a0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9597637740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e33c213620 con 0x55e33c4d11a0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.321+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9584036040 con 0x55e33c4d11a0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f957c012050 con 0x55e33c4d11a0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 20 client.15747 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c4ef160 0x55e33c4f1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 4 client.15747 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e33c441a20 con 0x55e33c4ef160 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9592d63640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c4ef160 0x55e33c4f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9575ffb640 10 client.15747 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.322+0000 7f9592d63640 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c4ef160 0x55e33c4f1550 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54bf03fbbe42785f server_cookie=317010042297632a in_seq=0 out_seq=0 2024-09-16T01:07:28.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9575ffb640 1 -- 172.21.15.17:0/2568845278 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e33c441a20 con 0x55e33c4ef160 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9575ffb640 10 client.15747 handle_command_reply: tid=0 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 client.15747 shutdown 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 msgr2=0x55e33c4dc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e470 tx=0x7f957c00e930 comp rx=0 tx=0).stop 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 shutdown_connections 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c4ef160 0x55e33c4f1550 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4ded70 0x55e33c4dc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc270 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 --2- 172.21.15.17:0/2568845278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4cff60 0x55e33c4dbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9575ffb640 0 client.15747 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 >> 172.21.15.17:0/2568845278 conn(0x55e33c4cc060 msgr2=0x55e33c4d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 shutdown_connections 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 1 -- 172.21.15.17:0/2568845278 wait complete. 2024-09-16T01:07:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.323+0000 7f9597637740 20 client.15747 trim_cache size 0 max 16384 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 Processor -- start 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 -- start start 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1ab4b0 con 0x55e33c4cff60 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1acff0 con 0x55e33c4d11a0 2024-09-16T01:07:28.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9597637740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1abb80 con 0x55e33c4ded70 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39128/0 (socket says 172.21.15.17:39128) 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9592d63640 1 -- 172.21.15.17:0/1948921132 learned_addr learned my addr 172.21.15.17:0/1948921132 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.338+0000 7f9591d61640 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 -- 172.21.15.17:0/1948921132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 msgr2=0x55e33c4d8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 -- 172.21.15.17:0/1948921132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4d11a0 msgr2=0x55e33c4dc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 -- 172.21.15.17:0/1948921132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33c4edc40 con 0x55e33c4cff60 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9592d63640 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f95840314e0 tx=0x7f9584005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c67df0c7d2a8ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9577fff640 1 -- 172.21.15.17:0/1948921132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584009540 con 0x55e33c4cff60 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9577fff640 1 -- 172.21.15.17:0/1948921132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9584036050 con 0x55e33c4cff60 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9577fff640 1 -- 172.21.15.17:0/1948921132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584003cf0 con 0x55e33c4cff60 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9597637740 1 -- 172.21.15.17:0/1948921132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 msgr2=0x55e33c4e1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.339+0000 7f9597637740 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f95840314e0 tx=0x7f9584005c30 comp rx=0 tx=0).stop 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- 172.21.15.17:0/1948921132 shutdown_connections 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4ded70 0x55e33c4d8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4d11a0 0x55e33c4dc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- 172.21.15.17:0/1948921132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4cff60 0x55e33c4e1000 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- 172.21.15.17:0/1948921132 >> 172.21.15.17:0/1948921132 conn(0x55e33c4cc060 msgr2=0x55e33c4e08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- 172.21.15.17:0/1948921132 shutdown_connections 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- 172.21.15.17:0/1948921132 wait complete. 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- start start 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 Processor -- start 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4d11a0 0x55e33c4f6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1ac920 con 0x55e33c4ded70 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1ac250 con 0x55e33c4cff60 2024-09-16T01:07:28.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1a9490 con 0x55e33c4d11a0 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9597637740 10 client.0 _ll_register_callbacks cb 0x7f957c009180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9592d63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39136/0 (socket says 172.21.15.17:39136) 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9592d63640 1 -- 172.21.15.17:0/1926443910 learned_addr learned my addr 172.21.15.17:0/1926443910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9592d63640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.340+0000 7f9591d61640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4d11a0 0x55e33c4f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 -- 172.21.15.17:0/1926443910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4d11a0 msgr2=0x55e33c4f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4d11a0 0x55e33c4f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 -- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 msgr2=0x55e33c4e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 -- 172.21.15.17:0/1926443910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33c4cccf0 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9592d63640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9584053040 tx=0x7f95840041e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921d8277d64d801c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584055070 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9584004710 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9584036050 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9584003a70 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9597637740 10 client.15753 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e33c559ca0 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.341+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9584036050 con 0x55e33c4ded70 2024-09-16T01:07:28.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9584030070 con 0x55e33c4ded70 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 10 client.15753 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 20 client.15753 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c559e70 0x55e33c55c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 4 client.15753 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e33c43bd70 con 0x55e33c559e70 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9591d61640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c559e70 0x55e33c55c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9591d61640 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c559e70 0x55e33c55c260 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4a81564bba60e8 server_cookie=ebaeed3323f56da1 in_seq=0 out_seq=0 2024-09-16T01:07:28.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.342+0000 7f9575ffb640 10 client.15753 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9575ffb640 1 -- 172.21.15.17:0/1926443910 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e33c43bd70 con 0x55e33c559e70 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9575ffb640 10 client.15753 handle_command_reply: tid=0 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 client.15753 shutdown 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 msgr2=0x55e33c4f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9584053040 tx=0x7f95840041e0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 shutdown_connections 2024-09-16T01:07:28.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e33c559e70 0x55e33c55c260 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33c4ded70 0x55e33c4f6ce0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e33c4d11a0 0x55e33c4f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9575ffb640 0 client.15753 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 --2- 172.21.15.17:0/1926443910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e33c4cff60 0x55e33c4e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 >> 172.21.15.17:0/1926443910 conn(0x55e33c4cc060 msgr2=0x55e33c4d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 shutdown_connections 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 1 -- 172.21.15.17:0/1926443910 wait complete. 2024-09-16T01:07:28.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f9597637740 20 client.15753 trim_cache size 0 max 16384 2024-09-16T01:07:28.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:07:28.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:07:28.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:07:28.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 msgr2=0x7f95780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.357+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 0x7f95780a5920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95880cd200 tx=0x7f958800bf60 comp rx=0 tx=0).stop 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 msgr2=0x7f958c1972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f958800d950 tx=0x7f958800de10 comp rx=0 tx=0).stop 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 shutdown_connections 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95780a3460 0x7f95780a5920 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f958c106220 0x7f958c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c100fd0 0x7f958c197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 --2- 172.21.15.17:0/1438966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c100630 0x7f958c1972e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 >> 172.21.15.17:0/1438966062 conn(0x7f958c075ef0 msgr2=0x7f958c104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 shutdown_connections 2024-09-16T01:07:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:28.358+0000 7f95947c6640 1 -- 172.21.15.17:0/1438966062 wait complete. 2024-09-16T01:07:29.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:29 smithi088 ceph-mon[34093]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:29 smithi154 ceph-mon[34759]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:29.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:29 smithi017 ceph-mon[31211]: pgmap v156: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:07:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:07:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:07:30.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:07:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:07:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:07:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:07:30.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:07:30.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:07:30.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:07:30.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:07:30.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:07:31.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:31 smithi088 ceph-mon[34093]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:31.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:31 smithi154 ceph-mon[34759]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:31.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:31 smithi017 ceph-mon[31211]: pgmap v157: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:33.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:33 smithi088 ceph-mon[34093]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:33.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:33 smithi154 ceph-mon[34759]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:33.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:33 smithi017 ceph-mon[31211]: pgmap v158: 97 pgs: 97 active+clean; 3.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:35.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:35 smithi088 ceph-mon[34093]: pgmap v159: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:35.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:35 smithi154 ceph-mon[34759]: pgmap v159: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:35 smithi017 ceph-mon[31211]: pgmap v159: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:189/600: open fd = 3 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:190/600: open fd = 3 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.587 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:191/600: open fd = 3 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:192/600: open fd = 3 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.588 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:193/600: open fd = 3 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:194/600: open fd = 3 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.589 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:195/600: open fd = 3 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:196/600: open fd = 3 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.590 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.591 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.591 INFO:tasks.workunit.client.0.smithi017.stdout:197/600: open fd = 3 2024-09-16T01:07:37.591 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.591 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:198/600: open fd = 3 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:199/600: open fd = 3 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:200/600: open fd = 3 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.592 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:201/600: open fd = 3 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:202/600: open fd = 3 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:203/600: open fd = 3 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.593 INFO:tasks.workunit.client.0.smithi017.stdout:204/600: open fd = 3 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:205/600: open fd = 3 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:206/600: open fd = 3 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:207/600: open fd = 3 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.594 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:208/600: open fd = 3 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:209/600: open fd = 3 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:210/600: open fd = 3 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.595 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:211/600: open fd = 3 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:212/600: open fd = 3 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:213/600: open fd = 3 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:214/600: open fd = 3 2024-09-16T01:07:37.596 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:215/600: open fd = 3 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:216/600: open fd = 3 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:217/600: open fd = 3 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.597 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:218/600: open fd = 3 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:219/600: open fd = 3 2024-09-16T01:07:37.598 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.600 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.600 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.600 INFO:tasks.workunit.client.0.smithi017.stdout:220/600: open fd = 3 2024-09-16T01:07:37.600 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:221/600: open fd = 3 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:222/600: open fd = 3 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:223/600: open fd = 3 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.601 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:224/600: open fd = 3 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:225/600: open fd = 3 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:226/600: open fd = 3 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.602 INFO:tasks.workunit.client.0.smithi017.stdout:227/600: open fd = 3 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:228/600: open fd = 3 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:229/600: open fd = 3 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:230/600: open fd = 3 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.603 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:231/600: open fd = 3 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:232/600: open fd = 3 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:233/600: open fd = 3 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.604 INFO:tasks.workunit.client.0.smithi017.stdout:234/600: open fd = 3 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:235/600: open fd = 3 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:236/600: open fd = 3 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:237/600: open fd = 3 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.605 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:238/600: open fd = 3 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:239/600: open fd = 3 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:240/600: open fd = 3 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.606 INFO:tasks.workunit.client.0.smithi017.stdout:241/600: open fd = 3 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:242/600: open fd = 3 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:243/600: open fd = 3 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:244/600: open fd = 3 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.607 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:245/600: open fd = 3 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:246/600: open fd = 3 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:247/600: open fd = 3 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.608 INFO:tasks.workunit.client.0.smithi017.stdout:248/600: open fd = 3 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:249/600: open fd = 3 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:250/600: open fd = 3 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:07:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:37 smithi088 ceph-mon[34093]: pgmap v160: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:37 smithi154 ceph-mon[34759]: pgmap v160: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:37 smithi017 ceph-mon[31211]: pgmap v160: 97 pgs: 97 active+clean; 3.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:39 smithi088 ceph-mon[34093]: pgmap v161: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-09-16T01:07:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:39 smithi154 ceph-mon[34759]: pgmap v161: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-09-16T01:07:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:39 smithi017 ceph-mon[31211]: pgmap v161: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-09-16T01:07:41.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.458+0000 7f00a048d640 1 -- 172.21.15.17:0/445834351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 msgr2=0x7f0098107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.458+0000 7f00a048d640 1 --2- 172.21.15.17:0/445834351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f0098107f60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0094009930 tx=0x7f009402a420 comp rx=0 tx=0).stop 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 -- 172.21.15.17:0/445834351 shutdown_connections 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 --2- 172.21.15.17:0/445834351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f009810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 --2- 172.21.15.17:0/445834351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 0x7f0098101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 --2- 172.21.15.17:0/445834351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f0098107f60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 -- 172.21.15.17:0/445834351 >> 172.21.15.17:0/445834351 conn(0x7f00980fd7e0 msgr2=0x7f00980ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 -- 172.21.15.17:0/445834351 shutdown_connections 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 -- 172.21.15.17:0/445834351 wait complete. 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 Processor -- start 2024-09-16T01:07:41.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.459+0000 7f00a048d640 1 -- start start 2024-09-16T01:07:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 0x7f00981982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f00981987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0098111de0 con 0x7f0098107b80 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0098111c60 con 0x7f0098102480 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f00a048d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0098111f60 con 0x7f0098101ae0 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56906/0 (socket says 172.21.15.17:56906) 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 -- 172.21.15.17:0/1287938933 learned_addr learned my addr 172.21.15.17:0/1287938933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009e229640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 0x7f00981982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009da28640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f00981987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 -- 172.21.15.17:0/1287938933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 msgr2=0x7f00981982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 0x7f00981982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 -- 172.21.15.17:0/1287938933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 msgr2=0x7f00981987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f00981987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 -- 172.21.15.17:0/1287938933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009819d2a0 con 0x7f0098107b80 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009da28640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f00981987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f009ea2a640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f009000eb10 tx=0x7f009000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.460+0000 7f008f7fe640 1 -- 172.21.15.17:0/1287938933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090004b20 con 0x7f0098107b80 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.461+0000 7f008f7fe640 1 -- 172.21.15.17:0/1287938933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0090004cc0 con 0x7f0098107b80 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.461+0000 7f008f7fe640 1 -- 172.21.15.17:0/1287938933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090010690 con 0x7f0098107b80 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.461+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009819d590 con 0x7f0098107b80 2024-09-16T01:07:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.461+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981a4e20 con 0x7f0098107b80 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.463+0000 7f008f7fe640 1 -- 172.21.15.17:0/1287938933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0090005020 con 0x7f0098107b80 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 Processor -- start 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 -- start start 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddeded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da3dd522f0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55da3dcfa270 con 0x55da3ddedaf0 2024-09-16T01:07:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f00a3226740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da3dd4e2b0 con 0x55da3ddee410 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56908/0 (socket says 172.21.15.17:56908) 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f009da28640 1 -- 172.21.15.17:0/2033634786 learned_addr learned my addr 172.21.15.17:0/2033634786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f009da28640 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddeded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f008f7fe640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 0x7f00840a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.464+0000 7f009e229640 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009ea2a640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 0x7f00840a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 -- 172.21.15.17:0/2033634786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 msgr2=0x55da3ddf8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 -- 172.21.15.17:0/2033634786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 msgr2=0x55da3ddeded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddeded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 -- 172.21.15.17:0/2033634786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3dcf9340 con 0x55da3ddf8cb0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f008f7fe640 1 -- 172.21.15.17:0/1287938933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f00900d0230 con 0x7f0098107b80 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009da28640 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0088014a30 tx=0x7f008800c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a9711f8fdf8e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f008cbfe640 1 -- 172.21.15.17:0/2033634786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00880142d0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f009ea2a640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 0x7f00840a59a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00900989a0 tx=0x7f0090067320 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f008cbfe640 1 -- 172.21.15.17:0/2033634786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00880054d0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.465+0000 7f008cbfe640 1 -- 172.21.15.17:0/2033634786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00880047a0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- 172.21.15.17:0/2033634786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 msgr2=0x55da3ddfb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0088014a30 tx=0x7f008800c570 comp rx=0 tx=0).stop 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- 172.21.15.17:0/2033634786 shutdown_connections 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddfb0a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 --2- 172.21.15.17:0/2033634786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddeded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- 172.21.15.17:0/2033634786 >> 172.21.15.17:0/2033634786 conn(0x55da3ddea060 msgr2=0x55da3ddea440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- 172.21.15.17:0/2033634786 shutdown_connections 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- 172.21.15.17:0/2033634786 wait complete. 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 -- start start 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.466+0000 7f00a3226740 1 Processor -- start 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddf5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da3ddfb880 con 0x55da3ddf8cb0 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55da3dcdb290 con 0x55da3ddedaf0 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da3ddfba00 con 0x55da3ddee410 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f00a3226740 10 client.0 _ll_register_callbacks cb 0x55da3dd0c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56916/0 (socket says 172.21.15.17:56916) 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 -- 172.21.15.17:0/314615430 learned_addr learned my addr 172.21.15.17:0/314615430 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009e229640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddf5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 -- 172.21.15.17:0/314615430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 msgr2=0x55da3ddf6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 -- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 msgr2=0x55da3ddf5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddf5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.467+0000 7f009da28640 1 -- 172.21.15.17:0/314615430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3da65210 con 0x55da3ddf8cb0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f009da28640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0088001eb0 tx=0x7f0088016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e667d869bdc6ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008802a020 con 0x55da3ddf8cb0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0088012650 con 0x55da3ddf8cb0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00880054d0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0088012850 con 0x55da3ddf8cb0 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da3db31620 con 0x55da3ddf8cb0 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00880054d0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0088023800 con 0x55da3ddf8cb0 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.468+0000 7f00a3226740 20 client.15765 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de08b20 0x55da3de0af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f00a3226740 4 client.15765 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da3dd5fa20 con 0x55da3de08b20 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f009e229640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de08b20 0x55da3de0af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f0081ffb640 10 client.15765 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.469+0000 7f009e229640 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de08b20 0x55da3de0af10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3863192e8288d014 server_cookie=61c8d30f080f5be2 in_seq=0 out_seq=0 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f0081ffb640 1 -- 172.21.15.17:0/314615430 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da3dd5fa20 con 0x55da3de08b20 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f0081ffb640 10 client.15765 handle_command_reply: tid=0 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 client.15765 shutdown 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 msgr2=0x55da3ddf6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0088001eb0 tx=0x7f0088016040 comp rx=0 tx=0).stop 2024-09-16T01:07:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 shutdown_connections 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de08b20 0x55da3de0af10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3ddf6650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddee410 0x55da3ddf6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 --2- 172.21.15.17:0/314615430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddedaf0 0x55da3ddf5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 >> 172.21.15.17:0/314615430 conn(0x55da3ddea060 msgr2=0x55da3ddefd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f0081ffb640 0 client.15765 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 shutdown_connections 2024-09-16T01:07:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 1 -- 172.21.15.17:0/314615430 wait complete. 2024-09-16T01:07:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.470+0000 7f00a3226740 20 client.15765 trim_cache size 0 max 16384 2024-09-16T01:07:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 Processor -- start 2024-09-16T01:07:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 -- start start 2024-09-16T01:07:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de0df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddf8cb0 0x55da3de0e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00981ad720 con 0x55da3ddedaf0 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f00981af260 con 0x55da3ddee410 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f00a3226740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00981addf0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56922/0 (socket says 172.21.15.17:56922) 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.485+0000 7f009da28640 1 -- 172.21.15.17:0/907971626 learned_addr learned my addr 172.21.15.17:0/907971626 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009e229640 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de0df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 -- 172.21.15.17:0/907971626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddf8cb0 msgr2=0x55da3de0e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddf8cb0 0x55da3de0e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 -- 172.21.15.17:0/907971626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 msgr2=0x55da3de0df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de0df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 -- 172.21.15.17:0/907971626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3dde9e90 con 0x55da3ddedaf0 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009e229640 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f009da28640 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0088023c00 tx=0x7f0088020450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a3ebc07b080814 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f0083fff640 1 -- 172.21.15.17:0/907971626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008802a070 con 0x55da3ddedaf0 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f0083fff640 1 -- 172.21.15.17:0/907971626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0088012450 con 0x55da3ddedaf0 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f0083fff640 1 -- 172.21.15.17:0/907971626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00880236b0 con 0x55da3ddedaf0 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 -- 172.21.15.17:0/907971626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 msgr2=0x55da3ddf7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0088023c00 tx=0x7f0088020450 comp rx=0 tx=0).stop 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 -- 172.21.15.17:0/907971626 shutdown_connections 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddf8cb0 0x55da3de0e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.486+0000 7f00a3226740 1 --2- 172.21.15.17:0/907971626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddedaf0 0x55da3ddf7b40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- 172.21.15.17:0/907971626 >> 172.21.15.17:0/907971626 conn(0x55da3ddea060 msgr2=0x55da3ddf7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- 172.21.15.17:0/907971626 shutdown_connections 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- 172.21.15.17:0/907971626 wait complete. 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- start start 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 Processor -- start 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddedaf0 0x55da3de69dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de6a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00981aeb90 con 0x55da3ddf8cb0 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f00981ae4c0 con 0x55da3ddee410 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00981ab700 con 0x55da3ddedaf0 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f00a3226740 10 client.0 _ll_register_callbacks cb 0x7f0088014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:41.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f009da28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56934/0 (socket says 172.21.15.17:56934) 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f009da28640 1 -- 172.21.15.17:0/3117340922 learned_addr learned my addr 172.21.15.17:0/3117340922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.487+0000 7f009e229640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de6a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddedaf0 0x55da3de69dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 -- 172.21.15.17:0/3117340922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddedaf0 msgr2=0x55da3de69dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddedaf0 0x55da3de69dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 -- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 msgr2=0x55da3de6a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de6a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 -- 172.21.15.17:0/3117340922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3dde52d0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f009da28640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f008800cab0 tx=0x7f0088020540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b550c14b3c444980 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f0081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008802a040 con 0x55da3ddf8cb0 2024-09-16T01:07:41.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f00880129f0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0088012450 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f008804b050 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f00a3226740 10 client.15771 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da3de76db0 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.488+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0088012450 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0088036020 con 0x55da3ddf8cb0 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 10 client.15771 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 20 client.15771 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de77310 0x55da3de79730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 4 client.15771 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da3dd59d70 con 0x55da3de77310 2024-09-16T01:07:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f009e229640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de77310 0x55da3de79730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f0081ffb640 10 client.15771 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.489+0000 7f009e229640 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de77310 0x55da3de79730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653d2a43905178c server_cookie=8c701b47f6601669 in_seq=0 out_seq=0 2024-09-16T01:07:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f0081ffb640 1 -- 172.21.15.17:0/3117340922 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da3dd59d70 con 0x55da3de77310 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f0081ffb640 10 client.15771 handle_command_reply: tid=0 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 client.15771 shutdown 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 msgr2=0x55da3de6e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f008800cab0 tx=0x7f0088020540 comp rx=0 tx=0).stop 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 shutdown_connections 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55da3de77310 0x55da3de79730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da3ddf8cb0 0x55da3de6e3c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55da3ddee410 0x55da3de6a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f0081ffb640 0 client.15771 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 --2- 172.21.15.17:0/3117340922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ddedaf0 0x55da3de69dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.504+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 >> 172.21.15.17:0/3117340922 conn(0x55da3ddea060 msgr2=0x55da3ddf7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 shutdown_connections 2024-09-16T01:07:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a3226740 1 -- 172.21.15.17:0/3117340922 wait complete. 2024-09-16T01:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a3226740 20 client.15771 trim_cache size 0 max 16384 2024-09-16T01:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:07:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 msgr2=0x7f00840a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 0x7f00840a59a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00900989a0 tx=0x7f0090067320 comp rx=0 tx=0).stop 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 msgr2=0x7f009819cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f009000eb10 tx=0x7f009000c2d0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 shutdown_connections 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f00840a34e0 0x7f00840a59a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0098107b80 0x7f009819cb70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0098102480 0x7f00981987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 --2- 172.21.15.17:0/1287938933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0098101ae0 0x7f00981982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 >> 172.21.15.17:0/1287938933 conn(0x7f00980fd7e0 msgr2=0x7f00980fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.505+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 shutdown_connections 2024-09-16T01:07:41.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:41.506+0000 7f00a048d640 1 -- 172.21.15.17:0/1287938933 wait complete. 2024-09-16T01:07:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:41 smithi154 ceph-mon[34759]: pgmap v162: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:41 smithi017 ceph-mon[31211]: pgmap v162: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:41 smithi088 ceph-mon[34093]: pgmap v162: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:43.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:43 smithi154 ceph-mon[34759]: pgmap v163: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:43 smithi017 ceph-mon[31211]: pgmap v163: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:44.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:43 smithi088 ceph-mon[34093]: pgmap v163: 97 pgs: 97 active+clean; 3.5 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:07:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:45 smithi154 ceph-mon[34759]: pgmap v164: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-16T01:07:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:45 smithi017 ceph-mon[31211]: pgmap v164: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-16T01:07:45.945 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:45 smithi088 ceph-mon[34093]: pgmap v164: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-16T01:07:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:47 smithi154 ceph-mon[34759]: pgmap v165: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:47 smithi017 ceph-mon[31211]: pgmap v165: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:47 smithi088 ceph-mon[34093]: pgmap v165: 97 pgs: 97 active+clean; 3.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:49.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:49 smithi017 ceph-mon[31211]: pgmap v166: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:50.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:49 smithi088 ceph-mon[34093]: pgmap v166: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:50.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:49 smithi154 ceph-mon[34759]: pgmap v166: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:51.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:51 smithi017 ceph-mon[31211]: pgmap v167: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:52.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:51 smithi088 ceph-mon[34093]: pgmap v167: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:52.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:51 smithi154 ceph-mon[34759]: pgmap v167: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:53 smithi017 ceph-mon[31211]: pgmap v168: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:53 smithi088 ceph-mon[34093]: pgmap v168: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:54.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:53 smithi154 ceph-mon[34759]: pgmap v168: 97 pgs: 97 active+clean; 3.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-16T01:07:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 -- 172.21.15.17:0/2654973576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c3810c110 msgr2=0x7f6c3810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 --2- 172.21.15.17:0/2654973576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c3810c110 0x7f6c3810e590 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ca0 tx=0x7f6c3002a950 comp rx=0 tx=0).stop 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 -- 172.21.15.17:0/2654973576 shutdown_connections 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 --2- 172.21.15.17:0/2654973576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c3810c110 0x7f6c3810e590 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 --2- 172.21.15.17:0/2654973576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c381035e0 0x7f6c3810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 --2- 172.21.15.17:0/2654973576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c38102cc0 0x7f6c381030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 -- 172.21.15.17:0/2654973576 >> 172.21.15.17:0/2654973576 conn(0x7f6c380fc6b0 msgr2=0x7f6c380fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 -- 172.21.15.17:0/2654973576 shutdown_connections 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.605+0000 7f6c3d126640 1 -- 172.21.15.17:0/2654973576 wait complete. 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 Processor -- start 2024-09-16T01:07:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 -- start start 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c38102cc0 0x7f6c38198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c3810c110 0x7f6c3819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38111da0 con 0x7f6c381035e0 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38111c20 con 0x7f6c38102cc0 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3d126640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38111f20 con 0x7f6c3810c110 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.606+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48588/0 (socket says 172.21.15.17:48588) 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 -- 172.21.15.17:0/1576908044 learned_addr learned my addr 172.21.15.17:0/1576908044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c38102cc0 0x7f6c38198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3759e640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c3810c110 0x7f6c3819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 -- 172.21.15.17:0/1576908044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c3810c110 msgr2=0x7f6c3819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c3810c110 0x7f6c3819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 -- 172.21.15.17:0/1576908044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c38102cc0 msgr2=0x7f6c38198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c38102cc0 0x7f6c38198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 -- 172.21.15.17:0/1576908044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3819d260 con 0x7f6c381035e0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d950 tx=0x7f6c2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c2ffff640 1 -- 172.21.15.17:0/1576908044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20017030 con 0x7f6c381035e0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c2ffff640 1 -- 172.21.15.17:0/1576908044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c20004020 con 0x7f6c381035e0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3819d550 con 0x7f6c381035e0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c2ffff640 1 -- 172.21.15.17:0/1576908044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200055e0 con 0x7f6c381035e0 2024-09-16T01:07:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.607+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a4de0 con 0x7f6c381035e0 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.610+0000 7f6c3feb9740 1 Processor -- start 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.610+0000 7f6c3feb9740 1 -- start start 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.610+0000 7f6c2ffff640 1 -- 172.21.15.17:0/1576908044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6c200041d0 con 0x7f6c381035e0 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.610+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.610+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc28b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc2b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55de7db7e2f0 con 0x55de7dc199b0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55de7db26270 con 0x55de7dc1a2d0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55de7db7a2b0 con 0x55de7dc290c0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48604/0 (socket says 172.21.15.17:48604) 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 -- 172.21.15.17:0/106586285 learned_addr learned my addr 172.21.15.17:0/106586285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc28b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3659c640 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc2b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 -- 172.21.15.17:0/106586285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 msgr2=0x55de7dc2b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc2b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 -- 172.21.15.17:0/106586285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 msgr2=0x55de7dc28b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc28b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 -- 172.21.15.17:0/106586285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7db25340 con 0x55de7dc199b0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c3759e640 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ca0 tx=0x7f6c3002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e33cce93d0f908 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.611+0000 7f6c2ffff640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 0x7f6c240a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c2d7fa640 1 -- 172.21.15.17:0/106586285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30048070 con 0x55de7dc199b0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c2d7fa640 1 -- 172.21.15.17:0/106586285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c30003e20 con 0x55de7dc199b0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c2d7fa640 1 -- 172.21.15.17:0/106586285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30034040 con 0x55de7dc199b0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 0x7f6c240a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c2ffff640 1 -- 172.21.15.17:0/1576908044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6c200cf4b0 con 0x7f6c381035e0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c3feb9740 1 -- 172.21.15.17:0/106586285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 msgr2=0x55de7dc19d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 0x7f6c240a5920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c2800b390 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.612+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ca0 tx=0x7f6c3002fd40 comp rx=0 tx=0).stop 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- 172.21.15.17:0/106586285 shutdown_connections 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc2b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc28b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/106586285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc19d90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- 172.21.15.17:0/106586285 >> 172.21.15.17:0/106586285 conn(0x55de7dc16060 msgr2=0x55de7dc16440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- 172.21.15.17:0/106586285 shutdown_connections 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- 172.21.15.17:0/106586285 wait complete. 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- start start 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 Processor -- start 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc26560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc26aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55de7dc2bc30 con 0x55de7dc199b0 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55de7db07290 con 0x55de7dc1a2d0 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55de7dc2bdb0 con 0x55de7dc290c0 2024-09-16T01:07:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c3feb9740 10 client.0 _ll_register_callbacks cb 0x55de7db38140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48618/0 (socket says 172.21.15.17:48618) 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.613+0000 7f6c36d9d640 1 -- 172.21.15.17:0/1375510802 learned_addr learned my addr 172.21.15.17:0/1375510802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3759e640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc26aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc26560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 -- 172.21.15.17:0/1375510802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 msgr2=0x55de7dc26aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc26aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 -- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 msgr2=0x55de7dc26560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc26560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 -- 172.21.15.17:0/1375510802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7d891210 con 0x55de7dc199b0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc26560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c28003e00 tx=0x7f6c28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcfb275125d7db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802c060 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6c28017030 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30003e20 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c28031480 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3feb9740 10 client.15783 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de7d95d620 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.614+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c30003e20 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c28011640 con 0x55de7dc199b0 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 20 client.15783 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dc39080 0x55de7dc3b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 4 client.15783 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:07:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de7db8ba20 con 0x55de7dc39080 2024-09-16T01:07:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.615+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dc39080 0x55de7dc3b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dc39080 0x55de7dc3b470 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3298dc74d937b42 server_cookie=fb6aa440bee491d1 in_seq=0 out_seq=0 2024-09-16T01:07:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c1e7fc640 10 client.15783 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1375510802 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de7db8ba20 con 0x55de7dc39080 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c1e7fc640 10 client.15783 handle_command_reply: tid=0 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 client.15783 shutdown 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 msgr2=0x55de7dc26020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c28003e00 tx=0x7f6c28004730 comp rx=0 tx=0).stop 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 shutdown_connections 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dc39080 0x55de7dc3b470 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc26aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc1a2d0 0x55de7dc26560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c1e7fc640 0 client.15783 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1375510802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc199b0 0x55de7dc26020 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.616+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 >> 172.21.15.17:0/1375510802 conn(0x55de7dc16060 msgr2=0x55de7dc151c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.617+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 shutdown_connections 2024-09-16T01:07:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.617+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1375510802 wait complete. 2024-09-16T01:07:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.617+0000 7f6c3feb9740 20 client.15783 trim_cache size 0 max 16384 2024-09-16T01:07:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.631+0000 7f6c3feb9740 1 Processor -- start 2024-09-16T01:07:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.631+0000 7f6c3feb9740 1 -- start start 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 0x55de7dc27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ab490 con 0x55de7dc1a2d0 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381acfd0 con 0x55de7dc199b0 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381abb60 con 0x55de7dc290c0 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48620/0 (socket says 172.21.15.17:48620) 2024-09-16T01:07:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 -- 172.21.15.17:0/369163905 learned_addr learned my addr 172.21.15.17:0/369163905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 0x55de7dc27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 -- 172.21.15.17:0/369163905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 msgr2=0x55de7dc412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 -- 172.21.15.17:0/369163905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 msgr2=0x55de7dc27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 0x55de7dc27f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 -- 172.21.15.17:0/369163905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7dc1af50 con 0x55de7dc1a2d0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 0x55de7dc27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c3659c640 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c20005fd0 tx=0x7f6c20005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3e52a4ba501855 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c2cff9640 1 -- 172.21.15.17:0/369163905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2009b300 con 0x55de7dc1a2d0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c2cff9640 1 -- 172.21.15.17:0/369163905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c2009bec0 con 0x55de7dc1a2d0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.632+0000 7f6c2cff9640 1 -- 172.21.15.17:0/369163905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2009b120 con 0x55de7dc1a2d0 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 -- 172.21.15.17:0/369163905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 msgr2=0x55de7dc40d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c20005fd0 tx=0x7f6c20005780 comp rx=0 tx=0).stop 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 -- 172.21.15.17:0/369163905 shutdown_connections 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc290c0 0x55de7dc412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc40d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/369163905 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc199b0 0x55de7dc27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 -- 172.21.15.17:0/369163905 >> 172.21.15.17:0/369163905 conn(0x55de7dc16060 msgr2=0x55de7dc27880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 -- 172.21.15.17:0/369163905 shutdown_connections 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.633+0000 7f6c3feb9740 1 -- 172.21.15.17:0/369163905 wait complete. 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 -- start start 2024-09-16T01:07:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 Processor -- start 2024-09-16T01:07:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc199b0 0x55de7dc31040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 0x55de7dc2e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ac900 con 0x55de7dc1a2d0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ac230 con 0x55de7dc290c0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381a9470 con 0x55de7dc199b0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3feb9740 10 client.0 _ll_register_callbacks cb 0x7f6c28003cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48632/0 (socket says 172.21.15.17:48632) 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 -- 172.21.15.17:0/1721910658 learned_addr learned my addr 172.21.15.17:0/1721910658 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3759e640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 0x55de7dc2e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc199b0 0x55de7dc31040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 -- 172.21.15.17:0/1721910658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc199b0 msgr2=0x55de7dc31040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc199b0 0x55de7dc31040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 -- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 msgr2=0x55de7dc2e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 0x55de7dc2e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3659c640 1 -- 172.21.15.17:0/1721910658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7dc31c40 con 0x55de7dc1a2d0 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.634+0000 7f6c3759e640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 0x55de7dc2e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3659c640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c20097c20 tx=0x7f6c2009b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc463c64dd732f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2009fb70 con 0x55de7dc1a2d0 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6c20097e30 con 0x55de7dc1a2d0 2024-09-16T01:07:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2009bec0 con 0x55de7dc1a2d0 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c200a4430 con 0x55de7dc1a2d0 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 10 client.15789 fetch_fsmap learned FSMap version 28 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de7dca4330 con 0x55de7dc1a2d0 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c2009bec0 con 0x55de7dc1a2d0 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c200afce0 con 0x55de7dc1a2d0 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:07:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 20 client.15789 populate_metadata read hostname 'smithi017' 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dca4a10 0x55de7dca6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 4 client.15789 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.635+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de7db85d70 con 0x55de7dca4a10 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.636+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dca4a10 0x55de7dca6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.636+0000 7f6c1e7fc640 10 client.15789 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.636+0000 7f6c36d9d640 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dca4a10 0x55de7dca6e30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b04c57af86f2e942 server_cookie=59069fd51fb5d622 in_seq=0 out_seq=0 2024-09-16T01:07:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c1e7fc640 1 -- 172.21.15.17:0/1721910658 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de7db85d70 con 0x55de7dca4a10 2024-09-16T01:07:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c1e7fc640 10 client.15789 handle_command_reply: tid=0 2024-09-16T01:07:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 client.15789 shutdown 2024-09-16T01:07:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 msgr2=0x55de7dc31580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c20097c20 tx=0x7f6c2009b300 comp rx=0 tx=0).stop 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 shutdown_connections 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55de7dca4a10 0x55de7dca6e30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55de7dc290c0 0x55de7dc2e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de7dc1a2d0 0x55de7dc31580 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 --2- 172.21.15.17:0/1721910658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55de7dc199b0 0x55de7dc31040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c1e7fc640 0 client.15789 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 >> 172.21.15.17:0/1721910658 conn(0x55de7dc16060 msgr2=0x55de7dc25fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 shutdown_connections 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 1 -- 172.21.15.17:0/1721910658 wait complete. 2024-09-16T01:07:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.651+0000 7f6c3feb9740 20 client.15789 trim_cache size 0 max 16384 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 msgr2=0x7f6c240a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 0x7f6c240a5920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c2800b390 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 msgr2=0x7f6c381987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d950 tx=0x7f6c2000de10 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 shutdown_connections 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6c240a3460 0x7f6c240a5920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c3810c110 0x7f6c3819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c381035e0 0x7f6c381987b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 --2- 172.21.15.17:0/1576908044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c38102cc0 0x7f6c38198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 >> 172.21.15.17:0/1576908044 conn(0x7f6c380fc6b0 msgr2=0x7f6c380fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 shutdown_connections 2024-09-16T01:07:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:07:54.652+0000 7f6c3d126640 1 -- 172.21.15.17:0/1576908044 wait complete. 2024-09-16T01:07:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:55 smithi017 ceph-mon[31211]: pgmap v169: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:55 smithi088 ceph-mon[34093]: pgmap v169: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:56.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:55 smithi154 ceph-mon[34759]: pgmap v169: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:07:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:57 smithi017 ceph-mon[31211]: pgmap v170: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:57 smithi088 ceph-mon[34093]: pgmap v170: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:58.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:57 smithi154 ceph-mon[34759]: pgmap v170: 97 pgs: 97 active+clean; 4.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-16T01:07:59.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:07:59 smithi017 ceph-mon[31211]: pgmap v171: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:08:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:07:59 smithi088 ceph-mon[34093]: pgmap v171: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:08:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:07:59 smithi154 ceph-mon[34759]: pgmap v171: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-16T01:08:01.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:01 smithi017 ceph-mon[31211]: pgmap v172: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:02.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:01 smithi088 ceph-mon[34093]: pgmap v172: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:01 smithi154 ceph-mon[34759]: pgmap v172: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:03 smithi017 ceph-mon[31211]: pgmap v173: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:03 smithi088 ceph-mon[34093]: pgmap v173: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:04.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:03 smithi154 ceph-mon[34759]: pgmap v173: 97 pgs: 97 active+clean; 4.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-09-16T01:08:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:05 smithi017 ceph-mon[31211]: pgmap v174: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-16T01:08:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:05 smithi088 ceph-mon[34093]: pgmap v174: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-16T01:08:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:05 smithi154 ceph-mon[34759]: pgmap v174: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-16T01:08:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 -- 172.21.15.17:0/3348528952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 msgr2=0x7f1a3010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3348528952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a3010e9a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009cd0 tx=0x7f1a2802a8e0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 -- 172.21.15.17:0/3348528952 shutdown_connections 2024-09-16T01:08:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3348528952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a3010e9a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3348528952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30101ad0 0x7f1a30101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3348528952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30107b70 0x7f1a30107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 -- 172.21.15.17:0/3348528952 >> 172.21.15.17:0/3348528952 conn(0x7f1a300fd7d0 msgr2=0x7f1a300ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 -- 172.21.15.17:0/3348528952 shutdown_connections 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.752+0000 7f1a379c4640 1 -- 172.21.15.17:0/3348528952 wait complete. 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 Processor -- start 2024-09-16T01:08:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 -- start start 2024-09-16T01:08:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30101ad0 0x7f1a30198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30107b70 0x7f1a3019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30111dd0 con 0x7f1a30102470 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30111c50 con 0x7f1a30101ad0 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a379c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30111f50 con 0x7f1a30107b70 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a35f61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30107b70 0x7f1a3019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43648/0 (socket says 172.21.15.17:43648) 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 -- 172.21.15.17:0/3506702636 learned_addr learned my addr 172.21.15.17:0/3506702636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a35760640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30101ad0 0x7f1a30198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 -- 172.21.15.17:0/3506702636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30107b70 msgr2=0x7f1a3019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30107b70 0x7f1a3019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 -- 172.21.15.17:0/3506702636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30101ad0 msgr2=0x7f1a30198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30101ad0 0x7f1a30198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.753+0000 7f1a34f5f640 1 -- 172.21.15.17:0/3506702636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3019d210 con 0x7f1a30102470 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000d770 tx=0x7f1a2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a267fc640 1 -- 172.21.15.17:0/3506702636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20017070 con 0x7f1a30102470 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a267fc640 1 -- 172.21.15.17:0/3506702636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a200054d0 con 0x7f1a30102470 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3019d500 con 0x7f1a30102470 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a267fc640 1 -- 172.21.15.17:0/3506702636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20004cf0 con 0x7f1a30102470 2024-09-16T01:08:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.754+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a4d90 con 0x7f1a30102470 2024-09-16T01:08:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 Processor -- start 2024-09-16T01:08:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a267fc640 1 -- 172.21.15.17:0/3506702636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1a20004e90 con 0x7f1a30102470 2024-09-16T01:08:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 -- start start 2024-09-16T01:08:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 0x55e679f38770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e679e922f0 con 0x55e679f38cb0 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e679e3a270 con 0x55e679f2e410 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e679e8e2b0 con 0x55e679f2daf0 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a35f61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a35f61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.17:40430/0 (socket says 172.21.15.17:40430) 2024-09-16T01:08:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43652/0 (socket says 172.21.15.17:43652) 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a35f61640 1 -- 172.21.15.17:0/3555348620 learned_addr learned my addr 172.21.15.17:0/3555348620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.757+0000 7f1a35760640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 0x55e679f38770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a267fc640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 0x7f1a1c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 -- 172.21.15.17:0/3555348620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 msgr2=0x55e679f38770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 0x55e679f38770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 -- 172.21.15.17:0/3555348620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 msgr2=0x55e679f3b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 -- 172.21.15.17:0/3555348620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e679e39340 con 0x55e679f2daf0 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35760640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 0x55e679f38770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a267fc640 1 -- 172.21.15.17:0/3506702636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1a200cf6b0 con 0x7f1a30102470 2024-09-16T01:08:07.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 0x7f1a1c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a35f61640 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009cd0 tx=0x7f1a28009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e1ed37f5b25beae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/3555348620 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28004b40 con 0x55e679f2daf0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/3555348620 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a28036040 con 0x55e679f2daf0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.758+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/3555348620 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280307e0 con 0x55e679f2daf0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 -- 172.21.15.17:0/3555348620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 msgr2=0x55e679f2ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a35f61640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 0x7f1a1c0a5920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a280317f0 tx=0x7f1a2804b000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009cd0 tx=0x7f1a28009a20 comp rx=0 tx=0).stop 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 -- 172.21.15.17:0/3555348620 shutdown_connections 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f38cb0 0x55e679f3b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f2e410 0x55e679f38770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/3555348620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f2ded0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 -- 172.21.15.17:0/3555348620 >> 172.21.15.17:0/3555348620 conn(0x55e679f2a060 msgr2=0x55e679f2a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 -- 172.21.15.17:0/3555348620 shutdown_connections 2024-09-16T01:08:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.759+0000 7f1a3a83f740 1 -- 172.21.15.17:0/3555348620 wait complete. 2024-09-16T01:08:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 -- start start 2024-09-16T01:08:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 Processor -- start 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f36640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e679f3b880 con 0x55e679f2e410 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e679e1b290 con 0x55e679f38cb0 2024-09-16T01:08:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e679f3ba00 con 0x55e679f2daf0 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a3a83f740 10 client.0 _ll_register_callbacks cb 0x55e679e4c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a34f5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43654/0 (socket says 172.21.15.17:43654) 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.760+0000 7f1a34f5f640 1 -- 172.21.15.17:0/566830008 learned_addr learned my addr 172.21.15.17:0/566830008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a35760640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a35f61640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f36640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 -- 172.21.15.17:0/566830008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 msgr2=0x55e679f35bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f35bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 -- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 msgr2=0x55e679f36640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f36640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 -- 172.21.15.17:0/566830008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e679ba5210 con 0x55e679f2e410 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a35760640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f35bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a35f61640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f36640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1a200cce90 tx=0x7f1a20005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e776a09e9dc681 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20020050 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1a200980e0 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a28036040 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a20097d10 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a3a83f740 10 client.15801 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e679c71620 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.761+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a28036040 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a200cfb60 con 0x55e679f2e410 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 10 client.15801 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 20 client.15801 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679f48c80 0x55e679f4b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 4 client.15801 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e679e9fa20 con 0x55e679f48c80 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.762+0000 7f1a35760640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679f48c80 0x55e679f4b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.763+0000 7f1a18ff9640 10 client.15801 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.763+0000 7f1a35760640 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679f48c80 0x55e679f4b070 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c8760d425cc663 server_cookie=c0537f37d23f824f in_seq=0 out_seq=0 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.763+0000 7f1a18ff9640 1 -- 172.21.15.17:0/566830008 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e679e9fa20 con 0x55e679f48c80 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.763+0000 7f1a18ff9640 10 client.15801 handle_command_reply: tid=0 2024-09-16T01:08:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.763+0000 7f1a3a83f740 1 client.15801 shutdown 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 msgr2=0x55e679f36100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1a200cce90 tx=0x7f1a20005740 comp rx=0 tx=0).stop 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 shutdown_connections 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679f48c80 0x55e679f4b070 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f36640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a18ff9640 0 client.15801 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2e410 0x55e679f36100 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/566830008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2daf0 0x55e679f35bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 >> 172.21.15.17:0/566830008 conn(0x55e679f2a060 msgr2=0x55e679f2fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 shutdown_connections 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 1 -- 172.21.15.17:0/566830008 wait complete. 2024-09-16T01:08:07.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.764+0000 7f1a3a83f740 20 client.15801 trim_cache size 0 max 16384 2024-09-16T01:08:07.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 Processor -- start 2024-09-16T01:08:07.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 -- start start 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f50930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f50e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ad5a0 con 0x55e679f2daf0 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301af0e0 con 0x55e679f38cb0 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301adc70 con 0x55e679f2e410 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43670/0 (socket says 172.21.15.17:43670) 2024-09-16T01:08:07.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 -- 172.21.15.17:0/624963546 learned_addr learned my addr 172.21.15.17:0/624963546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f50930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35f61640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f50e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 -- 172.21.15.17:0/624963546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 msgr2=0x55e679f50930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f50930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 -- 172.21.15.17:0/624963546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 msgr2=0x55e679f50e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f50e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.779+0000 7f1a35760640 1 -- 172.21.15.17:0/624963546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e679f4b6a0 con 0x55e679f2daf0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a35f61640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f50e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a35760640 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c20 tx=0x7f1a2c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ad354306545ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a1affd640 1 -- 172.21.15.17:0/624963546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c003e10 con 0x55e679f2daf0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a1affd640 1 -- 172.21.15.17:0/624963546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a2c01e8e0 con 0x55e679f2daf0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a1affd640 1 -- 172.21.15.17:0/624963546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c010b10 con 0x55e679f2daf0 2024-09-16T01:08:07.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a3a83f740 1 -- 172.21.15.17:0/624963546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 msgr2=0x55e679f36470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.780+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c20 tx=0x7f1a2c005f90 comp rx=0 tx=0).stop 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- 172.21.15.17:0/624963546 shutdown_connections 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f50e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f50930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/624963546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f36470 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- 172.21.15.17:0/624963546 >> 172.21.15.17:0/624963546 conn(0x55e679f2a060 msgr2=0x55e679f37c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- 172.21.15.17:0/624963546 shutdown_connections 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- 172.21.15.17:0/624963546 wait complete. 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- start start 2024-09-16T01:08:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 Processor -- start 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f32980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f32f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301aea10 con 0x55e679f2daf0 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ae340 con 0x55e679f38cb0 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.781+0000 7f1a3a83f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301ab580 con 0x55e679f2e410 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a3a83f740 10 client.0 _ll_register_callbacks cb 0x7f1a20009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43680/0 (socket says 172.21.15.17:43680) 2024-09-16T01:08:07.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 -- 172.21.15.17:0/2199602714 learned_addr learned my addr 172.21.15.17:0/2199602714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f32980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35f61640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f32f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 -- 172.21.15.17:0/2199602714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 msgr2=0x55e679f32980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f32980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 -- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 msgr2=0x55e679f32f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f32f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 -- 172.21.15.17:0/2199602714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e679f47870 con 0x55e679f2daf0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35f61640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f32f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f32980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a35760640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a010 tx=0x7f1a2c010540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9322d8a15e8556 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c003e10 con 0x55e679f2daf0 2024-09-16T01:08:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a2c01e8e0 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1a2c01e430 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a2c01e650 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a3a83f740 10 client.15807 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.782+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e679f2d920 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a2c01e8e0 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a2c03b750 con 0x55e679f2daf0 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 20 client.15807 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679fb3c70 0x55e679fb6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 4 client.15807 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e679e99d70 con 0x55e679fb3c70 2024-09-16T01:08:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679fb3c70 0x55e679fb6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a18ff9640 10 client.15807 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.783+0000 7f1a34f5f640 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679fb3c70 0x55e679fb6090 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf55e370e272618 server_cookie=8741ade2b4f98141 in_seq=0 out_seq=0 2024-09-16T01:08:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a18ff9640 1 -- 172.21.15.17:0/2199602714 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e679e99d70 con 0x55e679fb3c70 2024-09-16T01:08:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a18ff9640 10 client.15807 handle_command_reply: tid=0 2024-09-16T01:08:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a3a83f740 1 client.15807 shutdown 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 msgr2=0x55e679f41490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a010 tx=0x7f1a2c010540 comp rx=0 tx=0).stop 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 shutdown_connections 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.799+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e679fb3c70 0x55e679fb6090 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e679f38cb0 0x55e679f32f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e679f2e410 0x55e679f32980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 --2- 172.21.15.17:0/2199602714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e679f2daf0 0x55e679f41490 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a18ff9640 0 client.15807 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 >> 172.21.15.17:0/2199602714 conn(0x55e679f2a060 msgr2=0x55e679f289a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 shutdown_connections 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 1 -- 172.21.15.17:0/2199602714 wait complete. 2024-09-16T01:08:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a3a83f740 20 client.15807 trim_cache size 0 max 16384 2024-09-16T01:08:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:08:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:08:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:08:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 msgr2=0x7f1a1c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 0x7f1a1c0a5920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a280317f0 tx=0x7f1a2804b000 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 msgr2=0x7f1a30198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000d770 tx=0x7f1a2000dc30 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 shutdown_connections 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f1a1c0a3460 0x7f1a1c0a5920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a30107b70 0x7f1a3019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a30102470 0x7f1a30198760 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 --2- 172.21.15.17:0/3506702636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a30101ad0 0x7f1a30198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 >> 172.21.15.17:0/3506702636 conn(0x7f1a300fd7d0 msgr2=0x7f1a300fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 shutdown_connections 2024-09-16T01:08:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:07.800+0000 7f1a379c4640 1 -- 172.21.15.17:0/3506702636 wait complete. 2024-09-16T01:08:07.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:07 smithi017 ceph-mon[31211]: pgmap v175: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-16T01:08:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:07 smithi088 ceph-mon[34093]: pgmap v175: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-16T01:08:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:07 smithi154 ceph-mon[34759]: pgmap v175: 97 pgs: 97 active+clean; 4.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-16T01:08:09.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:09 smithi017 ceph-mon[31211]: pgmap v176: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 81 KiB/s wr, 40 op/s 2024-09-16T01:08:10.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:09 smithi088 ceph-mon[34093]: pgmap v176: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 81 KiB/s wr, 40 op/s 2024-09-16T01:08:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:09 smithi154 ceph-mon[34759]: pgmap v176: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 81 KiB/s wr, 40 op/s 2024-09-16T01:08:11.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:11 smithi017 ceph-mon[31211]: pgmap v177: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:11 smithi088 ceph-mon[34093]: pgmap v177: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:12.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:11 smithi154 ceph-mon[34759]: pgmap v177: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:13 smithi088 ceph-mon[34093]: pgmap v178: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:14.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:13 smithi154 ceph-mon[34759]: pgmap v178: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:14.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:13 smithi017 ceph-mon[31211]: pgmap v178: 97 pgs: 97 active+clean; 4.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-09-16T01:08:15.945 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:15 smithi088 ceph-mon[34093]: pgmap v179: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-09-16T01:08:15.956 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:15 smithi154 ceph-mon[34759]: pgmap v179: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-09-16T01:08:16.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:15 smithi017 ceph-mon[31211]: pgmap v179: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-09-16T01:08:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:17 smithi088 ceph-mon[34093]: pgmap v180: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:18.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:17 smithi154 ceph-mon[34759]: pgmap v180: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:18.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:17 smithi017 ceph-mon[31211]: pgmap v180: 97 pgs: 97 active+clean; 4.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:20.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:19 smithi088 ceph-mon[34093]: pgmap v181: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:08:20.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:19 smithi154 ceph-mon[34759]: pgmap v181: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:08:20.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:19 smithi017 ceph-mon[31211]: pgmap v181: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:08:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 -- 172.21.15.17:0/262173567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 msgr2=0x7fddcc10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 --2- 172.21.15.17:0/262173567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc10bac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009900 tx=0x7fddbc02a480 comp rx=0 tx=0).stop 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 -- 172.21.15.17:0/262173567 shutdown_connections 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 --2- 172.21.15.17:0/262173567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc10c110 0x7fddcc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 --2- 172.21.15.17:0/262173567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc10bac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 --2- 172.21.15.17:0/262173567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc102cc0 0x7fddcc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.902+0000 7fddd3d42640 1 -- 172.21.15.17:0/262173567 >> 172.21.15.17:0/262173567 conn(0x7fddcc0fc6b0 msgr2=0x7fddcc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- 172.21.15.17:0/262173567 shutdown_connections 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- 172.21.15.17:0/262173567 wait complete. 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 Processor -- start 2024-09-16T01:08:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- start start 2024-09-16T01:08:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc102cc0 0x7fddcc198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc10c110 0x7fddcc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc111df0 con 0x7fddcc1035e0 2024-09-16T01:08:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc111c70 con 0x7fddcc102cc0 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.903+0000 7fddd3d42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc111f70 con 0x7fddcc10c110 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41594/0 (socket says 172.21.15.17:41594) 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 -- 172.21.15.17:0/3337926038 learned_addr learned my addr 172.21.15.17:0/3337926038 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd1ade640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc102cc0 0x7fddcc198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd22df640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc10c110 0x7fddcc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 -- 172.21.15.17:0/3337926038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc10c110 msgr2=0x7fddcc19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc10c110 0x7fddcc19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 -- 172.21.15.17:0/3337926038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc102cc0 msgr2=0x7fddcc198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc102cc0 0x7fddcc198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 -- 172.21.15.17:0/3337926038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc19d370 con 0x7fddcc1035e0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fddbc005ab0 tx=0x7fddbc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddc2ffd640 1 -- 172.21.15.17:0/3337926038 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc03f070 con 0x7fddcc1035e0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc19d600 con 0x7fddcc1035e0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.904+0000 7fddc2ffd640 1 -- 172.21.15.17:0/3337926038 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddbc031d60 con 0x7fddcc1035e0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.905+0000 7fddc2ffd640 1 -- 172.21.15.17:0/3337926038 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc035030 con 0x7fddcc1035e0 2024-09-16T01:08:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.905+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1a4ef0 con 0x7fddcc1035e0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.907+0000 7fddc2ffd640 1 -- 172.21.15.17:0/3337926038 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fddbc042070 con 0x7fddcc1035e0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.907+0000 7fddd6ad8740 1 Processor -- start 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 -- start start 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be68ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be69c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5558be5ef2f0 con 0x5558be68b2d0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5558be597270 con 0x5558be69a0c0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558be5eb2b0 con 0x5558be68a9b0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41610/0 (socket says 172.21.15.17:41610) 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 -- 172.21.15.17:0/1289444171 learned_addr learned my addr 172.21.15.17:0/1289444171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddc2ffd640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 0x7fddb80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd12dd640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be69c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd22df640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be68ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd22df640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 0x7fddb80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddc2ffd640 1 -- 172.21.15.17:0/3337926038 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fddbc0f0160 con 0x7fddcc1035e0 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 -- 172.21.15.17:0/1289444171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 msgr2=0x5558be68ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be68ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 -- 172.21.15.17:0/1289444171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 msgr2=0x5558be69c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be69c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd1ade640 1 -- 172.21.15.17:0/1289444171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558be596340 con 0x5558be68b2d0 2024-09-16T01:08:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.908+0000 7fddd22df640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be68ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.909+0000 7fddd1ade640 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fddc800b760 tx=0x7fddc800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4588b36f8d573aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.909+0000 7fddd22df640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 0x7fddb80a5920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009fd0 tx=0x7fddc40096a0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.909+0000 7fddb7fff640 1 -- 172.21.15.17:0/1289444171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003dd0 con 0x5558be68b2d0 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.909+0000 7fddb7fff640 1 -- 172.21.15.17:0/1289444171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddc8015070 con 0x5558be68b2d0 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.909+0000 7fddb7fff640 1 -- 172.21.15.17:0/1289444171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8004d90 con 0x5558be68b2d0 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1289444171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 msgr2=0x5558be699b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fddc800b760 tx=0x7fddc800bc20 comp rx=0 tx=0).stop 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1289444171 shutdown_connections 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be69c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be699b80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1289444171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be68ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1289444171 >> 172.21.15.17:0/1289444171 conn(0x5558be687060 msgr2=0x5558be687440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1289444171 shutdown_connections 2024-09-16T01:08:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1289444171 wait complete. 2024-09-16T01:08:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 -- start start 2024-09-16T01:08:20.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.910+0000 7fddd6ad8740 1 Processor -- start 2024-09-16T01:08:20.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be697030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be697ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5558be69cc90 con 0x5558be68b2d0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5558be578290 con 0x5558be69a0c0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5558be69ce10 con 0x5558be68a9b0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd6ad8740 10 client.0 _ll_register_callbacks cb 0x5558be5a9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41618/0 (socket says 172.21.15.17:41618) 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 -- 172.21.15.17:0/983747943 learned_addr learned my addr 172.21.15.17:0/983747943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd22df640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be697ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd1ade640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be697030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 -- 172.21.15.17:0/983747943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 msgr2=0x5558be697030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be697030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 -- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 msgr2=0x5558be697ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be697ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 -- 172.21.15.17:0/983747943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558be302210 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd22df640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be697ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddd12dd640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0b8920 tx=0x7fddbc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6ec6d47dc6917e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.911+0000 7fddb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc049040 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fddbc0d5280 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc8015070 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddbc0c5080 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 10 client.15819 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558be3ce620 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddc8015070 con 0x5558be68b2d0 2024-09-16T01:08:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fddbc0edb00 con 0x5558be68b2d0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 10 client.15819 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 20 client.15819 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be6aa0a0 0x5558be6ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 4 client.15819 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.912+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558be5fca20 con 0x5558be6aa0a0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.913+0000 7fddd1ade640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be6aa0a0 0x5558be6ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.913+0000 7fddd1ade640 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be6aa0a0 0x5558be6ac490 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541d2b1e3d806f32 server_cookie=3d2048edb0a7a0cc in_seq=0 out_seq=0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.913+0000 7fddb57fa640 10 client.15819 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddb57fa640 1 -- 172.21.15.17:0/983747943 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558be5fca20 con 0x5558be6aa0a0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddb57fa640 10 client.15819 handle_command_reply: tid=0 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 client.15819 shutdown 2024-09-16T01:08:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 msgr2=0x5558be697570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0b8920 tx=0x7fddbc009260 comp rx=0 tx=0).stop 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 shutdown_connections 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be6aa0a0 0x5558be6ac490 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be69a0c0 0x5558be697ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be697570 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/983747943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be68a9b0 0x5558be697030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddb57fa640 0 client.15819 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 >> 172.21.15.17:0/983747943 conn(0x5558be687060 msgr2=0x5558be68cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 shutdown_connections 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 1 -- 172.21.15.17:0/983747943 wait complete. 2024-09-16T01:08:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.914+0000 7fddd6ad8740 20 client.15819 trim_cache size 0 max 16384 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 Processor -- start 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 -- start start 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68a9b0 0x5558be6b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be694290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1ab3f0 con 0x5558be68b2d0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1acf30 con 0x5558be68a9b0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1abac0 con 0x5558be69a0c0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41622/0 (socket says 172.21.15.17:41622) 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 -- 172.21.15.17:0/1398418964 learned_addr learned my addr 172.21.15.17:0/1398418964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd1ade640 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68a9b0 0x5558be6b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd22df640 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be694290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 -- 172.21.15.17:0/1398418964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 msgr2=0x5558be694290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be694290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 -- 172.21.15.17:0/1398418964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68a9b0 msgr2=0x5558be6b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68a9b0 0x5558be6b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.929+0000 7fddd12dd640 1 -- 172.21.15.17:0/1398418964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558be695fc0 con 0x5558be68b2d0 2024-09-16T01:08:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd12dd640 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000c00 tx=0x7fddbc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac6cef95962d3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddb77fe640 1 -- 172.21.15.17:0/1398418964 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc049070 con 0x5558be68b2d0 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddb77fe640 1 -- 172.21.15.17:0/1398418964 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddbc0edb00 con 0x5558be68b2d0 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddb77fe640 1 -- 172.21.15.17:0/1398418964 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0d5380 con 0x5558be68b2d0 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1398418964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 msgr2=0x5558be6b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000c00 tx=0x7fddbc02a480 comp rx=0 tx=0).stop 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1398418964 shutdown_connections 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be694290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68b2d0 0x5558be6b22b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/1398418964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68a9b0 0x5558be6b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.930+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1398418964 >> 172.21.15.17:0/1398418964 conn(0x5558be687060 msgr2=0x5558be6990b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.931+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1398418964 shutdown_connections 2024-09-16T01:08:20.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.931+0000 7fddd6ad8740 1 -- 172.21.15.17:0/1398418964 wait complete. 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.931+0000 7fddd6ad8740 1 -- start start 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.931+0000 7fddd6ad8740 1 Processor -- start 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68b2d0 0x5558be6a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be69f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1ac860 con 0x5558be68a9b0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1ac190 con 0x5558be68b2d0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc1a93d0 con 0x5558be69a0c0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd6ad8740 10 client.0 _ll_register_callbacks cb 0x7fddbc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41624/0 (socket says 172.21.15.17:41624) 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 -- 172.21.15.17:0/3006826258 learned_addr learned my addr 172.21.15.17:0/3006826258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd22df640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be69f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68b2d0 0x5558be6a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 -- 172.21.15.17:0/3006826258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 msgr2=0x5558be69f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be69f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 -- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68b2d0 msgr2=0x5558be6a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68b2d0 0x5558be6a25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 -- 172.21.15.17:0/3006826258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558be68b100 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddd1ade640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fddc80039c0 tx=0x7fddc8004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1079eb18268b8f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.932+0000 7fddb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8011640 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddbc0edb00 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fddc80117e0 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddc8003e60 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558be715300 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddbc0edb00 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fddc80378c0 con 0x5558be68a9b0 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 20 client.15825 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be715750 0x5558be717b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 4 client.15825 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558be5f6d70 con 0x5558be715750 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.933+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be715750 0x5558be717b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.934+0000 7fddb57fa640 10 client.15825 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.934+0000 7fddd12dd640 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be715750 0x5558be717b70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4545159ce008a263 server_cookie=326753fc71d9337d in_seq=0 out_seq=0 2024-09-16T01:08:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddb57fa640 1 -- 172.21.15.17:0/3006826258 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558be5f6d70 con 0x5558be715750 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddb57fa640 10 client.15825 handle_command_reply: tid=0 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 client.15825 shutdown 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 msgr2=0x5558be6a20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fddc80039c0 tx=0x7fddc8004640 comp rx=0 tx=0).stop 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 shutdown_connections 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5558be715750 0x5558be717b70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5558be69a0c0 0x5558be69f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5558be68b2d0 0x5558be6a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 --2- 172.21.15.17:0/3006826258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5558be68a9b0 0x5558be6a20a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddb57fa640 0 client.15825 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 >> 172.21.15.17:0/3006826258 conn(0x5558be687060 msgr2=0x5558be6859a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 shutdown_connections 2024-09-16T01:08:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 1 -- 172.21.15.17:0/3006826258 wait complete. 2024-09-16T01:08:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd6ad8740 20 client.15825 trim_cache size 0 max 16384 2024-09-16T01:08:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:08:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:08:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:08:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 msgr2=0x7fddb80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 0x7fddb80a5920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009fd0 tx=0x7fddc40096a0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 msgr2=0x7fddcc1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fddbc005ab0 tx=0x7fddbc003c80 comp rx=0 tx=0).stop 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 shutdown_connections 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddb80a3460 0x7fddb80a5920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddcc10c110 0x7fddcc19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddcc1035e0 0x7fddcc1988c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 --2- 172.21.15.17:0/3337926038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddcc102cc0 0x7fddcc198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.950+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 >> 172.21.15.17:0/3337926038 conn(0x7fddcc0fc6b0 msgr2=0x7fddcc0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.951+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 shutdown_connections 2024-09-16T01:08:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:20.951+0000 7fddd3d42640 1 -- 172.21.15.17:0/3337926038 wait complete. 2024-09-16T01:08:22.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:21 smithi088 ceph-mon[34093]: pgmap v182: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:22.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:21 smithi154 ceph-mon[34759]: pgmap v182: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:22.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:21 smithi017 ceph-mon[31211]: pgmap v182: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:24.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:23 smithi088 ceph-mon[34093]: pgmap v183: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:24.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:23 smithi154 ceph-mon[34759]: pgmap v183: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:24.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:23 smithi017 ceph-mon[31211]: pgmap v183: 97 pgs: 97 active+clean; 4.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:08:26.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:25 smithi088 ceph-mon[34093]: pgmap v184: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:26.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:25 smithi154 ceph-mon[34759]: pgmap v184: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:26.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:25 smithi017 ceph-mon[31211]: pgmap v184: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:28.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:27 smithi088 ceph-mon[34093]: pgmap v185: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:28.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:27 smithi154 ceph-mon[34759]: pgmap v185: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:28.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:27 smithi017 ceph-mon[31211]: pgmap v185: 97 pgs: 97 active+clean; 5.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:30.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:29 smithi088 ceph-mon[34093]: pgmap v186: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:30.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:29 smithi154 ceph-mon[34759]: pgmap v186: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:30.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:29 smithi017 ceph-mon[31211]: pgmap v186: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:31.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:30 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:08:31.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:30 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:08:31.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:30 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:08:32.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:31 smithi088 ceph-mon[34093]: pgmap v187: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:32.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:31 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:08:32.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:31 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:08:32.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:31 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:08:32.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:31 smithi154 ceph-mon[34759]: pgmap v187: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:32.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:31 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:08:32.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:31 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:08:32.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:31 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:08:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:31 smithi017 ceph-mon[31211]: pgmap v187: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:31 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:08:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:31 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:08:32.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:31 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.049+0000 7f66908a5640 1 -- 172.21.15.17:0/558880583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 msgr2=0x7f668c10e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.049+0000 7f66908a5640 1 --2- 172.21.15.17:0/558880583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c10e9b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6684009cd0 tx=0x7f668402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 -- 172.21.15.17:0/558880583 shutdown_connections 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 --2- 172.21.15.17:0/558880583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c10e9b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 --2- 172.21.15.17:0/558880583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c101ae0 0x7f668c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 --2- 172.21.15.17:0/558880583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c107b80 0x7f668c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 -- 172.21.15.17:0/558880583 >> 172.21.15.17:0/558880583 conn(0x7f668c0fd7e0 msgr2=0x7f668c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 -- 172.21.15.17:0/558880583 shutdown_connections 2024-09-16T01:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.050+0000 7f66908a5640 1 -- 172.21.15.17:0/558880583 wait complete. 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 Processor -- start 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 -- start start 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c101ae0 0x7f668c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c107b80 0x7f668c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f668c111de0 con 0x7f668c102480 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f668c111c60 con 0x7f668c107b80 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f66908a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f668c111f60 con 0x7f668c101ae0 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36634/0 (socket says 172.21.15.17:36634) 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 -- 172.21.15.17:0/1695376552 learned_addr learned my addr 172.21.15.17:0/1695376552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f668a59c640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c101ae0 0x7f668c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f668ad9d640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c107b80 0x7f668c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 -- 172.21.15.17:0/1695376552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c101ae0 msgr2=0x7f668c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c101ae0 0x7f668c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 -- 172.21.15.17:0/1695376552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c107b80 msgr2=0x7f668c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c107b80 0x7f668c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.051+0000 7f6689d9b640 1 -- 172.21.15.17:0/1695376552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c1a6710 con 0x7f668c102480 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f6689d9b640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f668000d950 tx=0x7f668000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f667b7fe640 1 -- 172.21.15.17:0/1695376552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680017030 con 0x7f668c102480 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f667b7fe640 1 -- 172.21.15.17:0/1695376552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6680004020 con 0x7f668c102480 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c1a6a00 con 0x7f668c102480 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f667b7fe640 1 -- 172.21.15.17:0/1695376552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800047a0 con 0x7f668c102480 2024-09-16T01:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.052+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c1a6fa0 con 0x7f668c102480 2024-09-16T01:08:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.054+0000 7f667b7fe640 1 -- 172.21.15.17:0/1695376552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f66800041d0 con 0x7f668c102480 2024-09-16T01:08:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.054+0000 7f6693643740 1 Processor -- start 2024-09-16T01:08:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 -- start start 2024-09-16T01:08:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa008770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa00b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ba9f622f0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x564ba9f0a270 con 0x564baa008cb0 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6693643740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564ba9f5e2b0 con 0x564ba9ffe410 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f668ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f668ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36642/0 (socket says 172.21.15.17:36642) 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f668ad9d640 1 -- 172.21.15.17:0/831260646 learned_addr learned my addr 172.21.15.17:0/831260646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f667b7fe640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 0x7f66740a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f668a59c640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f6689d9b640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa00b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f668ad9d640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 0x7f66740a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.055+0000 7f667b7fe640 1 -- 172.21.15.17:0/1695376552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f66800cf6b0 con 0x7f668c102480 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 -- 172.21.15.17:0/831260646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 msgr2=0x564baa008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 -- 172.21.15.17:0/831260646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 msgr2=0x564baa00b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa00b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 -- 172.21.15.17:0/831260646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba9f09340 con 0x564ba9ffdaf0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f6689d9b640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa00b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668a59c640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa008770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f668ad9d640 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6684005e10 tx=0x7f6684031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387a28acd621063d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f6678ff9640 1 -- 172.21.15.17:0/831260646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684004610 con 0x564ba9ffdaf0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f6678ff9640 1 -- 172.21.15.17:0/831260646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6684050070 con 0x564ba9ffdaf0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.056+0000 7f6678ff9640 1 -- 172.21.15.17:0/831260646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684030d70 con 0x564ba9ffdaf0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- 172.21.15.17:0/831260646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 msgr2=0x564ba9ffded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6684005e10 tx=0x7f6684031a00 comp rx=0 tx=0).stop 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f668ad9d640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 0x7f66740a59a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f668404f000 tx=0x7f668404d000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- 172.21.15.17:0/831260646 shutdown_connections 2024-09-16T01:08:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa00b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa008770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 --2- 172.21.15.17:0/831260646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564ba9ffded0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- 172.21.15.17:0/831260646 >> 172.21.15.17:0/831260646 conn(0x564ba9ffa060 msgr2=0x564ba9ffa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- 172.21.15.17:0/831260646 shutdown_connections 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- 172.21.15.17:0/831260646 wait complete. 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 -- start start 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.057+0000 7f6693643740 1 Processor -- start 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564baa00b880 con 0x564baa008cb0 2024-09-16T01:08:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x564ba9eeb290 con 0x564ba9ffdaf0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564baa00ba00 con 0x564ba9ffe410 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6693643740 10 client.0 _ll_register_callbacks cb 0x564ba9f1c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36650/0 (socket says 172.21.15.17:36650) 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 -- 172.21.15.17:0/168439056 learned_addr learned my addr 172.21.15.17:0/168439056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668a59c640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f6689d9b640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 -- 172.21.15.17:0/168439056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 msgr2=0x564baa006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 -- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 msgr2=0x564baa005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.058+0000 7f668ad9d640 1 -- 172.21.15.17:0/168439056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba9c75210 con 0x564baa008cb0 2024-09-16T01:08:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f668ad9d640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6684033040 tx=0x7f66840307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae85b312dd4b3cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684004620 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6684050070 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f66840047c0 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f668404b560 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 10 client.15837 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564ba9d41620 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6684050070 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6684030070 con 0x564baa008cb0 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 10 client.15837 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 20 client.15837 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa0189b0 0x564baa01ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 4 client.15837 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.059+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ba9f6fa20 con 0x564baa0189b0 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.060+0000 7f668a59c640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa0189b0 0x564baa01ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.060+0000 7f6671ffb640 10 client.15837 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.060+0000 7f668a59c640 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa0189b0 0x564baa01ada0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac52efc840af65c3 server_cookie=e650d6a2f1373280 in_seq=0 out_seq=0 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6671ffb640 1 -- 172.21.15.17:0/168439056 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ba9f6fa20 con 0x564baa0189b0 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6671ffb640 10 client.15837 handle_command_reply: tid=0 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 client.15837 shutdown 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 msgr2=0x564baa006540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6684033040 tx=0x7f66840307d0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 shutdown_connections 2024-09-16T01:08:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa0189b0 0x564baa01ada0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564baa008cb0 0x564baa006540 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 --2- 172.21.15.17:0/168439056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa005ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6671ffb640 0 client.15837 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 >> 172.21.15.17:0/168439056 conn(0x564ba9ffa060 msgr2=0x564ba9fffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 shutdown_connections 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 1 -- 172.21.15.17:0/168439056 wait complete. 2024-09-16T01:08:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.061+0000 7f6693643740 20 client.15837 trim_cache size 0 max 16384 2024-09-16T01:08:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 Processor -- start 2024-09-16T01:08:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 -- start start 2024-09-16T01:08:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa004370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 0x564baa01ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1af850 con 0x564ba9ffe410 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1b1390 con 0x564ba9ffdaf0 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6693643740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1aff20 con 0x564baa008cb0 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6689d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6689d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36660/0 (socket says 172.21.15.17:36660) 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f6689d9b640 1 -- 172.21.15.17:0/3485481988 learned_addr learned my addr 172.21.15.17:0/3485481988 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.076+0000 7f668a59c640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f668ad9d640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 0x564baa01ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 -- 172.21.15.17:0/3485481988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 msgr2=0x564baa01ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 0x564baa01ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 -- 172.21.15.17:0/3485481988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 msgr2=0x564baa004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 -- 172.21.15.17:0/3485481988 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba9ffd870 con 0x564ba9ffe410 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f668ad9d640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 0x564baa01ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f668009b660 tx=0x7f668006d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40e1e8be5b94ed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6673fff640 1 -- 172.21.15.17:0/3485481988 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668009fd10 con 0x564ba9ffe410 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6673fff640 1 -- 172.21.15.17:0/3485481988 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66800a45d0 con 0x564ba9ffe410 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.077+0000 7f6673fff640 1 -- 172.21.15.17:0/3485481988 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680009a30 con 0x564ba9ffe410 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- 172.21.15.17:0/3485481988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 msgr2=0x564baa006370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f668009b660 tx=0x7f668006d6e0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- 172.21.15.17:0/3485481988 shutdown_connections 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564baa008cb0 0x564baa01ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffe410 0x564baa006370 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- 172.21.15.17:0/3485481988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ba9ffdaf0 0x564baa004370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- 172.21.15.17:0/3485481988 >> 172.21.15.17:0/3485481988 conn(0x564ba9ffa060 msgr2=0x564baa007b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- 172.21.15.17:0/3485481988 shutdown_connections 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- 172.21.15.17:0/3485481988 wait complete. 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- start start 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 Processor -- start 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa01b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa01bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1b0cc0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1b05f0 con 0x564baa008cb0 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.078+0000 7f6693643740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1ad830 con 0x564ba9ffe410 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6693643740 10 client.0 _ll_register_callbacks cb 0x7f6684030e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36674/0 (socket says 172.21.15.17:36674) 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 -- 172.21.15.17:0/3131116590 learned_addr learned my addr 172.21.15.17:0/3131116590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa01b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668ad9d640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa01bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 -- 172.21.15.17:0/3131116590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 msgr2=0x564baa01b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa01b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 -- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 msgr2=0x564baa01bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa01bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 -- 172.21.15.17:0/3131116590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564baa01c270 con 0x564ba9ffdaf0 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa01b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668ad9d640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa01bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f668a59c640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x564baa00ba40 tx=0x7f667c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3685775f0eaad9af server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c005220 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f667c0053c0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66800a45d0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f667c003e90 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6693643740 10 client.15843 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.079+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564baa0830e0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66800a45d0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f667c0267a0 con 0x564ba9ffdaf0 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 20 client.15843 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa083830 0x564baa085c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 4 client.15843 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:08:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ba9f69d70 con 0x564baa083830 2024-09-16T01:08:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.080+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa083830 0x564baa085c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.081+0000 7f6671ffb640 10 client.15843 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.081+0000 7f6689d9b640 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa083830 0x564baa085c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1994937a6ca4a16 server_cookie=d1745c3896d6f92b in_seq=0 out_seq=0 2024-09-16T01:08:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6671ffb640 1 -- 172.21.15.17:0/3131116590 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ba9f69d70 con 0x564baa083830 2024-09-16T01:08:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6671ffb640 10 client.15843 handle_command_reply: tid=0 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 client.15843 shutdown 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 msgr2=0x564baa01e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x564baa00ba40 tx=0x7f667c00bf50 comp rx=0 tx=0).stop 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 shutdown_connections 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564baa083830 0x564baa085c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564baa008cb0 0x564baa01bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564ba9ffe410 0x564baa01b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6671ffb640 0 client.15843 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 --2- 172.21.15.17:0/3131116590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ba9ffdaf0 0x564baa01e380 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 >> 172.21.15.17:0/3131116590 conn(0x564ba9ffa060 msgr2=0x564baa013c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 shutdown_connections 2024-09-16T01:08:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 1 -- 172.21.15.17:0/3131116590 wait complete. 2024-09-16T01:08:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f6693643740 20 client.15843 trim_cache size 0 max 16384 2024-09-16T01:08:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:08:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:08:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:08:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 msgr2=0x7f66740a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 0x7f66740a59a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f668404f000 tx=0x7f668404d000 comp rx=0 tx=0).stop 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 msgr2=0x7f668c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f668000d950 tx=0x7f668000de10 comp rx=0 tx=0).stop 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 shutdown_connections 2024-09-16T01:08:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f66740a34e0 0x7f66740a59a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668c107b80 0x7f668c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f668c102480 0x7f668c074a30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 --2- 172.21.15.17:0/1695376552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f668c101ae0 0x7f668c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 >> 172.21.15.17:0/1695376552 conn(0x7f668c0fd7e0 msgr2=0x7f668c0feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 shutdown_connections 2024-09-16T01:08:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:34.099+0000 7f66908a5640 1 -- 172.21.15.17:0/1695376552 wait complete. 2024-09-16T01:08:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:33 smithi088 ceph-mon[34093]: pgmap v188: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:33 smithi154 ceph-mon[34759]: pgmap v188: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:34.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:33 smithi017 ceph-mon[31211]: pgmap v188: 97 pgs: 97 active+clean; 5.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:35 smithi088 ceph-mon[34093]: pgmap v189: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:36.157 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:35 smithi154 ceph-mon[34759]: pgmap v189: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:36.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:35 smithi017 ceph-mon[31211]: pgmap v189: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:37 smithi088 ceph-mon[34093]: pgmap v190: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-16T01:08:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:37 smithi154 ceph-mon[34759]: pgmap v190: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-16T01:08:38.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:37 smithi017 ceph-mon[31211]: pgmap v190: 97 pgs: 97 active+clean; 5.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-16T01:08:40.131 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.131 INFO:tasks.workunit.client.0.smithi017.stdout:251/600: open fd = 3 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:252/600: open fd = 3 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:253/600: open fd = 3 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.132 INFO:tasks.workunit.client.0.smithi017.stdout:254/600: open fd = 3 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:255/600: open fd = 3 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:256/600: open fd = 3 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.133 INFO:tasks.workunit.client.0.smithi017.stdout:257/600: open fd = 3 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:258/600: open fd = 3 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:259/600: open fd = 3 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:260/600: open fd = 3 2024-09-16T01:08:40.134 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:261/600: open fd = 3 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:262/600: open fd = 3 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:263/600: open fd = 3 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.135 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:264/600: open fd = 3 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:265/600: open fd = 3 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:266/600: open fd = 3 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:267/600: open fd = 3 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:268/600: open fd = 3 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.137 INFO:tasks.workunit.client.0.smithi017.stdout:269/600: open fd = 3 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:270/600: open fd = 3 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:271/600: open fd = 3 2024-09-16T01:08:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:272/600: open fd = 3 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:273/600: open fd = 3 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:274/600: open fd = 3 2024-09-16T01:08:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:275/600: open fd = 3 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:276/600: open fd = 3 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:277/600: open fd = 3 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:278/600: open fd = 3 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:279/600: open fd = 3 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:280/600: open fd = 3 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:281/600: open fd = 3 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.142 INFO:tasks.workunit.client.0.smithi017.stdout:282/600: open fd = 3 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:283/600: open fd = 3 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:284/600: open fd = 3 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.143 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:285/600: open fd = 3 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:286/600: open fd = 3 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:287/600: open fd = 3 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:288/600: open fd = 3 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:289/600: open fd = 3 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:290/600: open fd = 3 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:291/600: open fd = 3 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.146 INFO:tasks.workunit.client.0.smithi017.stdout:292/600: open fd = 3 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:293/600: open fd = 3 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:294/600: open fd = 3 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.147 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:295/600: open fd = 3 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:296/600: open fd = 3 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:297/600: open fd = 3 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.148 INFO:tasks.workunit.client.0.smithi017.stdout:298/600: open fd = 3 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:299/600: open fd = 3 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:300/600: open fd = 3 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:301/600: open fd = 3 2024-09-16T01:08:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:302/600: open fd = 3 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:303/600: open fd = 3 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:304/600: open fd = 3 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.150 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:305/600: open fd = 3 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:306/600: open fd = 3 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.151 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:307/600: open fd = 3 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:308/600: open fd = 3 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:309/600: open fd = 3 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.152 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:310/600: open fd = 3 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:311/600: open fd = 3 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:312/600: open fd = 3 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.153 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:08:40.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:39 smithi154 ceph-mon[34759]: pgmap v191: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:40.154 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:39 smithi088 ceph-mon[34093]: pgmap v191: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:40.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:39 smithi017 ceph-mon[31211]: pgmap v191: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:41 smithi088 ceph-mon[34093]: pgmap v192: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:42.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:41 smithi154 ceph-mon[34759]: pgmap v192: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:42.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:41 smithi017 ceph-mon[31211]: pgmap v192: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:44.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:43 smithi088 ceph-mon[34093]: pgmap v193: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:44.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:43 smithi154 ceph-mon[34759]: pgmap v193: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:44.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:43 smithi017 ceph-mon[31211]: pgmap v193: 97 pgs: 97 active+clean; 1.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:08:46.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:45 smithi088 ceph-mon[34093]: pgmap v194: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:46.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:45 smithi154 ceph-mon[34759]: pgmap v194: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:46.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:45 smithi017 ceph-mon[31211]: pgmap v194: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-16T01:08:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 -- 172.21.15.17:0/2871143141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 msgr2=0x7eff88100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 --2- 172.21.15.17:0/2871143141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff88100e10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7eff78009930 tx=0x7eff7802a420 comp rx=0 tx=0).stop 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 -- 172.21.15.17:0/2871143141 shutdown_connections 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 --2- 172.21.15.17:0/2871143141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff88101350 0x7eff8810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 --2- 172.21.15.17:0/2871143141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff88100e10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 --2- 172.21.15.17:0/2871143141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff881069c0 0x7eff88106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 -- 172.21.15.17:0/2871143141 >> 172.21.15.17:0/2871143141 conn(0x7eff88077990 msgr2=0x7eff880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 -- 172.21.15.17:0/2871143141 shutdown_connections 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.199+0000 7eff906a6640 1 -- 172.21.15.17:0/2871143141 wait complete. 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 Processor -- start 2024-09-16T01:08:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 -- start start 2024-09-16T01:08:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88101350 0x7eff880fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff881069c0 0x7eff880fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110cb0 con 0x7eff881009b0 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110b30 con 0x7eff88101350 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.200+0000 7eff906a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110e30 con 0x7eff881069c0 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51540/0 (socket says 172.21.15.17:51540) 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 -- 172.21.15.17:0/3938758741 learned_addr learned my addr 172.21.15.17:0/3938758741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8dc41640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88101350 0x7eff880fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8ec43640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff881069c0 0x7eff880fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 -- 172.21.15.17:0/3938758741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff881069c0 msgr2=0x7eff880fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff881069c0 0x7eff880fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 -- 172.21.15.17:0/3938758741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88101350 msgr2=0x7eff880fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88101350 0x7eff880fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 -- 172.21.15.17:0/3938758741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff881a67f0 con 0x7eff881009b0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff8e442640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e9f0 tx=0x7eff8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff7f7fe640 1 -- 172.21.15.17:0/3938758741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8400cd80 con 0x7eff881009b0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff7f7fe640 1 -- 172.21.15.17:0/3938758741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff840108e0 con 0x7eff881009b0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff7f7fe640 1 -- 172.21.15.17:0/3938758741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84018920 con 0x7eff881009b0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff881a6ae0 con 0x7eff881009b0 2024-09-16T01:08:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.201+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff881a6fb0 con 0x7eff881009b0 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff7f7fe640 1 -- 172.21.15.17:0/3938758741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7eff84010a90 con 0x7eff881009b0 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 Processor -- start 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 -- start start 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f707f692f0 con 0x55f708004af0 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55f707f11270 con 0x55f708005410 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.204+0000 7eff9343a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f707f652b0 con 0x55f70800fcb0 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51542/0 (socket says 172.21.15.17:51542) 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 -- 172.21.15.17:0/2801794616 learned_addr learned my addr 172.21.15.17:0/2801794616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8e442640 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8dc41640 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 -- 172.21.15.17:0/2801794616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 msgr2=0x55f7080120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 -- 172.21.15.17:0/2801794616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 msgr2=0x55f70800f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 -- 172.21.15.17:0/2801794616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f707f10340 con 0x55f708004af0 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff7f7fe640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 0x7eff740a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fd0 tx=0x7eff800118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcef84312dfc332 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff8e442640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 0x7eff740a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.205+0000 7eff7f7fe640 1 -- 172.21.15.17:0/3938758741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7eff840cfed0 con 0x7eff881009b0 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff7cff9640 1 -- 172.21.15.17:0/2801794616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80004d20 con 0x55f708004af0 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff7cff9640 1 -- 172.21.15.17:0/2801794616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff80004050 con 0x55f708004af0 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff7cff9640 1 -- 172.21.15.17:0/2801794616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80005280 con 0x55f708004af0 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 -- 172.21.15.17:0/2801794616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 msgr2=0x55f708004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff8e442640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 0x7eff740a59a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff840cd700 tx=0x7eff840d3a20 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fd0 tx=0x7eff800118d0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 -- 172.21.15.17:0/2801794616 shutdown_connections 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 --2- 172.21.15.17:0/2801794616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708004ed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 -- 172.21.15.17:0/2801794616 >> 172.21.15.17:0/2801794616 conn(0x55f708001060 msgr2=0x55f708001440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.206+0000 7eff9343a740 1 -- 172.21.15.17:0/2801794616 shutdown_connections 2024-09-16T01:08:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 -- 172.21.15.17:0/2801794616 wait complete. 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 -- start start 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 Processor -- start 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 0x55f70800cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f70800d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f708012880 con 0x55f708005410 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55f707ef2290 con 0x55f708004af0 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f708012a00 con 0x55f70800fcb0 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff9343a740 10 client.0 _ll_register_callbacks cb 0x55f707f23140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff8dc41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff8dc41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51544/0 (socket says 172.21.15.17:51544) 2024-09-16T01:08:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff8dc41640 1 -- 172.21.15.17:0/1030202735 learned_addr learned my addr 172.21.15.17:0/1030202735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.207+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 0x55f70800cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 -- 172.21.15.17:0/1030202735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 msgr2=0x55f70800d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f70800d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 -- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 msgr2=0x55f70800cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 0x55f70800cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 -- 172.21.15.17:0/1030202735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f707c7c210 con 0x55f708005410 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 0x55f70800cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff8dc41640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff78009930 tx=0x7eff78031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e7470e7a394889 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78035040 con 0x55f708005410 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7eff78004050 con 0x55f708005410 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff80004050 con 0x55f708005410 2024-09-16T01:08:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff78004250 con 0x55f708005410 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff9343a740 10 client.15855 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f707d48620 con 0x55f708005410 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.208+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff80004050 con 0x55f708005410 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff780049a0 con 0x55f708005410 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 10 client.15855 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 20 client.15855 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70801fc10 0x55f708022040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 4 client.15855 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f707f76a20 con 0x55f70801fc10 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70801fc10 0x55f708022040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff71ffb640 10 client.15855 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.209+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70801fc10 0x55f708022040 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c63929788cd3b3f server_cookie=97d5d67f5095a6a5 in_seq=0 out_seq=0 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff71ffb640 1 -- 172.21.15.17:0/1030202735 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f707f76a20 con 0x55f70801fc10 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff71ffb640 10 client.15855 handle_command_reply: tid=0 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 client.15855 shutdown 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 msgr2=0x55f70800d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff78009930 tx=0x7eff78031e60 comp rx=0 tx=0).stop 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 shutdown_connections 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70801fc10 0x55f708022040 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f70800d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff71ffb640 0 client.15855 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f70800d0c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 --2- 172.21.15.17:0/1030202735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708004af0 0x55f70800cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 >> 172.21.15.17:0/1030202735 conn(0x55f708001060 msgr2=0x55f708006dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 shutdown_connections 2024-09-16T01:08:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 1 -- 172.21.15.17:0/1030202735 wait complete. 2024-09-16T01:08:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.210+0000 7eff9343a740 20 client.15855 trim_cache size 0 max 16384 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.225+0000 7eff9343a740 1 Processor -- start 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.225+0000 7eff9343a740 1 -- start start 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080279a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff881af890 con 0x55f708004af0 2024-09-16T01:08:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff881b13d0 con 0x55f708005410 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff9343a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff881aff60 con 0x55f70800fcb0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51558/0 (socket says 172.21.15.17:51558) 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 -- 172.21.15.17:0/1611201400 learned_addr learned my addr 172.21.15.17:0/1611201400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8dc41640 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 -- 172.21.15.17:0/1611201400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 msgr2=0x55f7080279a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 -- 172.21.15.17:0/1611201400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 msgr2=0x55f70800d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 -- 172.21.15.17:0/1611201400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f707ffc2d0 con 0x55f708004af0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff8ec43640 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7eff80009de0 tx=0x7eff80009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31df06018ac6743 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff73fff640 1 -- 172.21.15.17:0/1611201400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80005240 con 0x55f708004af0 2024-09-16T01:08:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff73fff640 1 -- 172.21.15.17:0/1611201400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff80005890 con 0x55f708004af0 2024-09-16T01:08:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.226+0000 7eff73fff640 1 -- 172.21.15.17:0/1611201400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8000fd70 con 0x55f708004af0 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- 172.21.15.17:0/1611201400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 msgr2=0x55f708007560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7eff80009de0 tx=0x7eff80009be0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- 172.21.15.17:0/1611201400 shutdown_connections 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f70800fcb0 0x55f7080279a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f708005410 0x55f70800d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 --2- 172.21.15.17:0/1611201400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708004af0 0x55f708007560 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- 172.21.15.17:0/1611201400 >> 172.21.15.17:0/1611201400 conn(0x55f708001060 msgr2=0x55f70800ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- 172.21.15.17:0/1611201400 shutdown_connections 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- 172.21.15.17:0/1611201400 wait complete. 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 -- start start 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.227+0000 7eff9343a740 1 Processor -- start 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708004af0 0x55f7080183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 0x55f708009d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff881b0d00 con 0x55f708005410 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff881b0630 con 0x55f70800fcb0 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff881ad870 con 0x55f708004af0 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff9343a740 10 client.0 _ll_register_callbacks cb 0x7eff78009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:08:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51560/0 (socket says 172.21.15.17:51560) 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 -- 172.21.15.17:0/2864481412 learned_addr learned my addr 172.21.15.17:0/2864481412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708004af0 0x55f7080183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 0x55f708009d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 -- 172.21.15.17:0/2864481412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708004af0 msgr2=0x55f7080183e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708004af0 0x55f7080183e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 -- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 msgr2=0x55f708009d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 0x55f708009d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 -- 172.21.15.17:0/2864481412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70800a550 con 0x55f708005410 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 0x55f708009d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff8dc41640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7eff78004ee0 tx=0x7eff78031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99d8fa648118bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:08:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.228+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78035070 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7eff78031770 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff80005890 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff78004770 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 10 client.15861 fetch_fsmap learned FSMap version 28 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f70808a900 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7eff80005890 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff78056030 con 0x55f708005410 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 20 client.15861 populate_metadata read hostname 'smithi017' 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70808afa0 0x55f70808d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:08:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 4 client.15861 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:08:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.229+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f707f70d70 con 0x55f70808afa0 2024-09-16T01:08:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.230+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70808afa0 0x55f70808d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:08:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.230+0000 7eff8ec43640 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70808afa0 0x55f70808d3c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5226c96e984b204e server_cookie=62e627035c7f7d8e in_seq=0 out_seq=0 2024-09-16T01:08:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.230+0000 7eff71ffb640 10 client.15861 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.242+0000 7eff71ffb640 1 -- 172.21.15.17:0/2864481412 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f707f70d70 con 0x55f70808afa0 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.242+0000 7eff71ffb640 10 client.15861 handle_command_reply: tid=0 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.242+0000 7eff9343a740 1 client.15861 shutdown 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 msgr2=0x55f708009830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7eff78004ee0 tx=0x7eff78031b80 comp rx=0 tx=0).stop 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 shutdown_connections 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55f70808afa0 0x55f70808d3c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f70800fcb0 0x55f708009d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f708005410 0x55f708009830 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 --2- 172.21.15.17:0/2864481412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f708004af0 0x55f7080183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff71ffb640 0 client.15861 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 >> 172.21.15.17:0/2864481412 conn(0x55f708001060 msgr2=0x55f707fff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 shutdown_connections 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 1 -- 172.21.15.17:0/2864481412 wait complete. 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff9343a740 20 client.15861 trim_cache size 0 max 16384 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:08:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 msgr2=0x7eff740a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 0x7eff740a59a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff840cd700 tx=0x7eff840d3a20 comp rx=0 tx=0).stop 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 msgr2=0x7eff880fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e9f0 tx=0x7eff8400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 shutdown_connections 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7eff740a34e0 0x7eff740a59a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff881069c0 0x7eff880fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff88101350 0x7eff880fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 --2- 172.21.15.17:0/3938758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff881009b0 0x7eff880fcde0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:08:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.243+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 >> 172.21.15.17:0/3938758741 conn(0x7eff88077990 msgr2=0x7eff88069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:08:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.244+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 shutdown_connections 2024-09-16T01:08:47.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:08:47.244+0000 7eff906a6640 1 -- 172.21.15.17:0/3938758741 wait complete. 2024-09-16T01:08:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:47 smithi088 ceph-mon[34093]: pgmap v195: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:47 smithi154 ceph-mon[34759]: pgmap v195: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:47 smithi017 ceph-mon[31211]: pgmap v195: 97 pgs: 97 active+clean; 1.8 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:08:50.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:49 smithi088 ceph-mon[34093]: pgmap v196: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-16T01:08:50.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:49 smithi154 ceph-mon[34759]: pgmap v196: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-16T01:08:50.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:49 smithi017 ceph-mon[31211]: pgmap v196: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-16T01:08:52.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:51 smithi088 ceph-mon[34093]: pgmap v197: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:52.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:51 smithi154 ceph-mon[34759]: pgmap v197: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:52.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:51 smithi017 ceph-mon[31211]: pgmap v197: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:53.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:53 smithi088 ceph-mon[34093]: pgmap v198: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:53.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:53 smithi154 ceph-mon[34759]: pgmap v198: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:53 smithi017 ceph-mon[31211]: pgmap v198: 97 pgs: 97 active+clean; 2.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-16T01:08:55.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:55 smithi017 ceph-mon[31211]: pgmap v199: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:55.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:55 smithi088 ceph-mon[34093]: pgmap v199: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:55.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:55 smithi154 ceph-mon[34759]: pgmap v199: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:08:57.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:57 smithi017 ceph-mon[31211]: pgmap v200: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:57.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:57 smithi088 ceph-mon[34093]: pgmap v200: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:57.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:57 smithi154 ceph-mon[34759]: pgmap v200: 97 pgs: 97 active+clean; 2.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:08:59.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:08:59 smithi017 ceph-mon[31211]: pgmap v201: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:08:59.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:08:59 smithi088 ceph-mon[34093]: pgmap v201: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:08:59.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:08:59 smithi154 ceph-mon[34759]: pgmap v201: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:09:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 -- 172.21.15.17:0/2250601882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101240 msgr2=0x7ff77c10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 --2- 172.21.15.17:0/2250601882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101240 0x7ff77c10de70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009900 tx=0x7ff76c02a410 comp rx=0 tx=0).stop 2024-09-16T01:09:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 -- 172.21.15.17:0/2250601882 shutdown_connections 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 --2- 172.21.15.17:0/2250601882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c10e440 0x7ff77c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 --2- 172.21.15.17:0/2250601882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101240 0x7ff77c10de70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 --2- 172.21.15.17:0/2250601882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c100890 0x7ff77c100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 -- 172.21.15.17:0/2250601882 >> 172.21.15.17:0/2250601882 conn(0x7ff77c077990 msgr2=0x7ff77c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 -- 172.21.15.17:0/2250601882 shutdown_connections 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.345+0000 7ff783386640 1 -- 172.21.15.17:0/2250601882 wait complete. 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 Processor -- start 2024-09-16T01:09:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 -- start start 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 0x7ff77c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 0x7ff77c19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c113f50 con 0x7ff77c100890 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c113dd0 con 0x7ff77c101240 2024-09-16T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff783386640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1140d0 con 0x7ff77c10e440 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41452/0 (socket says 172.21.15.17:41452) 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781122640 1 -- 172.21.15.17:0/1439130824 learned_addr learned my addr 172.21.15.17:0/1439130824 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff780921640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 0x7ff77c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781122640 1 -- 172.21.15.17:0/1439130824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 msgr2=0x7ff77c19ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781923640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 0x7ff77c19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.346+0000 7ff781122640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 0x7ff77c19ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff781122640 1 -- 172.21.15.17:0/1439130824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 msgr2=0x7ff77c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff781122640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 0x7ff77c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff781122640 1 -- 172.21.15.17:0/1439130824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c19f550 con 0x7ff77c100890 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff780921640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 0x7ff77c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff781923640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 0x7ff77c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff781122640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d950 tx=0x7ff77800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff7727fc640 1 -- 172.21.15.17:0/1439130824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778017070 con 0x7ff77c100890 2024-09-16T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff7727fc640 1 -- 172.21.15.17:0/1439130824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff778009c30 con 0x7ff77c100890 2024-09-16T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c19f840 con 0x7ff77c100890 2024-09-16T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff7727fc640 1 -- 172.21.15.17:0/1439130824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800f620 con 0x7ff77c100890 2024-09-16T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.347+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c1a70d0 con 0x7ff77c100890 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.350+0000 7ff7727fc640 1 -- 172.21.15.17:0/1439130824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff7780109a0 con 0x7ff77c100890 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.350+0000 7ff7861f8740 1 Processor -- start 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 -- start start 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d679ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d6870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d63d5de2f0 con 0x55d63d67a410 2024-09-16T01:09:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d63d586270 con 0x55d63d684cb0 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7861f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d63d5da2b0 con 0x55d63d679af0 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41460/0 (socket says 172.21.15.17:41460) 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 -- 172.21.15.17:0/894245166 learned_addr learned my addr 172.21.15.17:0/894245166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff780921640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d6870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781923640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d679ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff7727fc640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 0x7ff7680a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 -- 172.21.15.17:0/894245166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 msgr2=0x55d63d679ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d679ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 -- 172.21.15.17:0/894245166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 msgr2=0x55d63d6870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d6870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781122640 1 -- 172.21.15.17:0/894245166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63d585340 con 0x55d63d67a410 2024-09-16T01:09:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff781923640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d679ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.351+0000 7ff780921640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d6870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff781923640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 0x7ff7680a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff7727fc640 1 -- 172.21.15.17:0/1439130824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff7780cf9d0 con 0x7ff77c100890 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff781122640 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff7780cd0c0 tx=0x7ff778022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c6ea9f4392e7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff7677fe640 1 -- 172.21.15.17:0/894245166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77809b820 con 0x55d63d67a410 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff781923640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 0x7ff7680a5920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff774009370 tx=0x7ff774004a40 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff7677fe640 1 -- 172.21.15.17:0/894245166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7780cfe50 con 0x55d63d67a410 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.352+0000 7ff7677fe640 1 -- 172.21.15.17:0/894245166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77809b640 con 0x55d63d67a410 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- 172.21.15.17:0/894245166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 msgr2=0x55d63d684770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff7780cd0c0 tx=0x7ff778022000 comp rx=0 tx=0).stop 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- 172.21.15.17:0/894245166 shutdown_connections 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d6870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d67a410 0x55d63d684770 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 --2- 172.21.15.17:0/894245166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d679ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- 172.21.15.17:0/894245166 >> 172.21.15.17:0/894245166 conn(0x55d63d676060 msgr2=0x55d63d676440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- 172.21.15.17:0/894245166 shutdown_connections 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- 172.21.15.17:0/894245166 wait complete. 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 -- start start 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.353+0000 7ff7861f8740 1 Processor -- start 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d67a410 0x55d63d6820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d682630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d63d687820 con 0x55d63d679af0 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55d63d567290 con 0x55d63d684cb0 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d63d6879a0 con 0x55d63d67a410 2024-09-16T01:09:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff7861f8740 10 client.0 _ll_register_callbacks cb 0x55d63d598140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41474/0 (socket says 172.21.15.17:41474) 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 -- 172.21.15.17:0/3580924935 learned_addr learned my addr 172.21.15.17:0/3580924935 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff780921640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d67a410 0x55d63d6820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 -- 172.21.15.17:0/3580924935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d67a410 msgr2=0x55d63d6820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d67a410 0x55d63d6820f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781923640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d682630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 -- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 msgr2=0x55d63d682630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d682630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 -- 172.21.15.17:0/3580924935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63d2f1210 con 0x55d63d679af0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff781122640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff778012040 tx=0x7ff778005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27a1a04529f3b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.354+0000 7ff764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77809b640 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff778098350 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7780cfe50 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff77809b820 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d63d3bd620 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7780cfe50 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff77807f210 con 0x55d63d679af0 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 20 client.15873 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d694a50 0x55d63d696e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 4 client.15873 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.355+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63d5eba20 con 0x55d63d694a50 2024-09-16T01:09:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.356+0000 7ff780921640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d694a50 0x55d63d696e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.356+0000 7ff780921640 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d694a50 0x55d63d696e40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3b4641c8177b4f server_cookie=36f7cd8531cd74c6 in_seq=0 out_seq=0 2024-09-16T01:09:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.356+0000 7ff764ff9640 10 client.15873 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff764ff9640 1 -- 172.21.15.17:0/3580924935 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d63d5eba20 con 0x55d63d694a50 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff764ff9640 10 client.15873 handle_command_reply: tid=0 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 client.15873 shutdown 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 msgr2=0x55d63d681bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff778012040 tx=0x7ff778005f90 comp rx=0 tx=0).stop 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 shutdown_connections 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d694a50 0x55d63d696e40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d684cb0 0x55d63d682630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d67a410 0x55d63d6820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 --2- 172.21.15.17:0/3580924935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d681bb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff764ff9640 0 client.15873 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 >> 172.21.15.17:0/3580924935 conn(0x55d63d676060 msgr2=0x55d63d67bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 shutdown_connections 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 1 -- 172.21.15.17:0/3580924935 wait complete. 2024-09-16T01:09:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.357+0000 7ff7861f8740 20 client.15873 trim_cache size 0 max 16384 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 Processor -- start 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 -- start start 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d682460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 0x55d63d69c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1af9d0 con 0x55d63d679af0 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1b1510 con 0x55d63d67a410 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff7861f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1b00a0 con 0x55d63d684cb0 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff781122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41480/0 (socket says 172.21.15.17:41480) 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.372+0000 7ff781122640 1 -- 172.21.15.17:0/4014146638 learned_addr learned my addr 172.21.15.17:0/4014146638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff780921640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d682460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781923640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 0x55d63d69c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 -- 172.21.15.17:0/4014146638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 msgr2=0x55d63d69c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 0x55d63d69c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 -- 172.21.15.17:0/4014146638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 msgr2=0x55d63d682460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d682460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 -- 172.21.15.17:0/4014146638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63d679870 con 0x55d63d679af0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781923640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 0x55d63d69c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff781122640 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff778098140 tx=0x7ff77809a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddf6992b59d8d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff766ffd640 1 -- 172.21.15.17:0/4014146638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77809b640 con 0x55d63d679af0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff766ffd640 1 -- 172.21.15.17:0/4014146638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff77809c3e0 con 0x55d63d679af0 2024-09-16T01:09:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.373+0000 7ff766ffd640 1 -- 172.21.15.17:0/4014146638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780a0090 con 0x55d63d679af0 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- 172.21.15.17:0/4014146638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 msgr2=0x55d63d67c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff778098140 tx=0x7ff77809a1f0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- 172.21.15.17:0/4014146638 shutdown_connections 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d684cb0 0x55d63d69c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d682460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 --2- 172.21.15.17:0/4014146638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d679af0 0x55d63d67c560 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- 172.21.15.17:0/4014146638 >> 172.21.15.17:0/4014146638 conn(0x55d63d676060 msgr2=0x55d63d683c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- 172.21.15.17:0/4014146638 shutdown_connections 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- 172.21.15.17:0/4014146638 wait complete. 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 -- start start 2024-09-16T01:09:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.374+0000 7ff7861f8740 1 Processor -- start 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d68d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d67e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1b0e40 con 0x55d63d684cb0 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1b0770 con 0x55d63d67a410 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c1ad9b0 con 0x55d63d679af0 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 10 client.0 _ll_register_callbacks cb 0x7ff76c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41496/0 (socket says 172.21.15.17:41496) 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 -- 172.21.15.17:0/880510349 learned_addr learned my addr 172.21.15.17:0/880510349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781122640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d68d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff780921640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d67e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 -- 172.21.15.17:0/880510349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 msgr2=0x55d63d68d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d68d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 -- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 msgr2=0x55d63d67e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d67e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 -- 172.21.15.17:0/880510349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63d67f670 con 0x55d63d684cb0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff780921640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d67e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff781923640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff77401d7b0 tx=0x7ff774009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9157b04de369e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7740128f0 con 0x55d63d684cb0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff774012a90 con 0x55d63d684cb0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.375+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77809c3e0 con 0x55d63d684cb0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff774012c90 con 0x55d63d684cb0 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d63d6ff420 con 0x55d63d684cb0 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff77809c3e0 con 0x55d63d684cb0 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff774027420 con 0x55d63d684cb0 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 20 client.15879 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d6ffc00 0x55d63d702020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 4 client.15879 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d63d687520 con 0x55d63d6ffc00 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.376+0000 7ff781122640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d6ffc00 0x55d63d702020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.377+0000 7ff781122640 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d6ffc00 0x55d63d702020 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7baf9f8c9fa7d39 server_cookie=9ad1cfa49de9df0c in_seq=0 out_seq=0 2024-09-16T01:09:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.377+0000 7ff764ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.391+0000 7ff764ff9640 1 -- 172.21.15.17:0/880510349 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d63d687520 con 0x55d63d6ffc00 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.391+0000 7ff764ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 client.15879 shutdown 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 msgr2=0x55d63d67ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff77401d7b0 tx=0x7ff774009610 comp rx=0 tx=0).stop 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 shutdown_connections 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55d63d6ffc00 0x55d63d702020 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d63d684cb0 0x55d63d67ee40 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d63d67a410 0x55d63d67e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff764ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 --2- 172.21.15.17:0/880510349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d63d679af0 0x55d63d68d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 >> 172.21.15.17:0/880510349 conn(0x55d63d676060 msgr2=0x55d63d68fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 shutdown_connections 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 1 -- 172.21.15.17:0/880510349 wait complete. 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.392+0000 7ff7861f8740 20 client.15879 trim_cache size 0 max 16384 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:09:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:09:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:09:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 msgr2=0x7ff7680a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 0x7ff7680a5920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff774009370 tx=0x7ff774004a40 comp rx=0 tx=0).stop 2024-09-16T01:09:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 msgr2=0x7ff77c19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d950 tx=0x7ff77800de10 comp rx=0 tx=0).stop 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 shutdown_connections 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff7680a3460 0x7ff7680a5920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff77c10e440 0x7ff77c19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff77c101240 0x7ff77c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 --2- 172.21.15.17:0/1439130824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c100890 0x7ff77c19a560 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 >> 172.21.15.17:0/1439130824 conn(0x7ff77c077990 msgr2=0x7ff77c0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 shutdown_connections 2024-09-16T01:09:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:00.393+0000 7ff783386640 1 -- 172.21.15.17:0/1439130824 wait complete. 2024-09-16T01:09:01.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:01 smithi088 ceph-mon[34093]: pgmap v202: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:01.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:01 smithi154 ceph-mon[34759]: pgmap v202: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:01.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:01 smithi017 ceph-mon[31211]: pgmap v202: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:03 smithi088 ceph-mon[34093]: pgmap v203: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:03.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:03 smithi154 ceph-mon[34759]: pgmap v203: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:03 smithi017 ceph-mon[31211]: pgmap v203: 97 pgs: 97 active+clean; 2.4 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-09-16T01:09:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:05 smithi088 ceph-mon[34093]: pgmap v204: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-16T01:09:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:05 smithi088 ceph-mon[34093]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:09:05.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:05 smithi154 ceph-mon[34759]: pgmap v204: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-16T01:09:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:05 smithi154 ceph-mon[34759]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:09:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:05 smithi017 ceph-mon[31211]: pgmap v204: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 101 KiB/s wr, 40 op/s 2024-09-16T01:09:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:05 smithi017 ceph-mon[31211]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:09:07.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:07 smithi088 ceph-mon[34093]: pgmap v206: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:09:07.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:07 smithi154 ceph-mon[34759]: pgmap v206: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:09:07.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:07 smithi017 ceph-mon[31211]: pgmap v206: 97 pgs: 97 active+clean; 2.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:09:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:09 smithi088 ceph-mon[34093]: pgmap v207: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:09.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:09 smithi154 ceph-mon[34759]: pgmap v207: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:09 smithi017 ceph-mon[31211]: pgmap v207: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:11 smithi088 ceph-mon[34093]: pgmap v208: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:11.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:11 smithi154 ceph-mon[34759]: pgmap v208: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:11 smithi017 ceph-mon[31211]: pgmap v208: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:09:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:13 smithi088 ceph-mon[34093]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:09:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:13 smithi088 ceph-mon[34093]: pgmap v210: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:09:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:13 smithi154 ceph-mon[34759]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:09:13.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:13 smithi154 ceph-mon[34759]: pgmap v210: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:09:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:13 smithi017 ceph-mon[31211]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:09:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:13 smithi017 ceph-mon[31211]: pgmap v210: 97 pgs: 97 active+clean; 2.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 -- 172.21.15.17:0/822288023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258107b70 msgr2=0x7ff258107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 --2- 172.21.15.17:0/822288023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258107b70 0x7ff258107f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff248009930 tx=0x7ff24802a420 comp rx=0 tx=0).stop 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 -- 172.21.15.17:0/822288023 shutdown_connections 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 --2- 172.21.15.17:0/822288023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258102470 0x7ff25810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 --2- 172.21.15.17:0/822288023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258101ad0 0x7ff258101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 --2- 172.21.15.17:0/822288023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258107b70 0x7ff258107f50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 -- 172.21.15.17:0/822288023 >> 172.21.15.17:0/822288023 conn(0x7ff2580fd7d0 msgr2=0x7ff2580ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 -- 172.21.15.17:0/822288023 shutdown_connections 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.493+0000 7ff25e477640 1 -- 172.21.15.17:0/822288023 wait complete. 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 Processor -- start 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 -- start start 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258102470 0x7ff2581987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 0x7ff25819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff258111d90 con 0x7ff258101ad0 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff258111c10 con 0x7ff258107b70 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.494+0000 7ff25e477640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff258111f10 con 0x7ff258102470 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57188/0 (socket says 172.21.15.17:57188) 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 -- 172.21.15.17:0/2768570135 learned_addr learned my addr 172.21.15.17:0/2768570135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff2577fe640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258102470 0x7ff2581987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff25ca14640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 0x7ff25819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 -- 172.21.15.17:0/2768570135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258102470 msgr2=0x7ff2581987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258102470 0x7ff2581987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 -- 172.21.15.17:0/2768570135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 msgr2=0x7ff25819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 0x7ff25819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 -- 172.21.15.17:0/2768570135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25819d250 con 0x7ff258101ad0 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff25ca14640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 0x7ff25819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff257fff640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff248005940 tx=0x7ff2480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff2557fa640 1 -- 172.21.15.17:0/2768570135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24803f030 con 0x7ff258101ad0 2024-09-16T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff2557fa640 1 -- 172.21.15.17:0/2768570135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2480318a0 con 0x7ff258101ad0 2024-09-16T01:09:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff2557fa640 1 -- 172.21.15.17:0/2768570135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248035070 con 0x7ff258101ad0 2024-09-16T01:09:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.495+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25819d4e0 con 0x7ff258101ad0 2024-09-16T01:09:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.496+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581a4dd0 con 0x7ff258101ad0 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff2557fa640 1 -- 172.21.15.17:0/2768570135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff248042030 con 0x7ff258101ad0 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 Processor -- start 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 -- start start 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec359820 0x557dec363b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec3664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dec2b92f0 con 0x557dec358f00 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557dec261270 con 0x557dec359820 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.498+0000 7ff261211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557dec2b52b0 con 0x557dec3640c0 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57200/0 (socket says 172.21.15.17:57200) 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 -- 172.21.15.17:0/319357083 learned_addr learned my addr 172.21.15.17:0/319357083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff2557fa640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 0x7ff2400a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff257fff640 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec359820 0x557dec363b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff2577fe640 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec3664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 0x7ff2400a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 -- 172.21.15.17:0/319357083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 msgr2=0x557dec3664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec3664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 -- 172.21.15.17:0/319357083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec359820 msgr2=0x557dec363b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec359820 0x557dec363b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 -- 172.21.15.17:0/319357083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dec260340 con 0x557dec358f00 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff2557fa640 1 -- 172.21.15.17:0/2768570135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7ff2480f0010 con 0x7ff258101ad0 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff25ca14640 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff250005c40 tx=0x7ff250012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2980eeb4fa5526 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff23e7fc640 1 -- 172.21.15.17:0/319357083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250023030 con 0x557dec358f00 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.499+0000 7ff23e7fc640 1 -- 172.21.15.17:0/319357083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff25001fc90 con 0x557dec358f00 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff25ca14640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 0x7ff2400a59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff250023000 tx=0x7ff250022000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff23e7fc640 1 -- 172.21.15.17:0/319357083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25000fb60 con 0x557dec358f00 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 -- 172.21.15.17:0/319357083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 msgr2=0x557dec3592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff250005c40 tx=0x7ff250012f80 comp rx=0 tx=0).stop 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 -- 172.21.15.17:0/319357083 shutdown_connections 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec3664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec359820 0x557dec363b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 --2- 172.21.15.17:0/319357083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec358f00 0x557dec3592e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 -- 172.21.15.17:0/319357083 >> 172.21.15.17:0/319357083 conn(0x557dec355470 msgr2=0x557dec355850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 -- 172.21.15.17:0/319357083 shutdown_connections 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.500+0000 7ff261211740 1 -- 172.21.15.17:0/319357083 wait complete. 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 -- start start 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 Processor -- start 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec361010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec361a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dec366c90 con 0x557dec359820 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x557dec242290 con 0x557dec358f00 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557dec366e10 con 0x557dec3640c0 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff261211740 10 client.0 _ll_register_callbacks cb 0x557dec273140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57208/0 (socket says 172.21.15.17:57208) 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff2577fe640 1 -- 172.21.15.17:0/36521104 learned_addr learned my addr 172.21.15.17:0/36521104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.501+0000 7ff25ca14640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec361a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff257fff640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec361010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 -- 172.21.15.17:0/36521104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 msgr2=0x557dec361a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec361a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 -- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 msgr2=0x557dec361010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec361010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 -- 172.21.15.17:0/36521104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557debfcc210 con 0x557dec359820 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2577fe640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bad0 tx=0x7ff24c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d387ddf9ae4359 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c003e00 con 0x557dec359820 2024-09-16T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7ff24c011440 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff25001fc90 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff24c011640 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff261211740 10 client.15891 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dec098620 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.502+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff25001fc90 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff24c01ba40 con 0x557dec359820 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 20 client.15891 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec374150 0x557dec376540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 4 client.15891 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dec2c6a20 con 0x557dec374150 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff257fff640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec374150 0x557dec376540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff2377fe640 10 client.15891 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.503+0000 7ff257fff640 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec374150 0x557dec376540 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61a5a869ff4ccf4 server_cookie=2db8ffa8624dd268 in_seq=0 out_seq=0 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff2377fe640 1 -- 172.21.15.17:0/36521104 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dec2c6a20 con 0x557dec374150 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff2377fe640 10 client.15891 handle_command_reply: tid=0 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 client.15891 shutdown 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 msgr2=0x557dec361550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bad0 tx=0x7ff24c00bf90 comp rx=0 tx=0).stop 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 shutdown_connections 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec374150 0x557dec376540 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec3640c0 0x557dec361a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec361550 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 --2- 172.21.15.17:0/36521104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec361010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff2377fe640 0 client.15891 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.504+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 >> 172.21.15.17:0/36521104 conn(0x557dec355470 msgr2=0x557dec3501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.505+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 shutdown_connections 2024-09-16T01:09:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.505+0000 7ff261211740 1 -- 172.21.15.17:0/36521104 wait complete. 2024-09-16T01:09:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.505+0000 7ff261211740 20 client.15891 trim_cache size 0 max 16384 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.519+0000 7ff261211740 1 Processor -- start 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.519+0000 7ff261211740 1 -- start start 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec35b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 0x557dec35ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ab530 con 0x557dec3640c0 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ad070 con 0x557dec358f00 2024-09-16T01:09:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff261211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581abc00 con 0x557dec359820 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57224/0 (socket says 172.21.15.17:57224) 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 -- 172.21.15.17:0/4244208970 learned_addr learned my addr 172.21.15.17:0/4244208970 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff257fff640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec35b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 -- 172.21.15.17:0/4244208970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 msgr2=0x557dec35ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff2577fe640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 0x557dec35ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 0x557dec35ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 -- 172.21.15.17:0/4244208970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 msgr2=0x557dec35b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec35b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 -- 172.21.15.17:0/4244208970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dec35a3f0 con 0x557dec3640c0 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff257fff640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec35b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff2577fe640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 0x557dec35ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff25ca14640 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff25000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549af52dc042c6ae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff23dffb640 1 -- 172.21.15.17:0/4244208970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25000ec90 con 0x557dec3640c0 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff23dffb640 1 -- 172.21.15.17:0/4244208970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff250012580 con 0x557dec3640c0 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.520+0000 7ff23dffb640 1 -- 172.21.15.17:0/4244208970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25000f890 con 0x557dec3640c0 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- 172.21.15.17:0/4244208970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 msgr2=0x557dec37be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff25000ee80 comp rx=0 tx=0).stop 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- 172.21.15.17:0/4244208970 shutdown_connections 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec3640c0 0x557dec37be10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec359820 0x557dec35ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 --2- 172.21.15.17:0/4244208970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec358f00 0x557dec35b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- 172.21.15.17:0/4244208970 >> 172.21.15.17:0/4244208970 conn(0x557dec355470 msgr2=0x557dec363090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- 172.21.15.17:0/4244208970 shutdown_connections 2024-09-16T01:09:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- 172.21.15.17:0/4244208970 wait complete. 2024-09-16T01:09:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.521+0000 7ff261211740 1 -- start start 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 Processor -- start 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 0x557dec367d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec3640c0 0x557dec3687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ac9a0 con 0x557dec359820 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ac2d0 con 0x557dec3640c0 2024-09-16T01:09:13.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581a9530 con 0x557dec358f00 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff261211740 10 client.0 _ll_register_callbacks cb 0x7ff24c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57228/0 (socket says 172.21.15.17:57228) 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 -- 172.21.15.17:0/322584166 learned_addr learned my addr 172.21.15.17:0/322584166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff25ca14640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec3640c0 0x557dec3687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff257fff640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 0x557dec367d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 -- 172.21.15.17:0/322584166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 msgr2=0x557dec367d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 0x557dec367d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 -- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec3640c0 msgr2=0x557dec3687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec3640c0 0x557dec3687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff2577fe640 1 -- 172.21.15.17:0/322584166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dec3ddde0 con 0x557dec359820 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.522+0000 7ff257fff640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 0x557dec367d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:09:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2577fe640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff24c000c00 tx=0x7ff24c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9e28416a555e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c003e00 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7ff24c011440 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff250012580 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff24c00b480 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dec3defd0 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff250012580 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff24c02a020 con 0x557dec359820 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 20 client.15897 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec3df750 0x557dec3e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 4 client.15897 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:09:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.523+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557dec2c0d70 con 0x557dec3df750 2024-09-16T01:09:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.524+0000 7ff257fff640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec3df750 0x557dec3e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.524+0000 7ff257fff640 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec3df750 0x557dec3e1b70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1805a61cd5a335ad server_cookie=24d74a84d15f493 in_seq=0 out_seq=0 2024-09-16T01:09:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.524+0000 7ff2377fe640 10 client.15897 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.539+0000 7ff2377fe640 1 -- 172.21.15.17:0/322584166 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557dec2c0d70 con 0x557dec3df750 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.539+0000 7ff2377fe640 10 client.15897 handle_command_reply: tid=0 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.539+0000 7ff261211740 1 client.15897 shutdown 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.539+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 msgr2=0x557dec368270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.539+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff24c000c00 tx=0x7ff24c005870 comp rx=0 tx=0).stop 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 shutdown_connections 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x557dec3df750 0x557dec3e1b70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x557dec3640c0 0x557dec3687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dec359820 0x557dec368270 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 --2- 172.21.15.17:0/322584166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557dec358f00 0x557dec367d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff2377fe640 0 client.15897 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 >> 172.21.15.17:0/322584166 conn(0x557dec355470 msgr2=0x557dec362870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 shutdown_connections 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 1 -- 172.21.15.17:0/322584166 wait complete. 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff261211740 20 client.15897 trim_cache size 0 max 16384 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 msgr2=0x7ff2400a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 0x7ff2400a59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff250023000 tx=0x7ff250022000 comp rx=0 tx=0).stop 2024-09-16T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 msgr2=0x7ff258198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff248005940 tx=0x7ff2480042f0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 shutdown_connections 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff2400a34e0 0x7ff2400a59a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff258107b70 0x7ff25819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff258102470 0x7ff2581987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 --2- 172.21.15.17:0/2768570135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff258101ad0 0x7ff258198260 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.540+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 >> 172.21.15.17:0/2768570135 conn(0x7ff2580fd7d0 msgr2=0x7ff2580fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.541+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 shutdown_connections 2024-09-16T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:13.541+0000 7ff25e477640 1 -- 172.21.15.17:0/2768570135 wait complete. 2024-09-16T01:09:15.439 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:15 smithi017 ceph-mon[31211]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:15 smithi088 ceph-mon[34093]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:15.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:15 smithi154 ceph-mon[34759]: pgmap v211: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:17 smithi088 ceph-mon[34093]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:17.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:17 smithi154 ceph-mon[34759]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:17 smithi017 ceph-mon[31211]: pgmap v212: 97 pgs: 97 active+clean; 3.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-09-16T01:09:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:19 smithi088 ceph-mon[34093]: pgmap v213: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:19.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:19 smithi154 ceph-mon[34759]: pgmap v213: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:19 smithi017 ceph-mon[31211]: pgmap v213: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:21.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:21 smithi154 ceph-mon[34759]: pgmap v214: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:21.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:21 smithi017 ceph-mon[31211]: pgmap v214: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:21.845 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:21 smithi088 ceph-mon[34093]: pgmap v214: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:23 smithi088 ceph-mon[34093]: pgmap v215: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:23 smithi154 ceph-mon[34759]: pgmap v215: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:23 smithi017 ceph-mon[31211]: pgmap v215: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:09:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:25 smithi088 ceph-mon[34093]: pgmap v216: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-16T01:09:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:25 smithi154 ceph-mon[34759]: pgmap v216: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-16T01:09:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:25 smithi017 ceph-mon[31211]: pgmap v216: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-16T01:09:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 -- 172.21.15.17:0/1173878454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 msgr2=0x7fa53c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 --2- 172.21.15.17:0/1173878454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c10e590 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa534009ca0 tx=0x7fa53402a950 comp rx=0 tx=0).stop 2024-09-16T01:09:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 -- 172.21.15.17:0/1173878454 shutdown_connections 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 --2- 172.21.15.17:0/1173878454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c10e590 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 --2- 172.21.15.17:0/1173878454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 0x7fa53c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 --2- 172.21.15.17:0/1173878454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 0x7fa53c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 -- 172.21.15.17:0/1173878454 >> 172.21.15.17:0/1173878454 conn(0x7fa53c0fc6b0 msgr2=0x7fa53c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 -- 172.21.15.17:0/1173878454 shutdown_connections 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 -- 172.21.15.17:0/1173878454 wait complete. 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.640+0000 7fa5427fd640 1 Processor -- start 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 -- start start 2024-09-16T01:09:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 0x7fa53c100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 0x7fa53c100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111da0 con 0x7fa53c10c110 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111c20 con 0x7fa53c102cc0 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa5427fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c111f20 con 0x7fa53c1035e0 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44536/0 (socket says 172.21.15.17:44536) 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 -- 172.21.15.17:0/398705094 learned_addr learned my addr 172.21.15.17:0/398705094 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa53bfff640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 0x7fa53c100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 0x7fa53c100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 -- 172.21.15.17:0/398705094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 msgr2=0x7fa53c100e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 0x7fa53c100e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 -- 172.21.15.17:0/398705094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 msgr2=0x7fa53c100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 0x7fa53c100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.641+0000 7fa540d9a640 1 -- 172.21.15.17:0/398705094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c1a66d0 con 0x7fa53c10c110 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa540d9a640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa534004af0 tx=0x7fa53402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa5397fa640 1 -- 172.21.15.17:0/398705094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534034040 con 0x7fa53c10c110 2024-09-16T01:09:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c1a6960 con 0x7fa53c10c110 2024-09-16T01:09:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa5397fa640 1 -- 172.21.15.17:0/398705094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa53402fe80 con 0x7fa53c10c110 2024-09-16T01:09:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa5397fa640 1 -- 172.21.15.17:0/398705094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5340046a0 con 0x7fa53c10c110 2024-09-16T01:09:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.642+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c1a6e50 con 0x7fa53c10c110 2024-09-16T01:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.644+0000 7fa5397fa640 1 -- 172.21.15.17:0/398705094 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa534037020 con 0x7fa53c10c110 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.644+0000 7fa54567b740 1 Processor -- start 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 -- start start 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c7641582f0 con 0x55c7641fecb0 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55c764100270 con 0x55c7641f4410 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa54567b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c7641542b0 con 0x55c7641f3af0 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44544/0 (socket says 172.21.15.17:44544) 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 -- 172.21.15.17:0/3584427870 learned_addr learned my addr 172.21.15.17:0/3584427870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa5397fa640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 0x7fa5280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53bfff640 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 -- 172.21.15.17:0/3584427870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 msgr2=0x55c7641f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 -- 172.21.15.17:0/3584427870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 msgr2=0x55c7641fe770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fe770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa53b7fe640 1 -- 172.21.15.17:0/3584427870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7640ff340 con 0x55c7641fecb0 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa540d9a640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 0x7fa5280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.645+0000 7fa5397fa640 1 -- 172.21.15.17:0/398705094 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fa5340f0a90 con 0x7fa53c10c110 2024-09-16T01:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa524005e10 tx=0x7fa52400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f45b36d54f8a089 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa5327fc640 1 -- 172.21.15.17:0/3584427870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400e950 con 0x55c7641fecb0 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa5327fc640 1 -- 172.21.15.17:0/3584427870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa524010430 con 0x55c7641fecb0 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa5327fc640 1 -- 172.21.15.17:0/3584427870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400f620 con 0x55c7641fecb0 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa540d9a640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 0x7fa5280a5920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5340ee3a0 tx=0x7fa53402cc70 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa54567b740 1 -- 172.21.15.17:0/3584427870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 msgr2=0x55c7642010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.646+0000 7fa54567b740 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa524005e10 tx=0x7fa52400b4a0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- 172.21.15.17:0/3584427870 shutdown_connections 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7642010a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- 172.21.15.17:0/3584427870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- 172.21.15.17:0/3584427870 >> 172.21.15.17:0/3584427870 conn(0x55c7641f0060 msgr2=0x55c7641f0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- 172.21.15.17:0/3584427870 shutdown_connections 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- 172.21.15.17:0/3584427870 wait complete. 2024-09-16T01:09:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- start start 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 Processor -- start 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.647+0000 7fa54567b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c764201880 con 0x55c7641fecb0 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa54567b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55c7640e1290 con 0x55c7641f4410 2024-09-16T01:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa54567b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c764201a00 con 0x55c7641f3af0 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa54567b740 10 client.0 _ll_register_callbacks cb 0x55c764112140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44550/0 (socket says 172.21.15.17:44550) 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 -- 172.21.15.17:0/659211815 learned_addr learned my addr 172.21.15.17:0/659211815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53bfff640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 -- 172.21.15.17:0/659211815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 msgr2=0x55c7641fbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641fbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 -- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 msgr2=0x55c7641fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 -- 172.21.15.17:0/659211815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c763e6b210 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa524005dc0 tx=0x7fa524010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63ec42f0c8c2ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa51b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524005270 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.648+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fa524005410 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa524010430 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa524005610 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 10 client.15909 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c763f37620 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa524010430 con 0x55c7641fecb0 2024-09-16T01:09:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa5240046c0 con 0x55c7641fecb0 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 10 client.15909 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 20 client.15909 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c76420eb80 0x55c764210f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 4 client.15909 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c764165a20 con 0x55c76420eb80 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.649+0000 7fa53bfff640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c76420eb80 0x55c764210f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.650+0000 7fa53bfff640 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c76420eb80 0x55c764210f70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b802bad2973261 server_cookie=1439fe2b05d3cfd4 in_seq=0 out_seq=0 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.650+0000 7fa51b7fe640 10 client.15909 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa51b7fe640 1 -- 172.21.15.17:0/659211815 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c764165a20 con 0x55c76420eb80 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa51b7fe640 10 client.15909 handle_command_reply: tid=0 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 client.15909 shutdown 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 msgr2=0x55c7641fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa524005dc0 tx=0x7fa524010e70 comp rx=0 tx=0).stop 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 shutdown_connections 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c76420eb80 0x55c764210f70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641fecb0 0x55c7641fc650 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f4410 0x55c7641fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa51b7fe640 0 client.15909 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 --2- 172.21.15.17:0/659211815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f3af0 0x55c7641fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 >> 172.21.15.17:0/659211815 conn(0x55c7641f0060 msgr2=0x55c7641f5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 shutdown_connections 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 1 -- 172.21.15.17:0/659211815 wait complete. 2024-09-16T01:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.651+0000 7fa54567b740 20 client.15909 trim_cache size 0 max 16384 2024-09-16T01:09:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 Processor -- start 2024-09-16T01:09:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 -- start start 2024-09-16T01:09:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 0x55c764216660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641fecb0 0x55c764216ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1af7c0 con 0x55c7641f3af0 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1b1300 con 0x55c7641fecb0 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa54567b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1afe90 con 0x55c7641f4410 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44566/0 (socket says 172.21.15.17:44566) 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 -- 172.21.15.17:0/2865206422 learned_addr learned my addr 172.21.15.17:0/2865206422 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 -- 172.21.15.17:0/2865206422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 msgr2=0x55c764216660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53bfff640 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 0x55c764216660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 0x55c764216660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 -- 172.21.15.17:0/2865206422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641fecb0 msgr2=0x55c764216ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641fecb0 0x55c764216ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 -- 172.21.15.17:0/2865206422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7641efe90 con 0x55c7641f3af0 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53bfff640 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 0x55c764216660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.666+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5240130c0 tx=0x7fa524005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3220869f22815b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa531ffb640 1 -- 172.21.15.17:0/2865206422 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524010430 con 0x55c7641f3af0 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa531ffb640 1 -- 172.21.15.17:0/2865206422 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa524010af0 con 0x55c7641f3af0 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa531ffb640 1 -- 172.21.15.17:0/2865206422 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400e980 con 0x55c7641f3af0 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 -- 172.21.15.17:0/2865206422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 msgr2=0x55c7641fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa5240130c0 tx=0x7fa524005850 comp rx=0 tx=0).stop 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 -- 172.21.15.17:0/2865206422 shutdown_connections 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641fecb0 0x55c764216ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641f4410 0x55c764216660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 --2- 172.21.15.17:0/2865206422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f3af0 0x55c7641fc480 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 -- 172.21.15.17:0/2865206422 >> 172.21.15.17:0/2865206422 conn(0x55c7641f0060 msgr2=0x55c7641fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 -- 172.21.15.17:0/2865206422 shutdown_connections 2024-09-16T01:09:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.667+0000 7fa54567b740 1 -- 172.21.15.17:0/2865206422 wait complete. 2024-09-16T01:09:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 -- start start 2024-09-16T01:09:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 Processor -- start 2024-09-16T01:09:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 0x55c764207550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641fecb0 0x55c764203000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1b0c30 con 0x55c7641f4410 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1b0560 con 0x55c7641f3af0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1ad7c0 con 0x55c7641fecb0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa54567b740 10 client.0 _ll_register_callbacks cb 0x7fa52400be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa53bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa53bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44580/0 (socket says 172.21.15.17:44580) 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa53bfff640 1 -- 172.21.15.17:0/679696856 learned_addr learned my addr 172.21.15.17:0/679696856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.668+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 0x55c764207550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641fecb0 0x55c764203000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 -- 172.21.15.17:0/679696856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641fecb0 msgr2=0x55c764203000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641fecb0 0x55c764203000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 -- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 msgr2=0x55c764207550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 0x55c764207550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 -- 172.21.15.17:0/679696856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c764280e40 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 0x55c764207550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa53bfff640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005d00 tx=0x7fa52c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4745b586c60b9c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa51b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c005220 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fa52c0053c0 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa524010af0 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa52c0055c0 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa54567b740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c764281fd0 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.669+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa524010af0 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa52c027780 con 0x55c7641f4410 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 20 client.15915 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c764282730 0x55c764284b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 4 client.15915 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c76415fd70 con 0x55c764282730 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c764282730 0x55c764284b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa51b7fe640 10 client.15915 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.670+0000 7fa53b7fe640 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c764282730 0x55c764284b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7299dd055c9571e3 server_cookie=ac4eb1b493b1799c in_seq=0 out_seq=0 2024-09-16T01:09:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.685+0000 7fa51b7fe640 1 -- 172.21.15.17:0/679696856 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c76415fd70 con 0x55c764282730 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.685+0000 7fa51b7fe640 10 client.15915 handle_command_reply: tid=0 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.685+0000 7fa54567b740 1 client.15915 shutdown 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 msgr2=0x55c764202870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005d00 tx=0x7fa52c012820 comp rx=0 tx=0).stop 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 shutdown_connections 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55c764282730 0x55c764284b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7641fecb0 0x55c764203000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa51b7fe640 0 client.15915 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7641f4410 0x55c764202870 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 --2- 172.21.15.17:0/679696856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55c7641f3af0 0x55c764207550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 >> 172.21.15.17:0/679696856 conn(0x55c7641f0060 msgr2=0x55c7641f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 shutdown_connections 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 1 -- 172.21.15.17:0/679696856 wait complete. 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa54567b740 20 client.15915 trim_cache size 0 max 16384 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:09:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 msgr2=0x7fa5280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 0x7fa5280a5920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5340ee3a0 tx=0x7fa53402cc70 comp rx=0 tx=0).stop 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 msgr2=0x7fa53c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.686+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa534004af0 tx=0x7fa53402f5d0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 shutdown_connections 2024-09-16T01:09:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa5280a3460 0x7fa5280a5920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c10c110 0x7fa53c101390 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c1035e0 0x7fa53c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 --2- 172.21.15.17:0/398705094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa53c102cc0 0x7fa53c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 >> 172.21.15.17:0/398705094 conn(0x7fa53c0fc6b0 msgr2=0x7fa53c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 shutdown_connections 2024-09-16T01:09:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:26.687+0000 7fa5427fd640 1 -- 172.21.15.17:0/398705094 wait complete. 2024-09-16T01:09:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:27 smithi088 ceph-mon[34093]: pgmap v217: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:27 smithi154 ceph-mon[34759]: pgmap v217: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:27 smithi017 ceph-mon[31211]: pgmap v217: 97 pgs: 97 active+clean; 3.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:29 smithi088 ceph-mon[34093]: pgmap v218: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-16T01:09:29.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:29 smithi154 ceph-mon[34759]: pgmap v218: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-16T01:09:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:29 smithi017 ceph-mon[31211]: pgmap v218: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-16T01:09:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:31 smithi088 ceph-mon[34093]: pgmap v219: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:31.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:31 smithi154 ceph-mon[34759]: pgmap v219: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:31.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:31 smithi017 ceph-mon[31211]: pgmap v219: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:09:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:09:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:09:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:09:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:09:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:09:32.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:09:32.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:09:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:09:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:09:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:09:32.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:09:33.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:33 smithi017 ceph-mon[31211]: pgmap v220: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:34.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:33 smithi088 ceph-mon[34093]: pgmap v220: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:34.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:33 smithi154 ceph-mon[34759]: pgmap v220: 97 pgs: 97 active+clean; 3.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:35.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:35 smithi017 ceph-mon[31211]: pgmap v221: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:36.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:35 smithi088 ceph-mon[34093]: pgmap v221: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:36.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:35 smithi154 ceph-mon[34759]: pgmap v221: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:37 smithi017 ceph-mon[31211]: pgmap v222: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:38.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:37 smithi088 ceph-mon[34093]: pgmap v222: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:38.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:37 smithi154 ceph-mon[34759]: pgmap v222: 97 pgs: 97 active+clean; 3.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 -- 172.21.15.17:0/1136913098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd8102cc0 msgr2=0x7fecd81030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 --2- 172.21.15.17:0/1136913098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd8102cc0 0x7fecd81030a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009900 tx=0x7fecd402a480 comp rx=0 tx=0).stop 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 -- 172.21.15.17:0/1136913098 shutdown_connections 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 --2- 172.21.15.17:0/1136913098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd810c110 0x7fecd810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 --2- 172.21.15.17:0/1136913098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd81035e0 0x7fecd810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 --2- 172.21.15.17:0/1136913098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd8102cc0 0x7fecd81030a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 -- 172.21.15.17:0/1136913098 >> 172.21.15.17:0/1136913098 conn(0x7fecd80fc6b0 msgr2=0x7fecd80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 -- 172.21.15.17:0/1136913098 shutdown_connections 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.784+0000 7fecdf34b640 1 -- 172.21.15.17:0/1136913098 wait complete. 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 Processor -- start 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 -- start start 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd8102cc0 0x7fecd8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd81035e0 0x7fecd81987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111df0 con 0x7fecd810c110 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111c70 con 0x7fecd8102cc0 2024-09-16T01:09:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdf34b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111f70 con 0x7fecd81035e0 2024-09-16T01:09:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdd8e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdd8e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51906/0 (socket says 172.21.15.17:51906) 2024-09-16T01:09:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.785+0000 7fecdd8e8640 1 -- 172.21.15.17:0/2600243525 learned_addr learned my addr 172.21.15.17:0/2600243525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd81035e0 0x7fecd81987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd8102cc0 0x7fecd8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 -- 172.21.15.17:0/2600243525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd81035e0 msgr2=0x7fecd81987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd81035e0 0x7fecd81987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 -- 172.21.15.17:0/2600243525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd8102cc0 msgr2=0x7fecd8198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd8102cc0 0x7fecd8198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 -- 172.21.15.17:0/2600243525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd819d270 con 0x7fecd810c110 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdd8e8640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fecd000eb10 tx=0x7fecd000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecce7fc640 1 -- 172.21.15.17:0/2600243525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004b20 con 0x7fecd810c110 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecce7fc640 1 -- 172.21.15.17:0/2600243525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecd0004cc0 con 0x7fecd810c110 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd819d560 con 0x7fecd810c110 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecce7fc640 1 -- 172.21.15.17:0/2600243525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0010690 con 0x7fecd810c110 2024-09-16T01:09:39.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.786+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd81a4df0 con 0x7fecd810c110 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 Processor -- start 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fecce7fc640 1 -- 172.21.15.17:0/2600243525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fecd0005020 con 0x7fecd810c110 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 -- start start 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad0f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0ffcb0 0x560fad1020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560fad0592f0 con 0x560fad0f5410 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x560fad001270 con 0x560fad0f4af0 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.789+0000 7fece21c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560fad0552b0 con 0x560fad0ffcb0 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51916/0 (socket says 172.21.15.17:51916) 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1829751563 learned_addr learned my addr 172.21.15.17:0/1829751563 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0ffcb0 0x560fad1020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad0f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecce7fc640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 0x7fecc40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1829751563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0ffcb0 msgr2=0x560fad1020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0ffcb0 0x560fad1020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1829751563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 msgr2=0x560fad0f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad0f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1829751563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fad000340 con 0x560fad0f5410 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd8e8640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 0x7fecc40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd4004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f640ac96c706f761 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecce7fc640 1 -- 172.21.15.17:0/2600243525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fecd00d03d0 con 0x7fecd810c110 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.790+0000 7fecc37fe640 1 -- 172.21.15.17:0/1829751563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4035040 con 0x560fad0f5410 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fecc37fe640 1 -- 172.21.15.17:0/1829751563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecd40054f0 con 0x560fad0f5410 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fecc37fe640 1 -- 172.21.15.17:0/1829751563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40035f0 con 0x560fad0f5410 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 -- 172.21.15.17:0/1829751563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 msgr2=0x560fad0ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fecdd8e8640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 0x7fecc40a5920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecd00a4d90 tx=0x7fecd0004e70 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd4004170 comp rx=0 tx=0).stop 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 -- 172.21.15.17:0/1829751563 shutdown_connections 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0ffcb0 0x560fad1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad0ff770 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 --2- 172.21.15.17:0/1829751563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad0f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 -- 172.21.15.17:0/1829751563 >> 172.21.15.17:0/1829751563 conn(0x560fad0f1060 msgr2=0x560fad0f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 -- 172.21.15.17:0/1829751563 shutdown_connections 2024-09-16T01:09:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.791+0000 7fece21c0740 1 -- 172.21.15.17:0/1829751563 wait complete. 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 -- start start 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 Processor -- start 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad1046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560fad102880 con 0x560fad0ffcb0 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x560facfe2290 con 0x560fad0f4af0 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560fad102a00 con 0x560fad0f5410 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fece21c0740 10 client.0 _ll_register_callbacks cb 0x560fad013140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fecdc8e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fecdc8e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51918/0 (socket says 172.21.15.17:51918) 2024-09-16T01:09:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fecdc8e6640 1 -- 172.21.15.17:0/2165186191 learned_addr learned my addr 172.21.15.17:0/2165186191 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.792+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad1046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 -- 172.21.15.17:0/2165186191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 msgr2=0x560fad1046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad1046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 -- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 msgr2=0x560fad104170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 -- 172.21.15.17:0/2165186191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560facd6c210 con 0x560fad0ffcb0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fecc8005fd0 tx=0x7fecc800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb9c2e5f07076d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8011cc0 con 0x560fad0ffcb0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fecc8004020 con 0x560fad0ffcb0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecd40054f0 con 0x560fad0ffcb0 2024-09-16T01:09:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fecc8011e60 con 0x560fad0ffcb0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fece21c0740 10 client.15927 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.793+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560face38620 con 0x560fad0ffcb0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecd40054f0 con 0x560fad0ffcb0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fecc801e030 con 0x560fad0ffcb0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 20 client.15927 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad114020 0x560fad116410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 4 client.15927 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fad066a20 con 0x560fad114020 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.794+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad114020 0x560fad116410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.795+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad114020 0x560fad116410 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d51a74ef237f852a server_cookie=9caff658d5ef2cfe in_seq=0 out_seq=0 2024-09-16T01:09:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.795+0000 7fecc0ff9640 10 client.15927 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.795+0000 7fecc0ff9640 1 -- 172.21.15.17:0/2165186191 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fad066a20 con 0x560fad114020 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.795+0000 7fecc0ff9640 10 client.15927 handle_command_reply: tid=0 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.795+0000 7fece21c0740 1 client.15927 shutdown 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 msgr2=0x560fad108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fecc8005fd0 tx=0x7fecc800bb80 comp rx=0 tx=0).stop 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 shutdown_connections 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad114020 0x560fad116410 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad108810 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad1046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 --2- 172.21.15.17:0/2165186191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fecc0ff9640 0 client.15927 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 >> 172.21.15.17:0/2165186191 conn(0x560fad0f1060 msgr2=0x560fad0f6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 shutdown_connections 2024-09-16T01:09:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 1 -- 172.21.15.17:0/2165186191 wait complete. 2024-09-16T01:09:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.796+0000 7fece21c0740 20 client.15927 trim_cache size 0 max 16384 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.810+0000 7fece21c0740 1 Processor -- start 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 -- start start 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad108800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81ab5b0 con 0x560fad0ffcb0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81ad0f0 con 0x560fad0f4af0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fece21c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81abc80 con 0x560fad0f5410 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51934/0 (socket says 172.21.15.17:51934) 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 -- 172.21.15.17:0/4046540478 learned_addr learned my addr 172.21.15.17:0/4046540478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad108800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 -- 172.21.15.17:0/4046540478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 msgr2=0x560fad108800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad108800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 -- 172.21.15.17:0/4046540478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 msgr2=0x560fad104650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 -- 172.21.15.17:0/4046540478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fad0f0e90 con 0x560fad0ffcb0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.811+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fecc8013690 tx=0x7fecc80105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f55400d4e6d26d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fecc2ffd640 1 -- 172.21.15.17:0/4046540478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8011cc0 con 0x560fad0ffcb0 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fecc2ffd640 1 -- 172.21.15.17:0/4046540478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecc800bbf0 con 0x560fad0ffcb0 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fecc2ffd640 1 -- 172.21.15.17:0/4046540478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc80035f0 con 0x560fad0ffcb0 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 -- 172.21.15.17:0/4046540478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 msgr2=0x560fad11bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fecc8013690 tx=0x7fecc80105d0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 -- 172.21.15.17:0/4046540478 shutdown_connections 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0ffcb0 0x560fad11bd00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f5410 0x560fad108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 --2- 172.21.15.17:0/4046540478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0f4af0 0x560fad104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 -- 172.21.15.17:0/4046540478 >> 172.21.15.17:0/4046540478 conn(0x560fad0f1060 msgr2=0x560fad103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 -- 172.21.15.17:0/4046540478 shutdown_connections 2024-09-16T01:09:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.812+0000 7fece21c0740 1 -- 172.21.15.17:0/4046540478 wait complete. 2024-09-16T01:09:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 -- start start 2024-09-16T01:09:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 Processor -- start 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f4af0 0x560fad10ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 0x560fad0fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81aca20 con 0x560fad0f5410 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81ac350 con 0x560fad0ffcb0 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81a95b0 con 0x560fad0f4af0 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fece21c0740 10 client.0 _ll_register_callbacks cb 0x7fecc8013770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51944/0 (socket says 172.21.15.17:51944) 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1212788405 learned_addr learned my addr 172.21.15.17:0/1212788405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f4af0 0x560fad10ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 0x560fad0fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1212788405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f4af0 msgr2=0x560fad10ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f4af0 0x560fad10ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 msgr2=0x560fad0fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 0x560fad0fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdd0e7640 1 -- 172.21.15.17:0/1212788405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fad0fe3f0 con 0x560fad0f5410 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.813+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 0x560fad0fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecdd0e7640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fecd402aa70 tx=0x7fecd4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd8103a24c4bddb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4035040 con 0x560fad0f5410 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fecd40037f0 con 0x560fad0f5410 2024-09-16T01:09:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc800bbf0 con 0x560fad0f5410 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fecd40044e0 con 0x560fad0f5410 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560fad10e730 con 0x560fad0f5410 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecc800bbf0 con 0x560fad0f5410 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fecd4031a40 con 0x560fad0f5410 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 20 client.15933 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad17ed70 0x560fad181160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 4 client.15933 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:09:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.814+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560fad060d70 con 0x560fad17ed70 2024-09-16T01:09:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.815+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad17ed70 0x560fad181160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.815+0000 7fecdc8e6640 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad17ed70 0x560fad181160 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8768062f5f69005 server_cookie=cd324a508c940fbd in_seq=0 out_seq=0 2024-09-16T01:09:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.815+0000 7fecc0ff9640 10 client.15933 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fecc0ff9640 1 -- 172.21.15.17:0/1212788405 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560fad060d70 con 0x560fad17ed70 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fecc0ff9640 10 client.15933 handle_command_reply: tid=0 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 client.15933 shutdown 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 msgr2=0x560fad1104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fecd402aa70 tx=0x7fecd4004ab0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 shutdown_connections 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560fad17ed70 0x560fad181160 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560fad0ffcb0 0x560fad0fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fecc0ff9640 0 client.15933 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fad0f5410 0x560fad1104b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 --2- 172.21.15.17:0/1212788405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fad0f4af0 0x560fad10ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 >> 172.21.15.17:0/1212788405 conn(0x560fad0f1060 msgr2=0x560fad0ef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 shutdown_connections 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 1 -- 172.21.15.17:0/1212788405 wait complete. 2024-09-16T01:09:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.831+0000 7fece21c0740 20 client.15933 trim_cache size 0 max 16384 2024-09-16T01:09:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:09:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:09:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:09:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 msgr2=0x7fecc40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 0x7fecc40a5920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecd00a4d90 tx=0x7fecd0004e70 comp rx=0 tx=0).stop 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 msgr2=0x7fecd819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fecd000eb10 tx=0x7fecd000c2d0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 shutdown_connections 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fecc40a3460 0x7fecc40a5920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd810c110 0x7fecd819cb40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd81035e0 0x7fecd81987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 --2- 172.21.15.17:0/2600243525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd8102cc0 0x7fecd8198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 >> 172.21.15.17:0/2600243525 conn(0x7fecd80fc6b0 msgr2=0x7fecd80fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 shutdown_connections 2024-09-16T01:09:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:39.832+0000 7fecdf34b640 1 -- 172.21.15.17:0/2600243525 wait complete. 2024-09-16T01:09:39.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:39 smithi017 ceph-mon[31211]: pgmap v223: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:09:40.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:39 smithi088 ceph-mon[34093]: pgmap v223: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:09:40.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:39 smithi154 ceph-mon[34759]: pgmap v223: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:09:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:41 smithi017 ceph-mon[31211]: pgmap v224: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:42.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:41 smithi088 ceph-mon[34093]: pgmap v224: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:42.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:41 smithi154 ceph-mon[34759]: pgmap v224: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:42.669 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:313/600: open fd = 3 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:314/600: open fd = 3 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:315/600: open fd = 3 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.670 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:316/600: open fd = 3 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:317/600: open fd = 3 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:318/600: open fd = 3 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.671 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:319/600: open fd = 3 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:320/600: open fd = 3 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:321/600: open fd = 3 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.672 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:322/600: open fd = 3 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:323/600: open fd = 3 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:324/600: open fd = 3 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.673 INFO:tasks.workunit.client.0.smithi017.stdout:325/600: open fd = 3 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:326/600: open fd = 3 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:327/600: open fd = 3 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:328/600: open fd = 3 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:329/600: open fd = 3 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:330/600: open fd = 3 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:331/600: open fd = 3 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.675 INFO:tasks.workunit.client.0.smithi017.stdout:332/600: open fd = 3 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:333/600: open fd = 3 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:334/600: open fd = 3 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:335/600: open fd = 3 2024-09-16T01:09:42.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:336/600: open fd = 3 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.677 INFO:tasks.workunit.client.0.smithi017.stdout:337/600: open fd = 3 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:338/600: open fd = 3 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:339/600: open fd = 3 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:340/600: open fd = 3 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:341/600: open fd = 3 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:342/600: open fd = 3 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:343/600: open fd = 3 2024-09-16T01:09:42.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:344/600: open fd = 3 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:345/600: open fd = 3 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:346/600: open fd = 3 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:347/600: open fd = 3 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:348/600: open fd = 3 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:349/600: open fd = 3 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.681 INFO:tasks.workunit.client.0.smithi017.stdout:350/600: open fd = 3 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:351/600: open fd = 3 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:352/600: open fd = 3 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:353/600: open fd = 3 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:354/600: open fd = 3 2024-09-16T01:09:42.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:355/600: open fd = 3 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.684 INFO:tasks.workunit.client.0.smithi017.stdout:356/600: open fd = 3 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:357/600: open fd = 3 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:358/600: open fd = 3 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.686 INFO:tasks.workunit.client.0.smithi017.stdout:359/600: open fd = 3 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:360/600: open fd = 3 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:361/600: open fd = 3 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.688 INFO:tasks.workunit.client.0.smithi017.stdout:362/600: open fd = 3 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:363/600: open fd = 3 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.689 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:364/600: open fd = 3 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:365/600: open fd = 3 2024-09-16T01:09:42.690 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:366/600: open fd = 3 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.691 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.692 INFO:tasks.workunit.client.0.smithi017.stdout:367/600: open fd = 3 2024-09-16T01:09:42.692 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.692 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.692 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.692 INFO:tasks.workunit.client.0.smithi017.stdout:368/600: open fd = 3 2024-09-16T01:09:42.693 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.693 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.693 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.693 INFO:tasks.workunit.client.0.smithi017.stdout:369/600: open fd = 3 2024-09-16T01:09:42.694 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.694 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.694 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.694 INFO:tasks.workunit.client.0.smithi017.stdout:370/600: open fd = 3 2024-09-16T01:09:42.694 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:371/600: open fd = 3 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.695 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:372/600: open fd = 3 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:373/600: open fd = 3 2024-09-16T01:09:42.696 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:374/600: open fd = 3 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:09:42.697 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:09:43.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:43 smithi017 ceph-mon[31211]: pgmap v225: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:44.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:43 smithi088 ceph-mon[34093]: pgmap v225: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:44.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:43 smithi154 ceph-mon[34759]: pgmap v225: 97 pgs: 97 active+clean; 4.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:09:45.945 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:45 smithi088 ceph-mon[34093]: pgmap v226: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:45.956 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:45 smithi154 ceph-mon[34759]: pgmap v226: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:46.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:45 smithi017 ceph-mon[31211]: pgmap v226: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:48.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:47 smithi088 ceph-mon[34093]: pgmap v227: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:48.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:47 smithi154 ceph-mon[34759]: pgmap v227: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:48.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:47 smithi017 ceph-mon[31211]: pgmap v227: 97 pgs: 97 active+clean; 4.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:50.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:49 smithi088 ceph-mon[34093]: pgmap v228: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:50.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:49 smithi154 ceph-mon[34759]: pgmap v228: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:50.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:49 smithi017 ceph-mon[31211]: pgmap v228: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:09:52.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:51 smithi088 ceph-mon[34093]: pgmap v229: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:52.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:51 smithi154 ceph-mon[34759]: pgmap v229: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:52.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:51 smithi017 ceph-mon[31211]: pgmap v229: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 -- 172.21.15.17:0/367012825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 msgr2=0x7f130c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 --2- 172.21.15.17:0/367012825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c1030a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009900 tx=0x7f12fc02a480 comp rx=0 tx=0).stop 2024-09-16T01:09:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 -- 172.21.15.17:0/367012825 shutdown_connections 2024-09-16T01:09:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 --2- 172.21.15.17:0/367012825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 0x7f130c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 --2- 172.21.15.17:0/367012825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 0x7f130c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 --2- 172.21.15.17:0/367012825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c1030a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 -- 172.21.15.17:0/367012825 >> 172.21.15.17:0/367012825 conn(0x7f130c0fc6b0 msgr2=0x7f130c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 -- 172.21.15.17:0/367012825 shutdown_connections 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.931+0000 7f1312077640 1 -- 172.21.15.17:0/367012825 wait complete. 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 Processor -- start 2024-09-16T01:09:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 -- start start 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 0x7f130c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 0x7f130c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f130c111da0 con 0x7f130c102cc0 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f130c111c20 con 0x7f130c10c110 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f1312077640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f130c111f20 con 0x7f130c1035e0 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f130b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f130b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59388/0 (socket says 172.21.15.17:59388) 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f130b7fe640 1 -- 172.21.15.17:0/1446292638 learned_addr learned my addr 172.21.15.17:0/1446292638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.932+0000 7f130affd640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 0x7f130c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130bfff640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 0x7f130c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 -- 172.21.15.17:0/1446292638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 msgr2=0x7f130c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 0x7f130c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 -- 172.21.15.17:0/1446292638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 msgr2=0x7f130c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 0x7f130c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 -- 172.21.15.17:0/1446292638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c19d260 con 0x7f130c102cc0 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f130b7fe640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005940 tx=0x7f12fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f1308ff9640 1 -- 172.21.15.17:0/1446292638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc03f030 con 0x7f130c102cc0 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f1308ff9640 1 -- 172.21.15.17:0/1446292638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12fc003cb0 con 0x7f130c102cc0 2024-09-16T01:09:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c19d4f0 con 0x7f130c102cc0 2024-09-16T01:09:52.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f1308ff9640 1 -- 172.21.15.17:0/1446292638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc035070 con 0x7f130c102cc0 2024-09-16T01:09:52.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.933+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c1a4de0 con 0x7f130c102cc0 2024-09-16T01:09:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1308ff9640 1 -- 172.21.15.17:0/1446292638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f12fc042030 con 0x7f130c102cc0 2024-09-16T01:09:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 Processor -- start 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 -- start start 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559e1b54e2f0 con 0x559e1b5e99f0 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x559e1b4f6270 con 0x559e1b5f90c0 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f1314e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1b54a2b0 con 0x559e1b5ea310 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59400/0 (socket says 172.21.15.17:59400) 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f130bfff640 1 -- 172.21.15.17:0/510793982 learned_addr learned my addr 172.21.15.17:0/510793982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f130b7fe640 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.936+0000 7f130affd640 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 -- 172.21.15.17:0/510793982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 msgr2=0x559e1b5f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 -- 172.21.15.17:0/510793982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 msgr2=0x559e1b5fb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f1308ff9640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 0x7f12f40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 -- 172.21.15.17:0/510793982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1b4f5340 con 0x559e1b5e99f0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130b7fe640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 0x7f12f40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f130bfff640 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1304009f40 tx=0x7f1304010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8752cad47f9369 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f1308ff9640 1 -- 172.21.15.17:0/1446292638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f12fc0f04e0 con 0x7f130c102cc0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f12f1ffb640 1 -- 172.21.15.17:0/510793982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304003b70 con 0x559e1b5e99f0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f12f1ffb640 1 -- 172.21.15.17:0/510793982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1304003d10 con 0x559e1b5e99f0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.937+0000 7f12f1ffb640 1 -- 172.21.15.17:0/510793982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304011960 con 0x559e1b5e99f0 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- 172.21.15.17:0/510793982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 msgr2=0x559e1b5e9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f130b7fe640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 0x7f12f40a5920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0edce0 tx=0x7f12fc0f60e0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1304009f40 tx=0x7f1304010860 comp rx=0 tx=0).stop 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- 172.21.15.17:0/510793982 shutdown_connections 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 --2- 172.21.15.17:0/510793982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5e9dd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- 172.21.15.17:0/510793982 >> 172.21.15.17:0/510793982 conn(0x559e1b5e6060 msgr2=0x559e1b5e6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- 172.21.15.17:0/510793982 shutdown_connections 2024-09-16T01:09:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- 172.21.15.17:0/510793982 wait complete. 2024-09-16T01:09:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.938+0000 7f1314e0d740 1 -- start start 2024-09-16T01:09:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 Processor -- start 2024-09-16T01:09:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559e1b5fbd20 con 0x559e1b5ea310 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x559e1b4d7290 con 0x559e1b5f90c0 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1b5fbea0 con 0x559e1b5e99f0 2024-09-16T01:09:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f1314e0d740 10 client.0 _ll_register_callbacks cb 0x559e1b508140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59404/0 (socket says 172.21.15.17:59404) 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 -- 172.21.15.17:0/1644799595 learned_addr learned my addr 172.21.15.17:0/1644799595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130bfff640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 -- 172.21.15.17:0/1644799595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5e99f0 msgr2=0x559e1b5f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 -- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 msgr2=0x559e1b5f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130bfff640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130affd640 1 -- 172.21.15.17:0/1644799595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1b261210 con 0x559e1b5ea310 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.939+0000 7f130bfff640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f130affd640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f130000bac0 tx=0x7f130000bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1db3b6298fd7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300003e20 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f1300011440 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1304003d10 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1300005020 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e1b32d620 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1304003d10 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1300011640 con 0x559e1b5ea310 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 20 client.15945 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b609280 0x559e1b60b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 4 client.15945 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.940+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e1b55ba20 con 0x559e1b609280 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.941+0000 7f130bfff640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b609280 0x559e1b60b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.941+0000 7f130bfff640 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b609280 0x559e1b60b670 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b376e8e9bb5633 server_cookie=c7bd1f3203a4f7d3 in_seq=0 out_seq=0 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.941+0000 7f12eaffd640 10 client.15945 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f12eaffd640 1 -- 172.21.15.17:0/1644799595 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e1b55ba20 con 0x559e1b609280 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f12eaffd640 10 client.15945 handle_command_reply: tid=0 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 client.15945 shutdown 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 msgr2=0x559e1b5f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f130000bac0 tx=0x7f130000bf80 comp rx=0 tx=0).stop 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 shutdown_connections 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b609280 0x559e1b60b670 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5ea310 0x559e1b5f65c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 --2- 172.21.15.17:0/1644799595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f12eaffd640 0 client.15945 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 >> 172.21.15.17:0/1644799595 conn(0x559e1b5e6060 msgr2=0x559e1b5ebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 shutdown_connections 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 1 -- 172.21.15.17:0/1644799595 wait complete. 2024-09-16T01:09:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.942+0000 7f1314e0d740 20 client.15945 trim_cache size 0 max 16384 2024-09-16T01:09:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 Processor -- start 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 -- start start 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5ea310 0x559e1b610f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5f90c0 0x559e1b611470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1ab540 con 0x559e1b5e99f0 2024-09-16T01:09:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1ad080 con 0x559e1b5ea310 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f1314e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1abc10 con 0x559e1b5f90c0 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59414/0 (socket says 172.21.15.17:59414) 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 -- 172.21.15.17:0/997216619 learned_addr learned my addr 172.21.15.17:0/997216619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 -- 172.21.15.17:0/997216619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5f90c0 msgr2=0x559e1b611470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5f90c0 0x559e1b611470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 -- 172.21.15.17:0/997216619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5ea310 msgr2=0x559e1b610f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130affd640 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5ea310 0x559e1b610f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5ea310 0x559e1b610f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.957+0000 7f130bfff640 1 -- 172.21.15.17:0/997216619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1b5ea140 con 0x559e1b5e99f0 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f130bfff640 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1304010d60 tx=0x7f1304010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43abbe0871e493f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f12f17fa640 1 -- 172.21.15.17:0/997216619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304004a00 con 0x559e1b5e99f0 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f12f17fa640 1 -- 172.21.15.17:0/997216619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1304004ba0 con 0x559e1b5e99f0 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f12f17fa640 1 -- 172.21.15.17:0/997216619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304011500 con 0x559e1b5e99f0 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 -- 172.21.15.17:0/997216619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 msgr2=0x559e1b5f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1304010d60 tx=0x7f1304010860 comp rx=0 tx=0).stop 2024-09-16T01:09:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 -- 172.21.15.17:0/997216619 shutdown_connections 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5f90c0 0x559e1b611470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5ea310 0x559e1b610f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 --2- 172.21.15.17:0/997216619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b5f6930 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.958+0000 7f1314e0d740 1 -- 172.21.15.17:0/997216619 >> 172.21.15.17:0/997216619 conn(0x559e1b5e6060 msgr2=0x559e1b5f8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- 172.21.15.17:0/997216619 shutdown_connections 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- 172.21.15.17:0/997216619 wait complete. 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- start start 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 Processor -- start 2024-09-16T01:09:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1ac9b0 con 0x559e1b5e99f0 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1ac2e0 con 0x559e1b5f90c0 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1a9540 con 0x559e1b5ea310 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f1314e0d740 10 client.0 _ll_register_callbacks cb 0x7f1300004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.959+0000 7f130bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59416/0 (socket says 172.21.15.17:59416) 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 -- 172.21.15.17:0/4074396668 learned_addr learned my addr 172.21.15.17:0/4074396668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130affd640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 -- 172.21.15.17:0/4074396668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 msgr2=0x559e1b5fcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5fcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 -- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 msgr2=0x559e1b5fd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 -- 172.21.15.17:0/4074396668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1b5fd830 con 0x559e1b5e99f0 2024-09-16T01:09:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f130bfff640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1304005bd0 tx=0x7f1304010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7119a770d24e815 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f12eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304036070 con 0x559e1b5e99f0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f1304024040 con 0x559e1b5e99f0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1304004ba0 con 0x559e1b5e99f0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13040119f0 con 0x559e1b5e99f0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f1314e0d740 10 client.15951 fetch_fsmap learned FSMap version 28 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e1b673e40 con 0x559e1b5e99f0 2024-09-16T01:09:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.960+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1304004ba0 con 0x559e1b5e99f0 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f130401b420 con 0x559e1b5e99f0 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 20 client.15951 populate_metadata read hostname 'smithi017' 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b6742c0 0x559e1b6766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 4 client.15951 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e1b555d70 con 0x559e1b6742c0 2024-09-16T01:09:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f130affd640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b6742c0 0x559e1b6766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:09:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f12eaffd640 10 client.15951 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:52.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.961+0000 7f130affd640 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b6742c0 0x559e1b6766b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9f7cab6ce9a25d server_cookie=2785df236de2569a in_seq=0 out_seq=0 2024-09-16T01:09:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f12eaffd640 1 -- 172.21.15.17:0/4074396668 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e1b555d70 con 0x559e1b6742c0 2024-09-16T01:09:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f12eaffd640 10 client.15951 handle_command_reply: tid=0 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 client.15951 shutdown 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 msgr2=0x559e1b6017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1304005bd0 tx=0x7f1304010e70 comp rx=0 tx=0).stop 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 shutdown_connections 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x559e1b6742c0 0x559e1b6766b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x559e1b5f90c0 0x559e1b5fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1b5ea310 0x559e1b5fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 --2- 172.21.15.17:0/4074396668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e1b5e99f0 0x559e1b6017a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 >> 172.21.15.17:0/4074396668 conn(0x559e1b5e6060 msgr2=0x559e1b5f8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f12eaffd640 0 client.15951 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 shutdown_connections 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 1 -- 172.21.15.17:0/4074396668 wait complete. 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1314e0d740 20 client.15951 trim_cache size 0 max 16384 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:09:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 msgr2=0x7f12f40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 0x7f12f40a5920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0edce0 tx=0x7f12fc0f60e0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 msgr2=0x7f130c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:09:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005940 tx=0x7f12fc0042f0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 shutdown_connections 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f12f40a3460 0x7f12f40a5920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f130c10c110 0x7f130c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c1035e0 0x7f130c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 --2- 172.21.15.17:0/1446292638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f130c102cc0 0x7f130c198270 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 >> 172.21.15.17:0/1446292638 conn(0x7f130c0fc6b0 msgr2=0x7f130c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.978+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 shutdown_connections 2024-09-16T01:09:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:09:52.979+0000 7f1312077640 1 -- 172.21.15.17:0/1446292638 wait complete. 2024-09-16T01:09:54.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:53 smithi088 ceph-mon[34093]: pgmap v230: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:54.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:53 smithi154 ceph-mon[34759]: pgmap v230: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:54.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:53 smithi017 ceph-mon[31211]: pgmap v230: 97 pgs: 97 active+clean; 4.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:09:56.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:55 smithi088 ceph-mon[34093]: pgmap v231: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:09:56.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:55 smithi154 ceph-mon[34759]: pgmap v231: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:09:56.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:55 smithi017 ceph-mon[31211]: pgmap v231: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:09:58.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:57 smithi088 ceph-mon[34093]: pgmap v232: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:58.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:57 smithi154 ceph-mon[34759]: pgmap v232: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:09:58.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:57 smithi017 ceph-mon[31211]: pgmap v232: 97 pgs: 97 active+clean; 4.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:00.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:09:59 smithi088 ceph-mon[34093]: pgmap v233: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:00.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:09:59 smithi154 ceph-mon[34759]: pgmap v233: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:00.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:09:59 smithi017 ceph-mon[31211]: pgmap v233: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:01.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:00 smithi088 ceph-mon[34093]: overall HEALTH_OK 2024-09-16T01:10:01.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:00 smithi154 ceph-mon[34759]: overall HEALTH_OK 2024-09-16T01:10:01.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:00 smithi017 ceph-mon[31211]: overall HEALTH_OK 2024-09-16T01:10:02.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:01 smithi088 ceph-mon[34093]: pgmap v234: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:02.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:01 smithi154 ceph-mon[34759]: pgmap v234: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:02.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:01 smithi017 ceph-mon[31211]: pgmap v234: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:04.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:03 smithi088 ceph-mon[34093]: pgmap v235: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:04.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:03 smithi154 ceph-mon[34759]: pgmap v235: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:04.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:03 smithi017 ceph-mon[31211]: pgmap v235: 97 pgs: 97 active+clean; 4.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:05.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:04 smithi088 ceph-mon[34093]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:10:05.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:04 smithi154 ceph-mon[34759]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:10:05.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:04 smithi017 ceph-mon[31211]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:10:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 -- 172.21.15.17:0/3402009437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 msgr2=0x7f234410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 --2- 172.21.15.17:0/3402009437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f234410bb20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a480 comp rx=0 tx=0).stop 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 -- 172.21.15.17:0/3402009437 shutdown_connections 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 --2- 172.21.15.17:0/3402009437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f234410c0f0 0x7f234410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 --2- 172.21.15.17:0/3402009437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f234410bb20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 --2- 172.21.15.17:0/3402009437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2344102d20 0x7f2344103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 -- 172.21.15.17:0/3402009437 >> 172.21.15.17:0/3402009437 conn(0x7f2344077990 msgr2=0x7f23440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 -- 172.21.15.17:0/3402009437 shutdown_connections 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.079+0000 7f234b74b640 1 -- 172.21.15.17:0/3402009437 wait complete. 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 Processor -- start 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 -- start start 2024-09-16T01:10:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 0x7f2344198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f234410c0f0 0x7f234419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2344111d70 con 0x7f2344103640 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2344111bf0 con 0x7f234410c0f0 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f234b74b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2344111ef0 con 0x7f2344102d20 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52692/0 (socket says 172.21.15.17:52692) 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.080+0000 7f2348ce6640 1 -- 172.21.15.17:0/1160026728 learned_addr learned my addr 172.21.15.17:0/1160026728 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f234410c0f0 0x7f234419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f23494e7640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 0x7f2344198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 -- 172.21.15.17:0/1160026728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 msgr2=0x7f2344198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 0x7f2344198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 -- 172.21.15.17:0/1160026728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f234410c0f0 msgr2=0x7f234419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f234410c0f0 0x7f234419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 -- 172.21.15.17:0/1160026728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234419d250 con 0x7f2344103640 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f23494e7640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 0x7f2344198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2334005940 tx=0x7f23340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f233a7fc640 1 -- 172.21.15.17:0/1160026728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233403f030 con 0x7f2344103640 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234419d4e0 con 0x7f2344103640 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f233a7fc640 1 -- 172.21.15.17:0/1160026728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2334003cb0 con 0x7f2344103640 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f233a7fc640 1 -- 172.21.15.17:0/1160026728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334035070 con 0x7f2344103640 2024-09-16T01:10:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.081+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23441a4dd0 con 0x7f2344103640 2024-09-16T01:10:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.084+0000 7f233a7fc640 1 -- 172.21.15.17:0/1160026728 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2334042030 con 0x7f2344103640 2024-09-16T01:10:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.084+0000 7f234e5c0740 1 Processor -- start 2024-09-16T01:10:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.084+0000 7f234e5c0740 1 -- start start 2024-09-16T01:10:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f0af0 0x564e4f3f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 0x564e4f3fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564e4f3552f0 con 0x564e4f3fbcb0 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x564e4f2fd270 con 0x564e4f3f1410 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f234e5c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e4f3512b0 con 0x564e4f3f0af0 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52708/0 (socket says 172.21.15.17:52708) 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 -- 172.21.15.17:0/3340087952 learned_addr learned my addr 172.21.15.17:0/3340087952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f23494e7640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 0x564e4f3fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2349ce8640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f0af0 0x564e4f3f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f233a7fc640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 0x7f23300a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 -- 172.21.15.17:0/3340087952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f0af0 msgr2=0x564e4f3f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 0x7f23300a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f0af0 0x564e4f3f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 -- 172.21.15.17:0/3340087952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 msgr2=0x564e4f3fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 0x564e4f3fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f233a7fc640 1 -- 172.21.15.17:0/1160026728 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f23340f0650 con 0x7f2344103640 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f2348ce6640 1 -- 172.21.15.17:0/3340087952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4f2fc340 con 0x564e4f3fbcb0 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.085+0000 7f23494e7640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 0x564e4f3fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.086+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f23340b8d10 tx=0x7f233402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94320bbb727aba41 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.086+0000 7f232f7fe640 1 -- 172.21.15.17:0/3340087952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334049030 con 0x564e4f3fbcb0 2024-09-16T01:10:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.086+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 0x7f23300a5920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233c005fd0 tx=0x7f233c004ab0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.086+0000 7f232f7fe640 1 -- 172.21.15.17:0/3340087952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23340bcfb0 con 0x564e4f3fbcb0 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.086+0000 7f232f7fe640 1 -- 172.21.15.17:0/3340087952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340b8f20 con 0x564e4f3fbcb0 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- 172.21.15.17:0/3340087952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 msgr2=0x564e4f3fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f23340b8d10 tx=0x7f233402a480 comp rx=0 tx=0).stop 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- 172.21.15.17:0/3340087952 shutdown_connections 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f3fe0a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f1410 0x564e4f3fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3340087952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f0af0 0x564e4f3f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- 172.21.15.17:0/3340087952 >> 172.21.15.17:0/3340087952 conn(0x564e4f3ed060 msgr2=0x564e4f3ed440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- 172.21.15.17:0/3340087952 shutdown_connections 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- 172.21.15.17:0/3340087952 wait complete. 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 -- start start 2024-09-16T01:10:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.087+0000 7f234e5c0740 1 Processor -- start 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f3f9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564e4f3fe640 con 0x564e4f3f0af0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x564e4f2de290 con 0x564e4f3fbcb0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e4f3fe7c0 con 0x564e4f3f1410 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f234e5c0740 10 client.0 _ll_register_callbacks cb 0x564e4f30f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52714/0 (socket says 172.21.15.17:52714) 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 -- 172.21.15.17:0/1952495387 learned_addr learned my addr 172.21.15.17:0/1952495387 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f3f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 -- 172.21.15.17:0/1952495387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 msgr2=0x564e4f3f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f3f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 -- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3fbcb0 msgr2=0x564e4f3f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 -- 172.21.15.17:0/1952495387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4f068210 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f23494e7640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f234000bf50 tx=0x7f23400128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35c8510f0d99335 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.088+0000 7f232cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23400108a0 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f2340010a40 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23340bcfb0 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2340010c40 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 10 client.15963 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e4f134620 con 0x564e4f3f0af0 2024-09-16T01:10:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23340bcfb0 con 0x564e4f3f0af0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2340023380 con 0x564e4f3f0af0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 20 client.15963 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f40b8c0 0x564e4f40dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 4 client.15963 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.089+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e4f362a20 con 0x564e4f40b8c0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.090+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f40b8c0 0x564e4f40dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.090+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f40b8c0 0x564e4f40dcf0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7006b56bd0c87060 server_cookie=835b4a0baf499c1b in_seq=0 out_seq=0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.090+0000 7f232cff9640 10 client.15963 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f232cff9640 1 -- 172.21.15.17:0/1952495387 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e4f362a20 con 0x564e4f40b8c0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f232cff9640 10 client.15963 handle_command_reply: tid=0 2024-09-16T01:10:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 client.15963 shutdown 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 msgr2=0x564e4f3f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f234000bf50 tx=0x7f23400128e0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 shutdown_connections 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f40b8c0 0x564e4f40dcf0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f3f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1952495387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f0af0 0x564e4f3f8b10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f232cff9640 0 client.15963 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 >> 172.21.15.17:0/1952495387 conn(0x564e4f3ed060 msgr2=0x564e4f3f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 shutdown_connections 2024-09-16T01:10:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 1 -- 172.21.15.17:0/1952495387 wait complete. 2024-09-16T01:10:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.091+0000 7f234e5c0740 20 client.15963 trim_cache size 0 max 16384 2024-09-16T01:10:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 Processor -- start 2024-09-16T01:10:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 -- start start 2024-09-16T01:10:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f413650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f23441ad7e0 con 0x564e4f3fbcb0 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23441af320 con 0x564e4f3f0af0 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f234e5c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23441adeb0 con 0x564e4f3f1410 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52724/0 (socket says 172.21.15.17:52724) 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 -- 172.21.15.17:0/1141504841 learned_addr learned my addr 172.21.15.17:0/1141504841 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f23494e7640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f413650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 -- 172.21.15.17:0/1141504841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 msgr2=0x564e4f413650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f413650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 -- 172.21.15.17:0/1141504841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 msgr2=0x564e4f3f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2349ce8640 1 -- 172.21.15.17:0/1141504841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4f3ece90 con 0x564e4f3fbcb0 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f23494e7640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.106+0000 7f2348ce6640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f413650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f2349ce8640 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f233c012e90 tx=0x7f233c009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f543fa68af28f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f232effd640 1 -- 172.21.15.17:0/1141504841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c021970 con 0x564e4f3fbcb0 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f232effd640 1 -- 172.21.15.17:0/1141504841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f233c010420 con 0x564e4f3fbcb0 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f232effd640 1 -- 172.21.15.17:0/1141504841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c00f620 con 0x564e4f3fbcb0 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 -- 172.21.15.17:0/1141504841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 msgr2=0x564e4f413b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f233c012e90 tx=0x7f233c009ab0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 -- 172.21.15.17:0/1141504841 shutdown_connections 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3fbcb0 0x564e4f413b90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3f1410 0x564e4f413650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 --2- 172.21.15.17:0/1141504841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 -- 172.21.15.17:0/1141504841 >> 172.21.15.17:0/1141504841 conn(0x564e4f3ed060 msgr2=0x564e4f3fab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 -- 172.21.15.17:0/1141504841 shutdown_connections 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.107+0000 7f234e5c0740 1 -- 172.21.15.17:0/1141504841 wait complete. 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 -- start start 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 Processor -- start 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f23441aec50 con 0x564e4f3f1410 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23441ae580 con 0x564e4f3f0af0 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23441ab7e0 con 0x564e4f3fbcb0 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f234e5c0740 10 client.0 _ll_register_callbacks cb 0x7f234000b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f2348ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52728/0 (socket says 172.21.15.17:52728) 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.108+0000 7f2348ce6640 1 -- 172.21.15.17:0/3468061447 learned_addr learned my addr 172.21.15.17:0/3468061447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f23494e7640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 -- 172.21.15.17:0/3468061447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 msgr2=0x564e4f3f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2349ce8640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 -- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 msgr2=0x564e4f3f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 -- 172.21.15.17:0/3468061447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4f4756f0 con 0x564e4f3f1410 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f23494e7640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2349ce8640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f2348ce6640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f23340bc840 tx=0x7f2334009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ee5cc47861c7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f232cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334049040 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f233403b460 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f233c010420 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23340bcfb0 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f234e5c0740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564e4f476970 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.109+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f233c010420 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f23340edfa0 con 0x564e4f3f1410 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 20 client.15969 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f476f60 0x564e4f479380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 4 client.15969 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:10:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e4f35cd70 con 0x564e4f476f60 2024-09-16T01:10:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f23494e7640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f476f60 0x564e4f479380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f232cff9640 10 client.15969 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.110+0000 7f23494e7640 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f476f60 0x564e4f479380 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54647221cba6115 server_cookie=221dd0271e22c691 in_seq=0 out_seq=0 2024-09-16T01:10:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f232cff9640 1 -- 172.21.15.17:0/3468061447 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e4f35cd70 con 0x564e4f476f60 2024-09-16T01:10:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f232cff9640 10 client.15969 handle_command_reply: tid=0 2024-09-16T01:10:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 client.15969 shutdown 2024-09-16T01:10:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 msgr2=0x564e4f3f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f23340bc840 tx=0x7f2334009610 comp rx=0 tx=0).stop 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 shutdown_connections 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x564e4f476f60 0x564e4f479380 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e4f3fbcb0 0x564e4f3f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e4f3f1410 0x564e4f3f61c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f232cff9640 0 client.15969 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 --2- 172.21.15.17:0/3468061447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564e4f3f0af0 0x564e4f3f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 >> 172.21.15.17:0/3468061447 conn(0x564e4f3ed060 msgr2=0x564e4f3ec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 shutdown_connections 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 1 -- 172.21.15.17:0/3468061447 wait complete. 2024-09-16T01:10:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.126+0000 7f234e5c0740 20 client.15969 trim_cache size 0 max 16384 2024-09-16T01:10:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:10:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:10:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:10:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:10:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 msgr2=0x7f23300a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 0x7f23300a5920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233c005fd0 tx=0x7f233c004ab0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 msgr2=0x7f23441987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2334005940 tx=0x7f23340042f0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 shutdown_connections 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f23300a3460 0x7f23300a5920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f234410c0f0 0x7f234419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2344103640 0x7f23441987a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 --2- 172.21.15.17:0/1160026728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2344102d20 0x7f2344198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 >> 172.21.15.17:0/1160026728 conn(0x7f2344077990 msgr2=0x7f23440fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 shutdown_connections 2024-09-16T01:10:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:06.127+0000 7f234b74b640 1 -- 172.21.15.17:0/1160026728 wait complete. 2024-09-16T01:10:06.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:05 smithi088 ceph-mon[34093]: pgmap v237: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:06.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:05 smithi154 ceph-mon[34759]: pgmap v237: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:06.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:05 smithi017 ceph-mon[31211]: pgmap v237: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:08.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:07 smithi088 ceph-mon[34093]: pgmap v238: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:08.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:07 smithi154 ceph-mon[34759]: pgmap v238: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:08.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:07 smithi017 ceph-mon[31211]: pgmap v238: 97 pgs: 97 active+clean; 5.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-09-16T01:10:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:09 smithi088 ceph-mon[34093]: pgmap v239: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:10.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:09 smithi154 ceph-mon[34759]: pgmap v239: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:10.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:09 smithi017 ceph-mon[31211]: pgmap v239: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:11 smithi088 ceph-mon[34093]: pgmap v240: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:11 smithi154 ceph-mon[34759]: pgmap v240: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:12.187 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:11 smithi017 ceph-mon[31211]: pgmap v240: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:10:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:13 smithi088 ceph-mon[34093]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:10:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:13 smithi088 ceph-mon[34093]: pgmap v242: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-16T01:10:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:13 smithi154 ceph-mon[34759]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:10:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:13 smithi154 ceph-mon[34759]: pgmap v242: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-16T01:10:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:13 smithi017 ceph-mon[31211]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:10:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:13 smithi017 ceph-mon[31211]: pgmap v242: 97 pgs: 97 active+clean; 5.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-16T01:10:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:15 smithi088 ceph-mon[34093]: pgmap v243: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:15.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:15 smithi154 ceph-mon[34759]: pgmap v243: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:15 smithi017 ceph-mon[31211]: pgmap v243: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:17 smithi088 ceph-mon[34093]: pgmap v244: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:17.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:17 smithi154 ceph-mon[34759]: pgmap v244: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:17 smithi017 ceph-mon[31211]: pgmap v244: 97 pgs: 97 active+clean; 5.5 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:10:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 -- 172.21.15.17:0/1447998177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80105520 msgr2=0x7f0f8010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 --2- 172.21.15.17:0/1447998177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80105520 0x7f0f8010d070 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009ca0 tx=0x7f0f7002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 -- 172.21.15.17:0/1447998177 shutdown_connections 2024-09-16T01:10:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 --2- 172.21.15.17:0/1447998177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80105520 0x7f0f8010d070 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 --2- 172.21.15.17:0/1447998177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f801011e0 0x7f0f80104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 --2- 172.21.15.17:0/1447998177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f80100830 0x7f0f80100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 -- 172.21.15.17:0/1447998177 >> 172.21.15.17:0/1447998177 conn(0x7f0f80075ec0 msgr2=0x7f0f800762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 -- 172.21.15.17:0/1447998177 shutdown_connections 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.227+0000 7f0f858d2640 1 -- 172.21.15.17:0/1447998177 wait complete. 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 Processor -- start 2024-09-16T01:10:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 -- start start 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 0x7f0f80198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f80105520 0x7f0f8019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80111e10 con 0x7f0f80100830 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80111c90 con 0x7f0f801011e0 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f858d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80111f90 con 0x7f0f80105520 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f7effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f7effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58168/0 (socket says 172.21.15.17:58168) 2024-09-16T01:10:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f7effd640 1 -- 172.21.15.17:0/2008914647 learned_addr learned my addr 172.21.15.17:0/2008914647 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 0x7f0f80198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.228+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f80105520 0x7f0f8019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 -- 172.21.15.17:0/2008914647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f80105520 msgr2=0x7f0f8019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f80105520 0x7f0f8019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 -- 172.21.15.17:0/2008914647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 msgr2=0x7f0f80198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 0x7f0f80198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 -- 172.21.15.17:0/2008914647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8019d1f0 con 0x7f0f80100830 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 0x7f0f80198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f7effd640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c920 tx=0x7f0f7800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f848d0640 1 -- 172.21.15.17:0/2008914647 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78007c70 con 0x7f0f80100830 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f848d0640 1 -- 172.21.15.17:0/2008914647 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f78007e10 con 0x7f0f80100830 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8019d4e0 con 0x7f0f80100830 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f848d0640 1 -- 172.21.15.17:0/2008914647 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78018820 con 0x7f0f80100830 2024-09-16T01:10:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.229+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f801a4d70 con 0x7f0f80100830 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f848d0640 1 -- 172.21.15.17:0/2008914647 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0f780189c0 con 0x7f0f80100830 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 Processor -- start 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 -- start start 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 0x560b0007db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0007e0c0 0x560b000804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560afffd32f0 con 0x560b0006ea10 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x560afff7b270 con 0x560b0007e0c0 2024-09-16T01:10:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f88664740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560afffcf2b0 con 0x560b0006f330 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58184/0 (socket says 172.21.15.17:58184) 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3749035357 learned_addr learned my addr 172.21.15.17:0/3749035357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.232+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0007e0c0 0x560b000804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7effd640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 0x560b0007db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3749035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 msgr2=0x560b0007db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 0x560b0007db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3749035357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0007e0c0 msgr2=0x560b000804b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0007e0c0 0x560b000804b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3749035357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560afff7a340 con 0x560b0006ea10 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7effd640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 0x560b0007db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f848d0640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 0x7f0f6c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009ca0 tx=0x7f0f70031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e123b3c559537f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f7effd640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 0x7f0f6c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f75ffb640 1 -- 172.21.15.17:0/3749035357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70031650 con 0x560b0006ea10 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f75ffb640 1 -- 172.21.15.17:0/3749035357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f70036030 con 0x560b0006ea10 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f75ffb640 1 -- 172.21.15.17:0/3749035357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70004570 con 0x560b0006ea10 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.233+0000 7f0f848d0640 1 -- 172.21.15.17:0/2008914647 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0f780cfda0 con 0x7f0f80100830 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- 172.21.15.17:0/3749035357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 msgr2=0x560b0006edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f7effd640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 0x7f0f6c0a5920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f780cd5a0 tx=0x7f0f780d5040 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009ca0 tx=0x7f0f70031d10 comp rx=0 tx=0).stop 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- 172.21.15.17:0/3749035357 shutdown_connections 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0007e0c0 0x560b000804b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0006f330 0x560b0007db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 --2- 172.21.15.17:0/3749035357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0006edf0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- 172.21.15.17:0/3749035357 >> 172.21.15.17:0/3749035357 conn(0x560b0006b060 msgr2=0x560b0006b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- 172.21.15.17:0/3749035357 shutdown_connections 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- 172.21.15.17:0/3749035357 wait complete. 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.234+0000 7f0f88664740 1 -- start start 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 Processor -- start 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b0007b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b0007b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b00080b10 con 0x560b0006ea10 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x560afff5c290 con 0x560b0006f330 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560b00080c90 con 0x560b0007e0c0 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f88664740 10 client.0 _ll_register_callbacks cb 0x560afff8d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58194/0 (socket says 172.21.15.17:58194) 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3344317442 learned_addr learned my addr 172.21.15.17:0/3344317442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b0007b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.235+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b0007b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3344317442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 msgr2=0x560b0007b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b0007b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 msgr2=0x560b0007b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b0007b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3344317442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560affce6210 con 0x560b0006ea10 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b0007b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009bf0 tx=0x7f0f70031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1909c504bca4ddc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f5effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70058060 con 0x560b0006ea10 2024-09-16T01:10:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f70036030 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0f70003b70 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f70003d70 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f88664740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560affdb2620 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.236+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f70036030 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f70043070 con 0x560b0006ea10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 20 client.15981 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b0008dd10 0x560b00090100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 4 client.15981 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560afffe0a20 con 0x560b0008dd10 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.237+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b0008dd10 0x560b00090100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.238+0000 7f0f5effd640 10 client.15981 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.238+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b0008dd10 0x560b00090100 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=667dfb1b17eb182e server_cookie=997fa2b2af2909bd in_seq=0 out_seq=0 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.238+0000 7f0f5effd640 1 -- 172.21.15.17:0/3344317442 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560afffe0a20 con 0x560b0008dd10 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.238+0000 7f0f5effd640 10 client.15981 handle_command_reply: tid=0 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 client.15981 shutdown 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 msgr2=0x560b0007af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009bf0 tx=0x7f0f70031b40 comp rx=0 tx=0).stop 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 shutdown_connections 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b0008dd10 0x560b00090100 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b0007b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b0007b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f5effd640 0 client.15981 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 --2- 172.21.15.17:0/3344317442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b0007af70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 >> 172.21.15.17:0/3344317442 conn(0x560b0006b060 msgr2=0x560b0006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 shutdown_connections 2024-09-16T01:10:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 1 -- 172.21.15.17:0/3344317442 wait complete. 2024-09-16T01:10:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.239+0000 7f0f88664740 20 client.15981 trim_cache size 0 max 16384 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 Processor -- start 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 -- start start 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006ea10 0x560b00095840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801ab420 con 0x560b0006f330 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801acf60 con 0x560b0006ea10 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f88664740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801abaf0 con 0x560b0007e0c0 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58202/0 (socket says 172.21.15.17:58202) 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 -- 172.21.15.17:0/1613291552 learned_addr learned my addr 172.21.15.17:0/1613291552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006ea10 0x560b00095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 -- 172.21.15.17:0/1613291552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 msgr2=0x560b000781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 -- 172.21.15.17:0/1613291552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006ea10 msgr2=0x560b00095840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006ea10 0x560b00095840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.254+0000 7f0f7e7fc640 1 -- 172.21.15.17:0/1613291552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b00079f00 con 0x560b0006f330 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0f80068fb0 tx=0x7f0f68010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135baa15808986e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f757fa640 1 -- 172.21.15.17:0/1613291552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004220 con 0x560b0006f330 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f757fa640 1 -- 172.21.15.17:0/1613291552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f680043c0 con 0x560b0006f330 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f757fa640 1 -- 172.21.15.17:0/1613291552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68003d70 con 0x560b0006f330 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 -- 172.21.15.17:0/1613291552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 msgr2=0x560b00095d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0f80068fb0 tx=0x7f0f68010d80 comp rx=0 tx=0).stop 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 -- 172.21.15.17:0/1613291552 shutdown_connections 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006f330 0x560b00095d80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 --2- 172.21.15.17:0/1613291552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006ea10 0x560b00095840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 -- 172.21.15.17:0/1613291552 >> 172.21.15.17:0/1613291552 conn(0x560b0006b060 msgr2=0x560b0007b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 -- 172.21.15.17:0/1613291552 shutdown_connections 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.255+0000 7f0f88664740 1 -- 172.21.15.17:0/1613291552 wait complete. 2024-09-16T01:10:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 -- start start 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 Processor -- start 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b00082920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000f7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801ac890 con 0x560b0006ea10 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801ac1c0 con 0x560b0006f330 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f801a9420 con 0x560b0007e0c0 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f88664740 10 client.0 _ll_register_callbacks cb 0x7f0f6800a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58216/0 (socket says 172.21.15.17:58216) 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3456171714 learned_addr learned my addr 172.21.15.17:0/3456171714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.256+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b00082920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3456171714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 msgr2=0x560b000f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 msgr2=0x560b00082920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b00082920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 -- 172.21.15.17:0/3456171714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0006f160 con 0x560b0006ea10 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f7f7fe640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0f700093d0 tx=0x7f0f70031ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df05159f118c53dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f5effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70058040 con 0x560b0006ea10 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0f70004110 con 0x560b0006ea10 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f680043c0 con 0x560b0006ea10 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f70009540 con 0x560b0006ea10 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f88664740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.257+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b000f8e70 con 0x560b0006ea10 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f680043c0 con 0x560b0006ea10 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f70043040 con 0x560b0006ea10 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 20 client.15987 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b000f94a0 0x560b000fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 4 client.15987 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560afffdad70 con 0x560b000f94a0 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.258+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b000f94a0 0x560b000fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.259+0000 7f0f5effd640 10 client.15987 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.259+0000 7f0f7e7fc640 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b000f94a0 0x560b000fb8c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf4268f8e51a4a3 server_cookie=d2f50877de2d4391 in_seq=0 out_seq=0 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f5effd640 1 -- 172.21.15.17:0/3456171714 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560afffdad70 con 0x560b000f94a0 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f5effd640 10 client.15987 handle_command_reply: tid=0 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 client.15987 shutdown 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 msgr2=0x560b000823e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0f700093d0 tx=0x7f0f70031ac0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 shutdown_connections 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x560b000f94a0 0x560b000fb8c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560b0007e0c0 0x560b000f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x560b0006f330 0x560b00082920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f5effd640 0 client.15987 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 --2- 172.21.15.17:0/3456171714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0006ea10 0x560b000823e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 >> 172.21.15.17:0/3456171714 conn(0x560b0006b060 msgr2=0x560b00088dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 shutdown_connections 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 1 -- 172.21.15.17:0/3456171714 wait complete. 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.273+0000 7f0f88664740 20 client.15987 trim_cache size 0 max 16384 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:10:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:10:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 msgr2=0x7f0f6c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 0x7f0f6c0a5920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f780cd5a0 tx=0x7f0f780d5040 comp rx=0 tx=0).stop 2024-09-16T01:10:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 msgr2=0x7f0f80198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c920 tx=0x7f0f7800cde0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 shutdown_connections 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0f6c0a3460 0x7f0f6c0a5920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f80105520 0x7f0f8019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f801011e0 0x7f0f80198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 --2- 172.21.15.17:0/2008914647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f80100830 0x7f0f80198200 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 >> 172.21.15.17:0/2008914647 conn(0x7f0f80075ec0 msgr2=0x7f0f800fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 shutdown_connections 2024-09-16T01:10:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:19.274+0000 7f0f858d2640 1 -- 172.21.15.17:0/2008914647 wait complete. 2024-09-16T01:10:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:19 smithi088 ceph-mon[34093]: pgmap v245: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:19.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:19 smithi154 ceph-mon[34759]: pgmap v245: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:19 smithi017 ceph-mon[31211]: pgmap v245: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:21 smithi088 ceph-mon[34093]: pgmap v246: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:21.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:21 smithi154 ceph-mon[34759]: pgmap v246: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:21 smithi017 ceph-mon[31211]: pgmap v246: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:23.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:23 smithi088 ceph-mon[34093]: pgmap v247: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:23.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:23 smithi154 ceph-mon[34759]: pgmap v247: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:23.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:23 smithi017 ceph-mon[31211]: pgmap v247: 97 pgs: 97 active+clean; 5.7 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:25 smithi088 ceph-mon[34093]: pgmap v248: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:25 smithi154 ceph-mon[34759]: pgmap v248: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:25 smithi017 ceph-mon[31211]: pgmap v248: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:27 smithi088 ceph-mon[34093]: pgmap v249: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:27 smithi154 ceph-mon[34759]: pgmap v249: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:27 smithi017 ceph-mon[31211]: pgmap v249: 97 pgs: 97 active+clean; 1.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:29 smithi088 ceph-mon[34093]: pgmap v250: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:29.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:29 smithi154 ceph-mon[34759]: pgmap v250: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:29 smithi017 ceph-mon[31211]: pgmap v250: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:31 smithi088 ceph-mon[34093]: pgmap v251: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:31.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:31 smithi154 ceph-mon[34759]: pgmap v251: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:31.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:31 smithi017 ceph-mon[31211]: pgmap v251: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 -- 172.21.15.17:0/1000254529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d94106a00 msgr2=0x7f6d94106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/1000254529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d94106a00 0x7f6d94106de0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009900 tx=0x7f6d9002a410 comp rx=0 tx=0).stop 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 -- 172.21.15.17:0/1000254529 shutdown_connections 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/1000254529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94101390 0x7f6d9410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/1000254529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d941009f0 0x7f6d94100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/1000254529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d94106a00 0x7f6d94106de0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 -- 172.21.15.17:0/1000254529 >> 172.21.15.17:0/1000254529 conn(0x7f6d940fc6b0 msgr2=0x7f6d940fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 -- 172.21.15.17:0/1000254529 shutdown_connections 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.364+0000 7f6d9c52a640 1 -- 172.21.15.17:0/1000254529 wait complete. 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 Processor -- start 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 -- start start 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 0x7f6d9410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94106a00 0x7f6d9410ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d94111e30 con 0x7f6d941009f0 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d94111cb0 con 0x7f6d94106a00 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9c52a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d94111fb0 con 0x7f6d94101390 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44780/0 (socket says 172.21.15.17:44780) 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/179554760 learned_addr learned my addr 172.21.15.17:0/179554760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94106a00 0x7f6d9410ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 0x7f6d9410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/179554760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 msgr2=0x7f6d9410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 0x7f6d9410e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/179554760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94106a00 msgr2=0x7f6d9410ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94106a00 0x7f6d9410ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/179554760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d941a67a0 con 0x7f6d941009f0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.365+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 0x7f6d9410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6d90005ab0 tx=0x7f6d90003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d8b7fe640 1 -- 172.21.15.17:0/179554760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9003f070 con 0x7f6d941009f0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d941a6a30 con 0x7f6d941009f0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d8b7fe640 1 -- 172.21.15.17:0/179554760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d90031b60 con 0x7f6d941009f0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d8b7fe640 1 -- 172.21.15.17:0/179554760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90035030 con 0x7f6d941009f0 2024-09-16T01:10:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.366+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d941a6f20 con 0x7f6d941009f0 2024-09-16T01:10:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.368+0000 7f6d8b7fe640 1 -- 172.21.15.17:0/179554760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6d90042070 con 0x7f6d941009f0 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 Processor -- start 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 -- start start 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdbaf0 0x5556cafdbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556cafe6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5556caf402f0 con 0x5556cafdc410 2024-09-16T01:10:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5556caee8270 con 0x5556cafe6cb0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556caf3c2b0 con 0x5556cafdbaf0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d8b7fe640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 0x7f6d800a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556cafe6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d99ac5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556cafe6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44784/0 (socket says 172.21.15.17:44784) 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/1537647691 learned_addr learned my addr 172.21.15.17:0/1537647691 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdbaf0 0x5556cafdbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.369+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 0x7f6d800a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 -- 172.21.15.17:0/1537647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdbaf0 msgr2=0x5556cafdbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdbaf0 0x5556cafdbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d8b7fe640 1 -- 172.21.15.17:0/179554760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6d900f0480 con 0x7f6d941009f0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 -- 172.21.15.17:0/1537647691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 msgr2=0x5556cafe6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556cafe6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 -- 172.21.15.17:0/1537647691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556caee7340 con 0x5556cafe6cb0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe90a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009c10 tx=0x7f6d84010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0861f2d88bf94a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 0x7f6d800a5920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c005fd0 tx=0x7f6d8c009500 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d88bfe640 1 -- 172.21.15.17:0/1537647691 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004030 con 0x5556cafe6cb0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d88bfe640 1 -- 172.21.15.17:0/1537647691 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d840035f0 con 0x5556cafe6cb0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.370+0000 7f6d88bfe640 1 -- 172.21.15.17:0/1537647691 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84012650 con 0x5556cafe6cb0 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/1537647691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 msgr2=0x5556cafe90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe90a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009c10 tx=0x7f6d84010740 comp rx=0 tx=0).stop 2024-09-16T01:10:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/1537647691 shutdown_connections 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe90a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556cafe6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/1537647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdbaf0 0x5556cafdbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/1537647691 >> 172.21.15.17:0/1537647691 conn(0x5556cafd8060 msgr2=0x5556cafd8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/1537647691 shutdown_connections 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/1537647691 wait complete. 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 -- start start 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.371+0000 7f6d9f2c6740 1 Processor -- start 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5556cafe9880 con 0x5556cafe6cb0 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5556caec9290 con 0x5556cafdbaf0 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5556cafe9a00 con 0x5556cafdc410 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9f2c6740 10 client.0 _ll_register_callbacks cb 0x5556caefa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44788/0 (socket says 172.21.15.17:44788) 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 -- 172.21.15.17:0/3970630921 learned_addr learned my addr 172.21.15.17:0/3970630921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 -- 172.21.15.17:0/3970630921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 msgr2=0x5556cafe4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 -- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 msgr2=0x5556cafe3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 -- 172.21.15.17:0/3970630921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556cac53210 con 0x5556cafe6cb0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00ff20 tx=0x7f6d8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690d9736d2504d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.372+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c021e00 con 0x5556cafe6cb0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d840035f0 con 0x5556cafe6cb0 2024-09-16T01:10:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6d8c010430 con 0x5556cafe6cb0 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c010630 con 0x5556cafe6cb0 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 10 client.15999 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556cad1f620 con 0x5556cafe6cb0 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d840035f0 con 0x5556cafe6cb0 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d8c028070 con 0x5556cafe6cb0 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 10 client.15999 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 20 client.15999 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556caff6c50 0x5556caff90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 4 client.15999 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556caf4da20 con 0x5556caff6c50 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.373+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556caff6c50 0x5556caff90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556caff6c50 0x5556caff90c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac3c721ab7fbc00 server_cookie=8429ab8086d0a7c1 in_seq=0 out_seq=0 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d7dffb640 10 client.15999 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3970630921 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556caf4da20 con 0x5556caff6c50 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d7dffb640 10 client.15999 handle_command_reply: tid=0 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9f2c6740 1 client.15999 shutdown 2024-09-16T01:10:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 msgr2=0x5556cafe4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00ff20 tx=0x7f6d8c004a40 comp rx=0 tx=0).stop 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 shutdown_connections 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.374+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556caff6c50 0x5556caff90c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafe6cb0 0x5556cafe4590 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d7dffb640 0 client.15999 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3970630921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 >> 172.21.15.17:0/3970630921 conn(0x5556cafd8060 msgr2=0x5556cafdddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 shutdown_connections 2024-09-16T01:10:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3970630921 wait complete. 2024-09-16T01:10:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.375+0000 7f6d9f2c6740 20 client.15999 trim_cache size 0 max 16384 2024-09-16T01:10:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 Processor -- start 2024-09-16T01:10:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 -- start start 2024-09-16T01:10:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 0x5556caffef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941af990 con 0x5556cafdc410 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b14d0 con 0x5556cafdbaf0 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b0060 con 0x5556cafe6cb0 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d99ac5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d99ac5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44804/0 (socket says 172.21.15.17:44804) 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.389+0000 7f6d99ac5640 1 -- 172.21.15.17:0/767393057 learned_addr learned my addr 172.21.15.17:0/767393057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 0x5556caffef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 -- 172.21.15.17:0/767393057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 msgr2=0x5556caffef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 0x5556caffef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 -- 172.21.15.17:0/767393057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 msgr2=0x5556cafe43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 -- 172.21.15.17:0/767393057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556cafd7e90 con 0x5556cafdc410 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 0x5556caffef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009c10 tx=0x7f6d84009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1afcfad944504f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d7ffff640 1 -- 172.21.15.17:0/767393057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84009d00 con 0x5556cafdc410 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d7ffff640 1 -- 172.21.15.17:0/767393057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d84005570 con 0x5556cafdc410 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.390+0000 7f6d7ffff640 1 -- 172.21.15.17:0/767393057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84026460 con 0x5556cafdc410 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/767393057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 msgr2=0x5556caffe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009c10 tx=0x7f6d84009950 comp rx=0 tx=0).stop 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/767393057 shutdown_connections 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafe6cb0 0x5556caffef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdc410 0x5556caffe9d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/767393057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafdbaf0 0x5556cafe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/767393057 >> 172.21.15.17:0/767393057 conn(0x5556cafd8060 msgr2=0x5556cafe5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/767393057 shutdown_connections 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/767393057 wait complete. 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- start start 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 Processor -- start 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b0e00 con 0x5556cafdbaf0 2024-09-16T01:10:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b0730 con 0x5556cafe6cb0 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941ad990 con 0x5556cafdc410 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9f2c6740 10 client.0 _ll_register_callbacks cb 0x7f6d8c00fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.391+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44810/0 (socket says 172.21.15.17:44810) 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/3855762324 learned_addr learned my addr 172.21.15.17:0/3855762324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/3855762324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 msgr2=0x5556cafe7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 msgr2=0x5556cafe8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 -- 172.21.15.17:0/3855762324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556caff57f0 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9aac7640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9a2c6640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6d900b8b60 tx=0x7f6d900f28d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3d9454b8b7e055 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90049040 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6d9003b460 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d84005570 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d900c5370 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9f2c6740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556cb0619a0 con 0x5556cafdbaf0 2024-09-16T01:10:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.392+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d84005570 con 0x5556cafdbaf0 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d900eddf0 con 0x5556cafdbaf0 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 20 client.16005 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556cb061e20 0x5556cb064210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 4 client.16005 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556caf47d70 con 0x5556cb061e20 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556cb061e20 0x5556cb064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d7dffb640 10 client.16005 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.393+0000 7f6d99ac5640 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556cb061e20 0x5556cb064210 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3afc4cce291550 server_cookie=45c7f99080846372 in_seq=0 out_seq=0 2024-09-16T01:10:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d7dffb640 1 -- 172.21.15.17:0/3855762324 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556caf47d70 con 0x5556cb061e20 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d7dffb640 10 client.16005 handle_command_reply: tid=0 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 client.16005 shutdown 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 msgr2=0x5556cafef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6d900b8b60 tx=0x7f6d900f28d0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 shutdown_connections 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5556cb061e20 0x5556cb064210 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5556cafe6cb0 0x5556cafe8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d7dffb640 0 client.16005 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5556cafdc410 0x5556cafe7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 --2- 172.21.15.17:0/3855762324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556cafdbaf0 0x5556cafef510 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 >> 172.21.15.17:0/3855762324 conn(0x5556cafd8060 msgr2=0x5556cafd69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 shutdown_connections 2024-09-16T01:10:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 1 -- 172.21.15.17:0/3855762324 wait complete. 2024-09-16T01:10:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.405+0000 7f6d9f2c6740 20 client.16005 trim_cache size 0 max 16384 2024-09-16T01:10:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:10:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:10:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:10:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 msgr2=0x7f6d800a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 0x7f6d800a5920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c005fd0 tx=0x7f6d8c009500 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 msgr2=0x7f6d9410e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6d90005ab0 tx=0x7f6d90003c10 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 shutdown_connections 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d800a3460 0x7f6d800a5920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d94106a00 0x7f6d9410ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d94101390 0x7f6d9410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 --2- 172.21.15.17:0/179554760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d941009f0 0x7f6d9410e050 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 >> 172.21.15.17:0/179554760 conn(0x7f6d940fc6b0 msgr2=0x7f6d940fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 shutdown_connections 2024-09-16T01:10:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:32.406+0000 7f6d9c52a640 1 -- 172.21.15.17:0/179554760 wait complete. 2024-09-16T01:10:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:10:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:10:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:10:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:32 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:32 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:10:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:10:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:10:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:10:32.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:32 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:10:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:33 smithi088 ceph-mon[34093]: pgmap v252: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:33 smithi154 ceph-mon[34759]: pgmap v252: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:33.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:33 smithi017 ceph-mon[31211]: pgmap v252: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:35.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:35 smithi088 ceph-mon[34093]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 25 op/s 2024-09-16T01:10:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:35 smithi154 ceph-mon[34759]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 25 op/s 2024-09-16T01:10:35.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:35 smithi017 ceph-mon[31211]: pgmap v253: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 25 op/s 2024-09-16T01:10:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:37 smithi088 ceph-mon[34093]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:37 smithi154 ceph-mon[34759]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:10:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:37 smithi017 ceph-mon[31211]: pgmap v254: 97 pgs: 97 active+clean; 2.3 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:10:39.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:39 smithi088 ceph-mon[34093]: pgmap v255: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:10:39.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:39 smithi154 ceph-mon[34759]: pgmap v255: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:10:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:39 smithi017 ceph-mon[31211]: pgmap v255: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:10:41.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:41 smithi088 ceph-mon[34093]: pgmap v256: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:41.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:41 smithi154 ceph-mon[34759]: pgmap v256: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:41.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:41 smithi017 ceph-mon[31211]: pgmap v256: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:43.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:43 smithi088 ceph-mon[34093]: pgmap v257: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:43.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:43 smithi154 ceph-mon[34759]: pgmap v257: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:43.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:43 smithi017 ceph-mon[31211]: pgmap v257: 97 pgs: 97 active+clean; 2.5 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:375/600: open fd = 3 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:376/600: open fd = 3 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:377/600: open fd = 3 2024-09-16T01:10:45.222 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:378/600: open fd = 3 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:379/600: open fd = 3 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:380/600: open fd = 3 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.223 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:381/600: open fd = 3 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:382/600: open fd = 3 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:383/600: open fd = 3 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.224 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:384/600: open fd = 3 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:385/600: open fd = 3 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:386/600: open fd = 3 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:387/600: open fd = 3 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:388/600: open fd = 3 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:389/600: open fd = 3 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:390/600: open fd = 3 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:391/600: open fd = 3 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:392/600: open fd = 3 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:393/600: open fd = 3 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.227 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:394/600: open fd = 3 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:395/600: open fd = 3 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.228 INFO:tasks.workunit.client.0.smithi017.stdout:396/600: open fd = 3 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:397/600: open fd = 3 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:398/600: open fd = 3 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:399/600: open fd = 3 2024-09-16T01:10:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:400/600: open fd = 3 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:401/600: open fd = 3 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.230 INFO:tasks.workunit.client.0.smithi017.stdout:402/600: open fd = 3 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:403/600: open fd = 3 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:404/600: open fd = 3 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:405/600: open fd = 3 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:406/600: open fd = 3 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:407/600: open fd = 3 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:408/600: open fd = 3 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.232 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:409/600: open fd = 3 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:410/600: open fd = 3 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:411/600: open fd = 3 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.233 INFO:tasks.workunit.client.0.smithi017.stdout:412/600: open fd = 3 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:413/600: open fd = 3 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:414/600: open fd = 3 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:415/600: open fd = 3 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.234 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:416/600: open fd = 3 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:417/600: open fd = 3 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:418/600: open fd = 3 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.235 INFO:tasks.workunit.client.0.smithi017.stdout:419/600: open fd = 3 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:420/600: open fd = 3 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:421/600: open fd = 3 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:422/600: open fd = 3 2024-09-16T01:10:45.236 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:423/600: open fd = 3 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:424/600: open fd = 3 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:425/600: open fd = 3 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:426/600: open fd = 3 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:427/600: open fd = 3 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:428/600: open fd = 3 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:429/600: open fd = 3 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:430/600: open fd = 3 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:431/600: open fd = 3 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.239 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:432/600: open fd = 3 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:433/600: open fd = 3 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:434/600: open fd = 3 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:435/600: open fd = 3 2024-09-16T01:10:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:436/600: open fd = 3 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:10:45.241 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- 172.21.15.17:0/2025712548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4674102cc0 msgr2=0x7f46741030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 --2- 172.21.15.17:0/2025712548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4674102cc0 0x7f46741030a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4664009900 tx=0x7f466402a480 comp rx=0 tx=0).stop 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- 172.21.15.17:0/2025712548 shutdown_connections 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 --2- 172.21.15.17:0/2025712548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f467410c110 0x7f467410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 --2- 172.21.15.17:0/2025712548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741035e0 0x7f467410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 --2- 172.21.15.17:0/2025712548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4674102cc0 0x7f46741030a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- 172.21.15.17:0/2025712548 >> 172.21.15.17:0/2025712548 conn(0x7f46740fc6b0 msgr2=0x7f46740fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- 172.21.15.17:0/2025712548 shutdown_connections 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- 172.21.15.17:0/2025712548 wait complete. 2024-09-16T01:10:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 Processor -- start 2024-09-16T01:10:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.506+0000 7f467a9f6640 1 -- start start 2024-09-16T01:10:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4674102cc0 0x7f46741981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467410c110 0x7f467419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4674111da0 con 0x7f46741035e0 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4674111c20 con 0x7f4674102cc0 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f467a9f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4674111f20 con 0x7f467410c110 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39000/0 (socket says 172.21.15.17:39000) 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 -- 172.21.15.17:0/1983398223 learned_addr learned my addr 172.21.15.17:0/1983398223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f4678f93640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467410c110 0x7f467419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f4673fff640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4674102cc0 0x7f46741981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 -- 172.21.15.17:0/1983398223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467410c110 msgr2=0x7f467419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467410c110 0x7f467419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 -- 172.21.15.17:0/1983398223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4674102cc0 msgr2=0x7f46741981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4674102cc0 0x7f46741981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.507+0000 7f46737fe640 1 -- 172.21.15.17:0/1983398223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467419d1e0 con 0x7f46741035e0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f46737fe640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f466800c970 tx=0x7f466800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f46717fa640 1 -- 172.21.15.17:0/1983398223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668007bb0 con 0x7f46741035e0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f46717fa640 1 -- 172.21.15.17:0/1983398223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4668007d50 con 0x7f46741035e0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467419d4d0 con 0x7f46741035e0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f46717fa640 1 -- 172.21.15.17:0/1983398223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668018780 con 0x7f46741035e0 2024-09-16T01:10:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.508+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46741a4d60 con 0x7f46741035e0 2024-09-16T01:10:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f46717fa640 1 -- 172.21.15.17:0/1983398223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f466800f450 con 0x7f46741035e0 2024-09-16T01:10:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 Processor -- start 2024-09-16T01:10:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 -- start start 2024-09-16T01:10:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561a143532f0 con 0x561a143f9cb0 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561a142fb270 con 0x561a143ef410 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.511+0000 7f467d86c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a1434f2b0 con 0x561a143eeaf0 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39006/0 (socket says 172.21.15.17:39006) 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 -- 172.21.15.17:0/4131694996 learned_addr learned my addr 172.21.15.17:0/4131694996 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f4678f93640 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f4673fff640 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 -- 172.21.15.17:0/4131694996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 msgr2=0x561a143eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143eeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 -- 172.21.15.17:0/4131694996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 msgr2=0x561a143f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 -- 172.21.15.17:0/4131694996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a142fa340 con 0x561a143f9cb0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46717fa640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 0x7f465c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46737fe640 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46680cd4b0 tx=0x7f46680d81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50a014cf39294be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f4678f93640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 0x7f465c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f46717fa640 1 -- 172.21.15.17:0/1983398223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f46680cfdf0 con 0x7f46741035e0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f465a7fc640 1 -- 172.21.15.17:0/4131694996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668098370 con 0x561a143f9cb0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f465a7fc640 1 -- 172.21.15.17:0/4131694996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f466800fa90 con 0x561a143f9cb0 2024-09-16T01:10:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.512+0000 7f465a7fc640 1 -- 172.21.15.17:0/4131694996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466809ba30 con 0x561a143f9cb0 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 -- 172.21.15.17:0/4131694996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 msgr2=0x561a143fc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f4678f93640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 0x7f465c0a5920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f466c005fd0 tx=0x7f466c009500 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f46680cd4b0 tx=0x7f46680d81a0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 -- 172.21.15.17:0/4131694996 shutdown_connections 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a143fc0a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 --2- 172.21.15.17:0/4131694996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 -- 172.21.15.17:0/4131694996 >> 172.21.15.17:0/4131694996 conn(0x561a143eb060 msgr2=0x561a143eb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 -- 172.21.15.17:0/4131694996 shutdown_connections 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.513+0000 7f467d86c740 1 -- 172.21.15.17:0/4131694996 wait complete. 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 -- start start 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 Processor -- start 2024-09-16T01:10:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143f9cb0 0x561a143f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561a143fc880 con 0x561a143ef410 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561a142dc290 con 0x561a143f9cb0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a143fca00 con 0x561a143eeaf0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f467d86c740 10 client.0 _ll_register_callbacks cb 0x561a1430d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f46737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39012/0 (socket says 172.21.15.17:39012) 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f46737fe640 1 -- 172.21.15.17:0/853346777 learned_addr learned my addr 172.21.15.17:0/853346777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.514+0000 7f4673fff640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f4678f93640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143f9cb0 0x561a143f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 -- 172.21.15.17:0/853346777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 msgr2=0x561a143f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 -- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143f9cb0 msgr2=0x561a143f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143f9cb0 0x561a143f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 -- 172.21.15.17:0/853346777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a14066210 con 0x561a143ef410 2024-09-16T01:10:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46737fe640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4668007590 tx=0x7f4668007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38879908ba8294e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46537fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46680b4060 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f46680bc0b0 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a14360a20 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f466809bc10 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f467d86c740 10 client.16017 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a14132620 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.515+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x561a14360a20 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f46680cd7c0 con 0x561a143ef410 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 10 client.16017 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 20 client.16017 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14409a50 0x561a1440be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 4 client.16017 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:10:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a1435ad70 con 0x561a14409a50 2024-09-16T01:10:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.516+0000 7f4673fff640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14409a50 0x561a1440be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f46537fe640 10 client.16017 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f4673fff640 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14409a50 0x561a1440be40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a29e3f5dfc419c8 server_cookie=4ea4987bf59cdf1c in_seq=0 out_seq=0 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f46537fe640 1 -- 172.21.15.17:0/853346777 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a1435ad70 con 0x561a14409a50 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f46537fe640 10 client.16017 handle_command_reply: tid=0 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 client.16017 shutdown 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 msgr2=0x561a143f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4668007590 tx=0x7f4668007730 comp rx=0 tx=0).stop 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 shutdown_connections 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14409a50 0x561a1440be40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143f9cb0 0x561a143f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f46537fe640 0 client.16017 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143ef410 0x561a143f70a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 --2- 172.21.15.17:0/853346777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143eeaf0 0x561a143f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.517+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 >> 172.21.15.17:0/853346777 conn(0x561a143eb060 msgr2=0x561a143f0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.518+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 shutdown_connections 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.518+0000 7f467d86c740 1 -- 172.21.15.17:0/853346777 wait complete. 2024-09-16T01:10:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.518+0000 7f467d86c740 20 client.16017 trim_cache size 0 max 16384 2024-09-16T01:10:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 Processor -- start 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 -- start start 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 0x561a143f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143ef410 0x561a143f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46741ad700 con 0x561a143f9cb0 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f46741af240 con 0x561a143eeaf0 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f467d86c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741addd0 con 0x561a143ef410 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.532+0000 7f4678f93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39014/0 (socket says 172.21.15.17:39014) 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 -- 172.21.15.17:0/1767647375 learned_addr learned my addr 172.21.15.17:0/1767647375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4673fff640 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 0x561a143f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 -- 172.21.15.17:0/1767647375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143ef410 msgr2=0x561a143f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143ef410 0x561a143f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 -- 172.21.15.17:0/1767647375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 msgr2=0x561a143f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 0x561a143f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 -- 172.21.15.17:0/1767647375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a143eae90 con 0x561a143f9cb0 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4673fff640 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 0x561a143f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4678f93640 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f466c003f00 tx=0x7f466c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10bfa134e7106ef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4659ffb640 1 -- 172.21.15.17:0/1767647375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c01e520 con 0x561a143f9cb0 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4659ffb640 1 -- 172.21.15.17:0/1767647375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f466c01eb70 con 0x561a143f9cb0 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.533+0000 7f4659ffb640 1 -- 172.21.15.17:0/1767647375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c01fa10 con 0x561a143f9cb0 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- 172.21.15.17:0/1767647375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 msgr2=0x561a14411410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f466c003f00 tx=0x7f466c017000 comp rx=0 tx=0).stop 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- 172.21.15.17:0/1767647375 shutdown_connections 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143f9cb0 0x561a14411410 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143ef410 0x561a143f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 --2- 172.21.15.17:0/1767647375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143eeaf0 0x561a143f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- 172.21.15.17:0/1767647375 >> 172.21.15.17:0/1767647375 conn(0x561a143eb060 msgr2=0x561a143ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- 172.21.15.17:0/1767647375 shutdown_connections 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- 172.21.15.17:0/1767647375 wait complete. 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 -- start start 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.534+0000 7f467d86c740 1 Processor -- start 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143f9cb0 0x561a143fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46741aeb70 con 0x561a143eeaf0 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f46741ae4a0 con 0x561a143ef410 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741ab700 con 0x561a143f9cb0 2024-09-16T01:10:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f467d86c740 10 client.0 _ll_register_callbacks cb 0x7f46680d3df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39016/0 (socket says 172.21.15.17:39016) 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 -- 172.21.15.17:0/1627849519 learned_addr learned my addr 172.21.15.17:0/1627849519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 -- 172.21.15.17:0/1627849519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143f9cb0 msgr2=0x561a143fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143f9cb0 0x561a143fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 -- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 msgr2=0x561a143fe030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f46737fe640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143fe030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 -- 172.21.15.17:0/1627849519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a14473540 con 0x561a143eeaf0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f46737fe640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f4673fff640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4664005ab0 tx=0x7f4664009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e86c571aa07f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f46537fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664035040 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.535+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f4664005040 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c01eb70 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4664051050 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a14474740 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f466c01eb70 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f466404c030 con 0x561a143eeaf0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 20 client.16023 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14474ec0 0x561a144772e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 4 client.16023 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a142d7900 con 0x561a14474ec0 2024-09-16T01:10:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.536+0000 7f46737fe640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14474ec0 0x561a144772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.537+0000 7f46537fe640 10 client.16023 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.537+0000 7f46737fe640 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14474ec0 0x561a144772e0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a042740c54ea64 server_cookie=aa9b7ebb62cf50e4 in_seq=0 out_seq=0 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.550+0000 7f46537fe640 1 -- 172.21.15.17:0/1627849519 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a142d7900 con 0x561a14474ec0 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.550+0000 7f46537fe640 10 client.16023 handle_command_reply: tid=0 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 client.16023 shutdown 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 msgr2=0x561a143fdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4664005ab0 tx=0x7f4664009880 comp rx=0 tx=0).stop 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 shutdown_connections 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561a14474ec0 0x561a144772e0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a143f9cb0 0x561a143fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f46537fe640 0 client.16023 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561a143ef410 0x561a143fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 --2- 172.21.15.17:0/1627849519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a143eeaf0 0x561a143fdaf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 >> 172.21.15.17:0/1627849519 conn(0x561a143eb060 msgr2=0x561a143e99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 shutdown_connections 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 1 -- 172.21.15.17:0/1627849519 wait complete. 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.551+0000 7f467d86c740 20 client.16023 trim_cache size 0 max 16384 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:10:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 msgr2=0x7f465c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 0x7f465c0a5920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f466c005fd0 tx=0x7f466c009500 comp rx=0 tx=0).stop 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 msgr2=0x7f4674198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f466800c970 tx=0x7f466800ce30 comp rx=0 tx=0).stop 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 shutdown_connections 2024-09-16T01:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f465c0a3460 0x7f465c0a5920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467410c110 0x7f467419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46741035e0 0x7f4674198730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 --2- 172.21.15.17:0/1983398223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4674102cc0 0x7f46741981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 >> 172.21.15.17:0/1983398223 conn(0x7f46740fc6b0 msgr2=0x7f46740fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 shutdown_connections 2024-09-16T01:10:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:45.552+0000 7f467a9f6640 1 -- 172.21.15.17:0/1983398223 wait complete. 2024-09-16T01:10:45.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:45 smithi088 ceph-mon[34093]: pgmap v258: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:45.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:45 smithi154 ceph-mon[34759]: pgmap v258: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:45.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:45 smithi017 ceph-mon[31211]: pgmap v258: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-09-16T01:10:47.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:47 smithi088 ceph-mon[34093]: pgmap v259: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:10:47.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:47 smithi154 ceph-mon[34759]: pgmap v259: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:10:47.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:47 smithi017 ceph-mon[31211]: pgmap v259: 97 pgs: 97 active+clean; 2.7 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:10:49.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:49 smithi088 ceph-mon[34093]: pgmap v260: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:49.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:49 smithi154 ceph-mon[34759]: pgmap v260: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:49.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:49 smithi017 ceph-mon[31211]: pgmap v260: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:51.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:51 smithi088 ceph-mon[34093]: pgmap v261: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:51.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:51 smithi154 ceph-mon[34759]: pgmap v261: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:51 smithi017 ceph-mon[31211]: pgmap v261: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:53.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:53 smithi088 ceph-mon[34093]: pgmap v262: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:53.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:53 smithi154 ceph-mon[34759]: pgmap v262: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:53.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:53 smithi017 ceph-mon[31211]: pgmap v262: 97 pgs: 97 active+clean; 2.9 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:10:55.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:55 smithi088 ceph-mon[34093]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:55.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:55 smithi154 ceph-mon[34759]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:55.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:55 smithi017 ceph-mon[31211]: pgmap v263: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:57.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:57 smithi088 ceph-mon[34093]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:57.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:57 smithi154 ceph-mon[34759]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:57.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:57 smithi017 ceph-mon[31211]: pgmap v264: 97 pgs: 97 active+clean; 3.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:10:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 -- 172.21.15.17:0/2378948182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb241035a0 msgr2=0x7fbb2410ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/2378948182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb241035a0 0x7fbb2410ba80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009900 tx=0x7fbb1802a480 comp rx=0 tx=0).stop 2024-09-16T01:10:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 -- 172.21.15.17:0/2378948182 shutdown_connections 2024-09-16T01:10:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/2378948182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb2410c0d0 0x7fbb2410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/2378948182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb241035a0 0x7fbb2410ba80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/2378948182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb24102c80 0x7fbb24103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 -- 172.21.15.17:0/2378948182 >> 172.21.15.17:0/2378948182 conn(0x7fbb24077990 msgr2=0x7fbb240fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 -- 172.21.15.17:0/2378948182 shutdown_connections 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 -- 172.21.15.17:0/2378948182 wait complete. 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.652+0000 7fbb2a88c640 1 Processor -- start 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 -- start start 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb241035a0 0x7fbb24198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 0x7fbb2419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24111da0 con 0x7fbb24102c80 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24111c20 con 0x7fbb241035a0 2024-09-16T01:10:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb2a88c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24111f20 con 0x7fbb2410c0d0 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57390/0 (socket says 172.21.15.17:57390) 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 -- 172.21.15.17:0/73417971 learned_addr learned my addr 172.21.15.17:0/73417971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb237fe640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb241035a0 0x7fbb24198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb28e29640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 0x7fbb2419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 -- 172.21.15.17:0/73417971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 msgr2=0x7fbb2419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 0x7fbb2419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 -- 172.21.15.17:0/73417971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb241035a0 msgr2=0x7fbb24198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.653+0000 7fbb23fff640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb241035a0 0x7fbb24198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb23fff640 1 -- 172.21.15.17:0/73417971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2419d2e0 con 0x7fbb24102c80 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb28e29640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 0x7fbb2419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb23fff640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400b4a0 tx=0x7fbb1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb217fa640 1 -- 172.21.15.17:0/73417971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14014070 con 0x7fbb24102c80 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb217fa640 1 -- 172.21.15.17:0/73417971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb14010ac0 con 0x7fbb24102c80 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2419d5d0 con 0x7fbb24102c80 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb217fa640 1 -- 172.21.15.17:0/73417971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14017c30 con 0x7fbb24102c80 2024-09-16T01:10:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.654+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb241a4e60 con 0x7fbb24102c80 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.656+0000 7fbb217fa640 1 -- 172.21.15.17:0/73417971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbb14017070 con 0x7fbb24102c80 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 Processor -- start 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 -- start start 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67eefed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67efd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca67e542f0 con 0x55ca67ef0410 2024-09-16T01:10:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca67dfc270 con 0x55ca67efacb0 2024-09-16T01:10:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb2d625740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca67e502b0 con 0x55ca67eefaf0 2024-09-16T01:10:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb217fa640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 0x7fbb0c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57394/0 (socket says 172.21.15.17:57394) 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb23fff640 1 -- 172.21.15.17:0/1382603012 learned_addr learned my addr 172.21.15.17:0/1382603012 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67efd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb28e29640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 0x7fbb0c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.657+0000 7fbb217fa640 1 -- 172.21.15.17:0/73417971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fbb140cf340 con 0x7fbb24102c80 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb28e29640 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67eefed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 -- 172.21.15.17:0/1382603012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 msgr2=0x55ca67eefed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67eefed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 -- 172.21.15.17:0/1382603012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 msgr2=0x55ca67efd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67efd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 -- 172.21.15.17:0/1382603012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca67dfb340 con 0x55ca67ef0410 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb237fe640 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67efd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb23fff640 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb140ccba0 tx=0x7fbb1400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5d29cad554c9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb28e29640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 0x7fbb0c0a5920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c013b30 tx=0x7fbb1c00ad10 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb0a7fc640 1 -- 172.21.15.17:0/1382603012 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1401e070 con 0x55ca67ef0410 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb0a7fc640 1 -- 172.21.15.17:0/1382603012 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb140ce070 con 0x55ca67ef0410 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.658+0000 7fbb0a7fc640 1 -- 172.21.15.17:0/1382603012 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140999d0 con 0x55ca67ef0410 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- 172.21.15.17:0/1382603012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 msgr2=0x55ca67efa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb140ccba0 tx=0x7fbb1400bf90 comp rx=0 tx=0).stop 2024-09-16T01:10:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- 172.21.15.17:0/1382603012 shutdown_connections 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67efd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67efa770 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 --2- 172.21.15.17:0/1382603012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67eefed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- 172.21.15.17:0/1382603012 >> 172.21.15.17:0/1382603012 conn(0x55ca67eec060 msgr2=0x55ca67eec440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- 172.21.15.17:0/1382603012 shutdown_connections 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- 172.21.15.17:0/1382603012 wait complete. 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.659+0000 7fbb2d625740 1 -- start start 2024-09-16T01:10:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 Processor -- start 2024-09-16T01:10:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67ef8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca67efd880 con 0x55ca67ef0410 2024-09-16T01:10:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca67ddd290 con 0x55ca67efacb0 2024-09-16T01:10:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ca67efda00 con 0x55ca67eefaf0 2024-09-16T01:10:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb2d625740 10 client.0 _ll_register_callbacks cb 0x55ca67e0e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57400/0 (socket says 172.21.15.17:57400) 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 -- 172.21.15.17:0/2943906556 learned_addr learned my addr 172.21.15.17:0/2943906556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb23fff640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb28e29640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67ef8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 -- 172.21.15.17:0/2943906556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 msgr2=0x55ca67ef7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 -- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 msgr2=0x55ca67ef8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67ef8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.660+0000 7fbb237fe640 1 -- 172.21.15.17:0/2943906556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca67b67210 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb237fe640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009900 tx=0x7fbb180316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0bc2d05e19600b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18035040 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fbb18004040 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb140ce070 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb18004240 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 10 client.16035 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca67c33620 con 0x55ca67ef0410 2024-09-16T01:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb140ce070 con 0x55ca67ef0410 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb1803d570 con 0x55ca67ef0410 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 10 client.16035 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 20 client.16035 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f0acc0 0x55ca67f0d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 4 client.16035 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.661+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca67e61a20 con 0x55ca67f0acc0 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.662+0000 7fbb23fff640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f0acc0 0x55ca67f0d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.662+0000 7fbb037fe640 10 client.16035 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.662+0000 7fbb23fff640 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f0acc0 0x55ca67f0d0b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6510f03ae2131f4 server_cookie=82c50a11211ded98 in_seq=0 out_seq=0 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb037fe640 1 -- 172.21.15.17:0/2943906556 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca67e61a20 con 0x55ca67f0acc0 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb037fe640 10 client.16035 handle_command_reply: tid=0 2024-09-16T01:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 client.16035 shutdown 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 msgr2=0x55ca67ef8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009900 tx=0x7fbb180316d0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 shutdown_connections 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f0acc0 0x55ca67f0d0b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67ef8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67ef0410 0x55ca67ef8150 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 --2- 172.21.15.17:0/2943906556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb037fe640 0 client.16035 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 >> 172.21.15.17:0/2943906556 conn(0x55ca67eec060 msgr2=0x55ca67ef1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 shutdown_connections 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 1 -- 172.21.15.17:0/2943906556 wait complete. 2024-09-16T01:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.663+0000 7fbb2d625740 20 client.16035 trim_cache size 0 max 16384 2024-09-16T01:10:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 Processor -- start 2024-09-16T01:10:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 -- start start 2024-09-16T01:10:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67ef0410 0x55ca67ef1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67f03070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241ad760 con 0x55ca67eefaf0 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241af2a0 con 0x55ca67efacb0 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb2d625740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241ade30 con 0x55ca67ef0410 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57406/0 (socket says 172.21.15.17:57406) 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.678+0000 7fbb23fff640 1 -- 172.21.15.17:0/434645130 learned_addr learned my addr 172.21.15.17:0/434645130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb28e29640 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67f03070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 -- 172.21.15.17:0/434645130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67ef0410 msgr2=0x55ca67ef1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67ef0410 0x55ca67ef1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 -- 172.21.15.17:0/434645130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 msgr2=0x55ca67f03070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67f03070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 -- 172.21.15.17:0/434645130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca67eef920 con 0x55ca67eefaf0 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb23fff640 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbb14097b30 tx=0x7fbb1409b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d049c27f73dcdd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb09ffb640 1 -- 172.21.15.17:0/434645130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1401e040 con 0x55ca67eefaf0 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb09ffb640 1 -- 172.21.15.17:0/434645130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb140ce040 con 0x55ca67eefaf0 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.679+0000 7fbb09ffb640 1 -- 172.21.15.17:0/434645130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb140a3eb0 con 0x55ca67eefaf0 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- 172.21.15.17:0/434645130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 msgr2=0x55ca67ef84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbb14097b30 tx=0x7fbb1409b110 comp rx=0 tx=0).stop 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- 172.21.15.17:0/434645130 shutdown_connections 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67efacb0 0x55ca67f03070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67ef0410 0x55ca67ef1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 --2- 172.21.15.17:0/434645130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67eefaf0 0x55ca67ef84c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- 172.21.15.17:0/434645130 >> 172.21.15.17:0/434645130 conn(0x55ca67eec060 msgr2=0x55ca67ef1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- 172.21.15.17:0/434645130 shutdown_connections 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- 172.21.15.17:0/434645130 wait complete. 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 -- start start 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.680+0000 7fbb2d625740 1 Processor -- start 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 0x55ca67ef43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241aebd0 con 0x55ca67efacb0 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241ae500 con 0x55ca67ef0410 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb241ab760 con 0x55ca67eefaf0 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 10 client.0 _ll_register_callbacks cb 0x7fbb18009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb28e29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 0x55ca67ef43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb28e29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57418/0 (socket says 172.21.15.17:57418) 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb28e29640 1 -- 172.21.15.17:0/4162035664 learned_addr learned my addr 172.21.15.17:0/4162035664 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb23fff640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 -- 172.21.15.17:0/4162035664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 msgr2=0x55ca67ef3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 -- 172.21.15.17:0/4162035664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 msgr2=0x55ca67ef48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 -- 172.21.15.17:0/4162035664 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca67ef5020 con 0x55ca67ef0410 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb23fff640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb28e29640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb237fe640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 0x55ca67ef43a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55ca67efa630 tx=0x7fbb18005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e562f943f42d9716 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb037fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-16T01:10:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18052070 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb140ce040 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.681+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mon.2 v2:172.21.15.88:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fbb180318b0 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb18035040 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 10 client.25661 fetch_fsmap learned FSMap version 28 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca67f79e10 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mon.2 v2:172.21.15.88:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb140ce040 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mon.2 v2:172.21.15.88:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb180047a0 con 0x55ca67ef0410 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 10 client.25661 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 10 client.25661 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 20 client.25661 populate_metadata read hostname 'smithi017' 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f7a540 0x55ca67f7c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 4 client.25661 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca67e5bd70 con 0x55ca67f7a540 2024-09-16T01:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.682+0000 7fbb23fff640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f7a540 0x55ca67f7c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:10:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.683+0000 7fbb037fe640 10 client.25661 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.683+0000 7fbb23fff640 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f7a540 0x55ca67f7c960 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37509cebbd9adc42 server_cookie=3423f3b5781bd0c in_seq=0 out_seq=0 2024-09-16T01:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb037fe640 1 -- 172.21.15.17:0/4162035664 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca67e5bd70 con 0x55ca67f7a540 2024-09-16T01:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb037fe640 10 client.25661 handle_command_reply: tid=0 2024-09-16T01:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 client.25661 shutdown 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 msgr2=0x55ca67ef43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 0x55ca67ef43a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55ca67efa630 tx=0x7fbb18005850 comp rx=0 tx=0).stop 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 shutdown_connections 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55ca67f7a540 0x55ca67f7c960 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca67efacb0 0x55ca67ef48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca67ef0410 0x55ca67ef43a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb037fe640 0 client.25661 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 --2- 172.21.15.17:0/4162035664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca67eefaf0 0x55ca67ef3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 >> 172.21.15.17:0/4162035664 conn(0x55ca67eec060 msgr2=0x55ca67eea9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 shutdown_connections 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 1 -- 172.21.15.17:0/4162035664 wait complete. 2024-09-16T01:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.697+0000 7fbb2d625740 20 client.25661 trim_cache size 0 max 16384 2024-09-16T01:10:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:10:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:10:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:10:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 msgr2=0x7fbb0c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 0x7fbb0c0a5920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c013b30 tx=0x7fbb1c00ad10 comp rx=0 tx=0).stop 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 msgr2=0x7fbb241982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400b4a0 tx=0x7fbb1400b960 comp rx=0 tx=0).stop 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 shutdown_connections 2024-09-16T01:10:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbb0c0a3460 0x7fbb0c0a5920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb2410c0d0 0x7fbb2419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb241035a0 0x7fbb24198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 --2- 172.21.15.17:0/73417971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb24102c80 0x7fbb241982f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 >> 172.21.15.17:0/73417971 conn(0x7fbb24077990 msgr2=0x7fbb240fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 shutdown_connections 2024-09-16T01:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:10:58.698+0000 7fbb2a88c640 1 -- 172.21.15.17:0/73417971 wait complete. 2024-09-16T01:10:59.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:10:59 smithi088 ceph-mon[34093]: pgmap v265: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:59.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:10:59 smithi154 ceph-mon[34759]: pgmap v265: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:10:59.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:10:59 smithi017 ceph-mon[31211]: pgmap v265: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:01.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:01 smithi088 ceph-mon[34093]: pgmap v266: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:01.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:01 smithi154 ceph-mon[34759]: pgmap v266: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:01.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:01 smithi017 ceph-mon[31211]: pgmap v266: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:03 smithi088 ceph-mon[34093]: pgmap v267: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:03.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:03 smithi154 ceph-mon[34759]: pgmap v267: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:03 smithi017 ceph-mon[31211]: pgmap v267: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:11:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:05 smithi088 ceph-mon[34093]: pgmap v268: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:11:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:05 smithi088 ceph-mon[34093]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:11:05.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:05 smithi154 ceph-mon[34759]: pgmap v268: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:11:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:05 smithi154 ceph-mon[34759]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:11:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:05 smithi017 ceph-mon[31211]: pgmap v268: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:11:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:05 smithi017 ceph-mon[31211]: osdmap e88: 12 total, 12 up, 12 in 2024-09-16T01:11:07.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:07 smithi088 ceph-mon[34093]: pgmap v270: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:11:07.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:07 smithi154 ceph-mon[34759]: pgmap v270: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:11:07.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:07 smithi017 ceph-mon[31211]: pgmap v270: 97 pgs: 97 active+clean; 3.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:11:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:09 smithi088 ceph-mon[34093]: pgmap v271: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:09.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:09 smithi154 ceph-mon[34759]: pgmap v271: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:09 smithi017 ceph-mon[31211]: pgmap v271: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:11 smithi088 ceph-mon[34093]: pgmap v272: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:11.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:11 smithi154 ceph-mon[34759]: pgmap v272: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:11.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:11 smithi017 ceph-mon[31211]: pgmap v272: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 39 op/s 2024-09-16T01:11:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 -- 172.21.15.17:0/2927083035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc107b70 msgr2=0x7f0fbc107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/2927083035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc107b70 0x7f0fbc107f50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009930 tx=0x7f0fb802a420 comp rx=0 tx=0).stop 2024-09-16T01:11:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 -- 172.21.15.17:0/2927083035 shutdown_connections 2024-09-16T01:11:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/2927083035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc102470 0x7f0fbc10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/2927083035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fbc101ad0 0x7f0fbc101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/2927083035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc107b70 0x7f0fbc107f50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.797+0000 7f0fc36e4640 1 -- 172.21.15.17:0/2927083035 >> 172.21.15.17:0/2927083035 conn(0x7f0fbc0fd7d0 msgr2=0x7f0fbc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.798+0000 7f0fc36e4640 1 -- 172.21.15.17:0/2927083035 shutdown_connections 2024-09-16T01:11:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.798+0000 7f0fc36e4640 1 -- 172.21.15.17:0/2927083035 wait complete. 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.798+0000 7f0fc36e4640 1 Processor -- start 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.798+0000 7f0fc36e4640 1 -- start start 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fbc101ad0 0x7f0fbc198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 0x7f0fbc19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111dd0 con 0x7f0fbc102470 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111c50 con 0x7f0fbc107b70 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111f50 con 0x7f0fbc101ad0 2024-09-16T01:11:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55988/0 (socket says 172.21.15.17:55988) 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/899174786 learned_addr learned my addr 172.21.15.17:0/899174786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 0x7f0fbc19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/899174786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fbc101ad0 msgr2=0x7f0fbc198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fbc101ad0 0x7f0fbc198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/899174786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 msgr2=0x7f0fbc19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 0x7f0fbc19cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/899174786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc19d250 con 0x7f0fbc102470 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 0x7f0fbc19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9f0 tx=0x7f0fb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fae7fc640 1 -- 172.21.15.17:0/899174786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000cd80 con 0x7f0fbc102470 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fae7fc640 1 -- 172.21.15.17:0/899174786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fb00054d0 con 0x7f0fbc102470 2024-09-16T01:11:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc19d540 con 0x7f0fbc102470 2024-09-16T01:11:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.799+0000 7f0fae7fc640 1 -- 172.21.15.17:0/899174786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0010490 con 0x7f0fbc102470 2024-09-16T01:11:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.800+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc1a4dd0 con 0x7f0fbc102470 2024-09-16T01:11:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fae7fc640 1 -- 172.21.15.17:0/899174786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0fb0005020 con 0x7f0fbc102470 2024-09-16T01:11:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 Processor -- start 2024-09-16T01:11:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 -- start start 2024-09-16T01:11:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x561047016ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x5610470240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561046f7b2f0 con 0x561047017410 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561046f23270 con 0x561047016af0 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.803+0000 7f0fc6478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561046f772b0 con 0x561047021cb0 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55992/0 (socket says 172.21.15.17:55992) 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 -- 172.21.15.17:0/2500145302 learned_addr learned my addr 172.21.15.17:0/2500145302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x561047016ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x5610470240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fae7fc640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 0x7f0fa80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 -- 172.21.15.17:0/2500145302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 msgr2=0x5610470240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x5610470240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 -- 172.21.15.17:0/2500145302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 msgr2=0x561047016ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x561047016ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 -- 172.21.15.17:0/2500145302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046f22340 con 0x561047017410 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x561047016ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x5610470240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 0x7f0fa80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fae7fc640 1 -- 172.21.15.17:0/899174786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f0fb00d0220 con 0x7f0fbc102470 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.804+0000 7f0fc1480640 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005de0 tx=0x7f0fb8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4052c736f415ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 0x7f0fa80a5920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4005fd0 tx=0x7f0fb4004a40 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fa77fe640 1 -- 172.21.15.17:0/2500145302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb803e030 con 0x561047017410 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fa77fe640 1 -- 172.21.15.17:0/2500145302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fb8032c00 con 0x561047017410 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fa77fe640 1 -- 172.21.15.17:0/2500145302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8035040 con 0x561047017410 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 -- 172.21.15.17:0/2500145302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 msgr2=0x561047021770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005de0 tx=0x7f0fb8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 -- 172.21.15.17:0/2500145302 shutdown_connections 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x5610470240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x561047021770 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 --2- 172.21.15.17:0/2500145302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x561047016ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.805+0000 7f0fc6478740 1 -- 172.21.15.17:0/2500145302 >> 172.21.15.17:0/2500145302 conn(0x561047013060 msgr2=0x561047013440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 -- 172.21.15.17:0/2500145302 shutdown_connections 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 -- 172.21.15.17:0/2500145302 wait complete. 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 -- start start 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 Processor -- start 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104701eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.806+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x56104701f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc6478740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561047024880 con 0x561047017410 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc6478740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561046f04290 con 0x561047016af0 2024-09-16T01:11:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc6478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561047024a00 con 0x561047021cb0 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc6478740 10 client.0 _ll_register_callbacks cb 0x561046f35140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56004/0 (socket says 172.21.15.17:56004) 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/253464965 learned_addr learned my addr 172.21.15.17:0/253464965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x56104701f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc1480640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104701eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/253464965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 msgr2=0x56104701f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x56104701f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 msgr2=0x56104701eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104701eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 -- 172.21.15.17:0/253464965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561046c8e210 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c6a0 tx=0x7f0fb009be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aca0e6d03cc4c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb009cbe0 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f0fb0098bd0 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb8032c00 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.807+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fb009c4e0 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 10 client.16053 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561046d5a620 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fb8032c00 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0fb00b52e0 con 0x561047017410 2024-09-16T01:11:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 10 client.16053 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 20 client.16053 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561047031b80 0x561047033f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 4 client.16053 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561046f88a20 con 0x561047031b80 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.808+0000 7f0fc1480640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561047031b80 0x561047033f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.809+0000 7f0fa4ff9640 10 client.16053 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.809+0000 7f0fc1480640 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561047031b80 0x561047033f90 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c9b47319a523dfc server_cookie=cba26ff27c40d4f7 in_seq=0 out_seq=0 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/253464965 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561046f88a20 con 0x561047031b80 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fa4ff9640 10 client.16053 handle_command_reply: tid=0 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 client.16053 shutdown 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 msgr2=0x56104701f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c6a0 tx=0x7f0fb009be40 comp rx=0 tx=0).stop 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 shutdown_connections 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561047031b80 0x561047033f90 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047021cb0 0x56104701f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fa4ff9640 0 client.16053 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047017410 0x56104701f060 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 --2- 172.21.15.17:0/253464965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104701eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 >> 172.21.15.17:0/253464965 conn(0x561047013060 msgr2=0x561047018dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 shutdown_connections 2024-09-16T01:11:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 1 -- 172.21.15.17:0/253464965 wait complete. 2024-09-16T01:11:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.810+0000 7f0fc6478740 20 client.16053 trim_cache size 0 max 16384 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.825+0000 7f0fc6478740 1 Processor -- start 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.825+0000 7f0fc6478740 1 -- start start 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.825+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047020a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 0x561047039870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc6478740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1ad780 con 0x561047016af0 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc6478740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1af2c0 con 0x561047021cb0 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc6478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1ade50 con 0x561047017410 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56012/0 (socket says 172.21.15.17:56012) 2024-09-16T01:11:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 -- 172.21.15.17:0/1596718348 learned_addr learned my addr 172.21.15.17:0/1596718348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 -- 172.21.15.17:0/1596718348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 msgr2=0x561047020a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047020a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 0x561047039870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047020a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 -- 172.21.15.17:0/1596718348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 msgr2=0x561047039870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 0x561047039870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 -- 172.21.15.17:0/1596718348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561047012e90 con 0x561047016af0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047020a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 0x561047039870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005e10 tx=0x7f0fb8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ec8d017a8b4aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fa6ffd640 1 -- 172.21.15.17:0/1596718348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8035040 con 0x561047016af0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fa6ffd640 1 -- 172.21.15.17:0/1596718348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fb80054f0 con 0x561047016af0 2024-09-16T01:11:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.826+0000 7f0fa6ffd640 1 -- 172.21.15.17:0/1596718348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb803e040 con 0x561047016af0 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- 172.21.15.17:0/1596718348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 msgr2=0x56104701f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005e10 tx=0x7f0fb8004610 comp rx=0 tx=0).stop 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- 172.21.15.17:0/1596718348 shutdown_connections 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047021cb0 0x561047039870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047020a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1596718348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047016af0 0x56104701f3d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- 172.21.15.17:0/1596718348 >> 172.21.15.17:0/1596718348 conn(0x561047013060 msgr2=0x561047020380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- 172.21.15.17:0/1596718348 shutdown_connections 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- 172.21.15.17:0/1596718348 wait complete. 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 -- start start 2024-09-16T01:11:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.827+0000 7f0fc6478740 1 Processor -- start 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104702a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047027dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1aebf0 con 0x561047021cb0 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1ae520 con 0x561047016af0 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1ab780 con 0x561047017410 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc6478740 10 client.0 _ll_register_callbacks cb 0x7f0fb009c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56014/0 (socket says 172.21.15.17:56014) 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 -- 172.21.15.17:0/1134827474 learned_addr learned my addr 172.21.15.17:0/1134827474 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104702a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc0c7f640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047027dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 -- 172.21.15.17:0/1134827474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 msgr2=0x561047027dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047027dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 -- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 msgr2=0x56104702a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104702a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.828+0000 7f0fc1c81640 1 -- 172.21.15.17:0/1134827474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561047028b40 con 0x561047021cb0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc1c81640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009420 tx=0x7f0fb4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7998251c012bd49 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4010ea0 con 0x561047021cb0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f0fb4020440 con 0x561047021cb0 2024-09-16T01:11:11.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb80054f0 con 0x561047021cb0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fb4020640 con 0x561047021cb0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56104709c840 con 0x561047021cb0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fb80054f0 con 0x561047021cb0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0fb4029980 con 0x561047021cb0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 20 client.16059 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56104709cec0 0x56104709f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 4 client.16059 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.829+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561046f82d70 con 0x56104709cec0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.830+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56104709cec0 0x56104709f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.830+0000 7f0fc1480640 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56104709cec0 0x56104709f2e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ffb215700a82eb9 server_cookie=f3b5bbf671bb44e0 in_seq=0 out_seq=0 2024-09-16T01:11:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.830+0000 7f0fa4ff9640 10 client.16059 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fa4ff9640 1 -- 172.21.15.17:0/1134827474 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561046f82d70 con 0x56104709cec0 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fa4ff9640 10 client.16059 handle_command_reply: tid=0 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 client.16059 shutdown 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 msgr2=0x561047028310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009420 tx=0x7f0fb4004ab0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 shutdown_connections 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56104709cec0 0x56104709f2e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561047021cb0 0x561047028310 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561047017410 0x561047027dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fa4ff9640 0 client.16059 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 --2- 172.21.15.17:0/1134827474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561047016af0 0x56104702a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 >> 172.21.15.17:0/1134827474 conn(0x561047013060 msgr2=0x561047018d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 shutdown_connections 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 1 -- 172.21.15.17:0/1134827474 wait complete. 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.845+0000 7f0fc6478740 20 client.16059 trim_cache size 0 max 16384 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:11:11.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 msgr2=0x7f0fa80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 0x7f0fa80a5920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4005fd0 tx=0x7f0fb4004a40 comp rx=0 tx=0).stop 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 msgr2=0x7f0fbc1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9f0 tx=0x7f0fb000edf0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 shutdown_connections 2024-09-16T01:11:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f0fa80a3460 0x7f0fa80a5920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0fbc107b70 0x7f0fbc19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fbc102470 0x7f0fbc1987a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 --2- 172.21.15.17:0/899174786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fbc101ad0 0x7f0fbc198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 >> 172.21.15.17:0/899174786 conn(0x7f0fbc0fd7d0 msgr2=0x7f0fbc0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 shutdown_connections 2024-09-16T01:11:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:11.846+0000 7f0fc36e4640 1 -- 172.21.15.17:0/899174786 wait complete. 2024-09-16T01:11:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:13 smithi088 ceph-mon[34093]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:11:13.393 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:13 smithi088 ceph-mon[34093]: pgmap v274: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:11:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:13 smithi154 ceph-mon[34759]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:11:13.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:13 smithi154 ceph-mon[34759]: pgmap v274: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:11:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:13 smithi017 ceph-mon[31211]: osdmap e89: 12 total, 12 up, 12 in 2024-09-16T01:11:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:13 smithi017 ceph-mon[31211]: pgmap v274: 97 pgs: 97 active+clean; 3.7 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-16T01:11:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:15 smithi088 ceph-mon[34093]: pgmap v275: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-16T01:11:15.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:15 smithi154 ceph-mon[34759]: pgmap v275: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-16T01:11:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:15 smithi017 ceph-mon[31211]: pgmap v275: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-16T01:11:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:17 smithi088 ceph-mon[34093]: pgmap v276: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-16T01:11:17.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:17 smithi154 ceph-mon[34759]: pgmap v276: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-16T01:11:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:17 smithi017 ceph-mon[31211]: pgmap v276: 97 pgs: 97 active+clean; 4.0 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-16T01:11:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:19 smithi088 ceph-mon[34093]: pgmap v277: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:19.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:19 smithi154 ceph-mon[34759]: pgmap v277: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:19 smithi017 ceph-mon[31211]: pgmap v277: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:21 smithi088 ceph-mon[34093]: pgmap v278: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:21.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:21 smithi017 ceph-mon[31211]: pgmap v278: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:21.743 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:21 smithi154 ceph-mon[34759]: pgmap v278: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:23 smithi088 ceph-mon[34093]: pgmap v279: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:23 smithi154 ceph-mon[34759]: pgmap v279: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:23 smithi017 ceph-mon[31211]: pgmap v279: 97 pgs: 97 active+clean; 4.2 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-09-16T01:11:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- 172.21.15.17:0/31255867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 msgr2=0x7f96a0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 --2- 172.21.15.17:0/31255867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a0100e50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9690009930 tx=0x7f969002a420 comp rx=0 tx=0).stop 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- 172.21.15.17:0/31255867 shutdown_connections 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 --2- 172.21.15.17:0/31255867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 --2- 172.21.15.17:0/31255867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a0100e50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 --2- 172.21.15.17:0/31255867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a0106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- 172.21.15.17:0/31255867 >> 172.21.15.17:0/31255867 conn(0x7f96a00fc6b0 msgr2=0x7f96a00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- 172.21.15.17:0/31255867 shutdown_connections 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- 172.21.15.17:0/31255867 wait complete. 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 Processor -- start 2024-09-16T01:11:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.947+0000 7f96a7877640 1 -- start start 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110cf0 con 0x7f96a01009f0 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110b70 con 0x7f96a0101390 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a7877640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110e70 con 0x7f96a0106a00 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49098/0 (socket says 172.21.15.17:49098) 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 -- 172.21.15.17:0/4078000347 learned_addr learned my addr 172.21.15.17:0/4078000347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a4e12640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5e14640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 -- 172.21.15.17:0/4078000347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 msgr2=0x7f96a019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 -- 172.21.15.17:0/4078000347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 msgr2=0x7f96a0198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a0198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 -- 172.21.15.17:0/4078000347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a019d2c0 con 0x7f96a01009f0 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a4e12640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a0198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5e14640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.948+0000 7f96a5613640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d950 tx=0x7f969c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.949+0000 7f96967fc640 1 -- 172.21.15.17:0/4078000347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c017070 con 0x7f96a01009f0 2024-09-16T01:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.949+0000 7f96967fc640 1 -- 172.21.15.17:0/4078000347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969c009c30 con 0x7f96a01009f0 2024-09-16T01:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.949+0000 7f96967fc640 1 -- 172.21.15.17:0/4078000347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c00f620 con 0x7f96a01009f0 2024-09-16T01:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.949+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a019d5b0 con 0x7f96a01009f0 2024-09-16T01:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.949+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01a4e40 con 0x7f96a01009f0 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.951+0000 7f96967fc640 1 -- 172.21.15.17:0/4078000347 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f969c0109a0 con 0x7f96a01009f0 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.951+0000 7f96aa60d740 1 Processor -- start 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 -- start start 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e037672ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e0376800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0375d72f0 con 0x55e037673410 2024-09-16T01:11:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e03757f270 con 0x55e037672af0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96aa60d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e0375d32b0 con 0x55e03767dcb0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49108/0 (socket says 172.21.15.17:49108) 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a5613640 1 -- 172.21.15.17:0/2662565404 learned_addr learned my addr 172.21.15.17:0/2662565404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96967fc640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 0x7f968c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a4e12640 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e0376800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a5e14640 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e037672ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.952+0000 7f96a5e14640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 0x7f968c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96967fc640 1 -- 172.21.15.17:0/4078000347 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f969c0cf9a0 con 0x7f96a01009f0 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 -- 172.21.15.17:0/2662565404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 msgr2=0x55e0376800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e0376800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 -- 172.21.15.17:0/2662565404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 msgr2=0x55e037672ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e037672ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 -- 172.21.15.17:0/2662565404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03757e340 con 0x55e037673410 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5613640 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f969c09b980 tx=0x7f969c097920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d929e5d9399a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f96a5e14640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 0x7f968c0a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9698005c40 tx=0x7f9698009500 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f968b7fe640 1 -- 172.21.15.17:0/2662565404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c020070 con 0x55e037673410 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f968b7fe640 1 -- 172.21.15.17:0/2662565404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969c09bc80 con 0x55e037673410 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.953+0000 7f968b7fe640 1 -- 172.21.15.17:0/2662565404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0cccb0 con 0x55e037673410 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- 172.21.15.17:0/2662565404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 msgr2=0x55e03767d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f969c09b980 tx=0x7f969c097920 comp rx=0 tx=0).stop 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- 172.21.15.17:0/2662565404 shutdown_connections 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e0376800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767d770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2662565404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e037672ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- 172.21.15.17:0/2662565404 >> 172.21.15.17:0/2662565404 conn(0x55e03766f060 msgr2=0x55e03766f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- 172.21.15.17:0/2662565404 shutdown_connections 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- 172.21.15.17:0/2662565404 wait complete. 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 -- start start 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.954+0000 7f96aa60d740 1 Processor -- start 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e03767ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e03767b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e037680880 con 0x55e037673410 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55e037560290 con 0x55e037672af0 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e037680a00 con 0x55e03767dcb0 2024-09-16T01:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96aa60d740 10 client.0 _ll_register_callbacks cb 0x55e037591140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49122/0 (socket says 172.21.15.17:49122) 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a5613640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e03767ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 -- 172.21.15.17:0/2955569519 learned_addr learned my addr 172.21.15.17:0/2955569519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a5e14640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e03767b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 -- 172.21.15.17:0/2955569519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 msgr2=0x55e03767b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e03767b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 -- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 msgr2=0x55e03767ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e03767ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a4e12640 1 -- 172.21.15.17:0/2955569519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0372ea210 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.955+0000 7f96a5613640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e03767ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f96a4e12640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9690009930 tx=0x7f96900316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f242918097b69b47 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f9688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690035040 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f9690004040 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f969c09bc80 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9690004240 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f96aa60d740 10 client.16071 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0373b6620 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.956+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969c09bc80 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f96900049f0 con 0x55e037673410 2024-09-16T01:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 10 client.16071 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 20 client.16071 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e03768dcb0 0x55e0376900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 4 client.16071 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0375e4a20 con 0x55e03768dcb0 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96a5613640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e03768dcb0 0x55e0376900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f96a5613640 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e03768dcb0 0x55e0376900a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8777cac778f35a server_cookie=88a3ac824098bb47 in_seq=0 out_seq=0 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.957+0000 7f9688ff9640 10 client.16071 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f9688ff9640 1 -- 172.21.15.17:0/2955569519 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0375e4a20 con 0x55e03768dcb0 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f9688ff9640 10 client.16071 handle_command_reply: tid=0 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 client.16071 shutdown 2024-09-16T01:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 msgr2=0x55e03767b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9690009930 tx=0x7f96900316d0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 shutdown_connections 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e03768dcb0 0x55e0376900a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e03767b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037673410 0x55e03767b190 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f9688ff9640 0 client.16071 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 --2- 172.21.15.17:0/2955569519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037672af0 0x55e03767ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 >> 172.21.15.17:0/2955569519 conn(0x55e03766f060 msgr2=0x55e037674dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 shutdown_connections 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.958+0000 7f96aa60d740 1 -- 172.21.15.17:0/2955569519 wait complete. 2024-09-16T01:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.959+0000 7f96aa60d740 20 client.16071 trim_cache size 0 max 16384 2024-09-16T01:11:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 Processor -- start 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 -- start start 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e03767b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e037695990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ad7e0 con 0x55e037672af0 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01af320 con 0x55e037673410 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.973+0000 7f96aa60d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01adeb0 con 0x55e03767dcb0 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49136/0 (socket says 172.21.15.17:49136) 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 -- 172.21.15.17:0/729574384 learned_addr learned my addr 172.21.15.17:0/729574384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a4e12640 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e03767b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 -- 172.21.15.17:0/729574384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 msgr2=0x55e037695990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e037695990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 -- 172.21.15.17:0/729574384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 msgr2=0x55e03767b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e03767b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 -- 172.21.15.17:0/729574384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e037673240 con 0x55e037672af0 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f96a5613640 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f969c0cd1a0 tx=0x7f969c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b7065aaf2b2ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f968affd640 1 -- 172.21.15.17:0/729574384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c020040 con 0x55e037672af0 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f968affd640 1 -- 172.21.15.17:0/729574384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969c0d3040 con 0x55e037672af0 2024-09-16T01:11:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.974+0000 7f968affd640 1 -- 172.21.15.17:0/729574384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0cccb0 con 0x55e037672af0 2024-09-16T01:11:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- 172.21.15.17:0/729574384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 msgr2=0x55e0376755b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f969c0cd1a0 tx=0x7f969c00bf60 comp rx=0 tx=0).stop 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- 172.21.15.17:0/729574384 shutdown_connections 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e03767dcb0 0x55e037695990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e03767b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 --2- 172.21.15.17:0/729574384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e037672af0 0x55e0376755b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- 172.21.15.17:0/729574384 >> 172.21.15.17:0/729574384 conn(0x55e03766f060 msgr2=0x55e03767ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- 172.21.15.17:0/729574384 shutdown_connections 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- 172.21.15.17:0/729574384 wait complete. 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 -- start start 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.975+0000 7f96aa60d740 1 Processor -- start 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e037672af0 0x55e0376864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e0376817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01aec50 con 0x55e03767dcb0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ae580 con 0x55e037673410 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ab7e0 con 0x55e037672af0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96aa60d740 10 client.0 _ll_register_callbacks cb 0x7f9690009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49146/0 (socket says 172.21.15.17:49146) 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 -- 172.21.15.17:0/1111532985 learned_addr learned my addr 172.21.15.17:0/1111532985 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a4e12640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e0376817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 -- 172.21.15.17:0/1111532985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e037672af0 msgr2=0x55e0376864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5613640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e037672af0 0x55e0376864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e037672af0 0x55e0376864c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 -- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 msgr2=0x55e0376817e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e0376817e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 -- 172.21.15.17:0/1111532985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e037682600 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a4e12640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e0376817e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f96a5e14640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9698009df0 tx=0x7f9698009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f412a4c617bc153 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.976+0000 7f9688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969800fda0 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f969801b070 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f969c0d3040 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9698004b20 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0376f8a50 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969c0d3040 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9698032640 con 0x55e03767dcb0 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 20 client.16077 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e0376f9220 0x55e0376fb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 4 client.16077 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.977+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0375ded70 con 0x55e0376f9220 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.978+0000 7f96a5613640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e0376f9220 0x55e0376fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.978+0000 7f9688ff9640 10 client.16077 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.978+0000 7f96a5613640 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e0376f9220 0x55e0376fb640 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a340571f1fe7b4 server_cookie=5554430fc8adf0c0 in_seq=0 out_seq=0 2024-09-16T01:11:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.992+0000 7f9688ff9640 1 -- 172.21.15.17:0/1111532985 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e0375ded70 con 0x55e0376f9220 2024-09-16T01:11:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.992+0000 7f9688ff9640 10 client.16077 handle_command_reply: tid=0 2024-09-16T01:11:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.992+0000 7f96aa60d740 1 client.16077 shutdown 2024-09-16T01:11:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.992+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 msgr2=0x55e037681dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.992+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9698009df0 tx=0x7f9698009b70 comp rx=0 tx=0).stop 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 shutdown_connections 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55e0376f9220 0x55e0376fb640 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e03767dcb0 0x55e037681dd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55e037673410 0x55e0376817e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f9688ff9640 0 client.16077 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 --2- 172.21.15.17:0/1111532985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e037672af0 0x55e0376864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 >> 172.21.15.17:0/1111532985 conn(0x55e03766f060 msgr2=0x55e03767c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 shutdown_connections 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 1 -- 172.21.15.17:0/1111532985 wait complete. 2024-09-16T01:11:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96aa60d740 20 client.16077 trim_cache size 0 max 16384 2024-09-16T01:11:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:11:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:11:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:11:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 msgr2=0x7f968c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 0x7f968c0a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9698005c40 tx=0x7f9698009500 comp rx=0 tx=0).stop 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 msgr2=0x7f96a01982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d950 tx=0x7f969c00de10 comp rx=0 tx=0).stop 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 shutdown_connections 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f968c0a3460 0x7f968c0a5920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a0106a00 0x7f96a019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96a0101390 0x7f96a0198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 --2- 172.21.15.17:0/4078000347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96a01009f0 0x7f96a01982d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.993+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 >> 172.21.15.17:0/4078000347 conn(0x7f96a00fc6b0 msgr2=0x7f96a006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.994+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 shutdown_connections 2024-09-16T01:11:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:24.994+0000 7f96a7877640 1 -- 172.21.15.17:0/4078000347 wait complete. 2024-09-16T01:11:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:25 smithi088 ceph-mon[34093]: pgmap v280: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-16T01:11:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:25 smithi154 ceph-mon[34759]: pgmap v280: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-16T01:11:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:25 smithi017 ceph-mon[31211]: pgmap v280: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-16T01:11:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:27 smithi088 ceph-mon[34093]: pgmap v281: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:27.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:27 smithi154 ceph-mon[34759]: pgmap v281: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:27 smithi017 ceph-mon[31211]: pgmap v281: 97 pgs: 97 active+clean; 4.3 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:29 smithi088 ceph-mon[34093]: pgmap v282: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:29 smithi154 ceph-mon[34759]: pgmap v282: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:29 smithi017 ceph-mon[31211]: pgmap v282: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:31 smithi088 ceph-mon[34093]: pgmap v283: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:31.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:31 smithi154 ceph-mon[34759]: pgmap v283: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:31.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:31 smithi017 ceph-mon[31211]: pgmap v283: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:33 smithi088 ceph-mon[34093]: pgmap v284: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:33 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:11:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:33 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:11:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:33 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:11:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:33 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:11:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:33 smithi154 ceph-mon[34759]: pgmap v284: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:33 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:11:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:33 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:11:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:33 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:11:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:33 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:11:33.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:33 smithi017 ceph-mon[31211]: pgmap v284: 97 pgs: 97 active+clean; 4.6 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:33.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:33 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:11:33.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:33 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:11:33.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:33 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:11:33.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:33 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:11:35.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:35 smithi088 ceph-mon[34093]: pgmap v285: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:35 smithi154 ceph-mon[34759]: pgmap v285: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:35.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:35 smithi017 ceph-mon[31211]: pgmap v285: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:37 smithi088 ceph-mon[34093]: pgmap v286: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:11:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:37 smithi154 ceph-mon[34759]: pgmap v286: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:11:37.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:37 smithi017 ceph-mon[31211]: pgmap v286: 97 pgs: 97 active+clean; 4.7 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.094+0000 7f2448647640 1 -- 172.21.15.17:0/3768865264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440102d60 msgr2=0x7f2440103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.094+0000 7f2448647640 1 --2- 172.21.15.17:0/3768865264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440102d60 0x7f2440103140 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2430009900 tx=0x7f243002a480 comp rx=0 tx=0).stop 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 -- 172.21.15.17:0/3768865264 shutdown_connections 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 --2- 172.21.15.17:0/3768865264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f244010c0f0 0x7f244010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 --2- 172.21.15.17:0/3768865264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440103680 0x7f244010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 --2- 172.21.15.17:0/3768865264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2440102d60 0x7f2440103140 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 -- 172.21.15.17:0/3768865264 >> 172.21.15.17:0/3768865264 conn(0x7f24400fc6f0 msgr2=0x7f24400feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 -- 172.21.15.17:0/3768865264 shutdown_connections 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 -- 172.21.15.17:0/3768865264 wait complete. 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 Processor -- start 2024-09-16T01:11:38.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.095+0000 7f2448647640 1 -- start start 2024-09-16T01:11:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 0x7f244019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440103680 0x7f244019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2440113f70 con 0x7f244010c0f0 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2440113df0 con 0x7f2440102d60 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24401140f0 con 0x7f2440103680 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50924/0 (socket says 172.21.15.17:50924) 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 -- 172.21.15.17:0/3919483453 learned_addr learned my addr 172.21.15.17:0/3919483453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f24463e3640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 0x7f244019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2445be2640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440103680 0x7f244019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 -- 172.21.15.17:0/3919483453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440103680 msgr2=0x7f244019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440103680 0x7f244019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 -- 172.21.15.17:0/3919483453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 msgr2=0x7f244019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 0x7f244019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 -- 172.21.15.17:0/3919483453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244019f4a0 con 0x7f244010c0f0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f24463e3640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 0x7f244019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2446be4640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f243800eaa0 tx=0x7f243800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f243f7fe640 1 -- 172.21.15.17:0/3919483453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243800cdb0 con 0x7f244010c0f0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f243f7fe640 1 -- 172.21.15.17:0/3919483453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2438005020 con 0x7f244010c0f0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.096+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244019f790 con 0x7f244010c0f0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.097+0000 7f243f7fe640 1 -- 172.21.15.17:0/3919483453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24380116d0 con 0x7f244010c0f0 2024-09-16T01:11:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.097+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24401a7020 con 0x7f244010c0f0 2024-09-16T01:11:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.099+0000 7f243f7fe640 1 -- 172.21.15.17:0/3919483453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f24380051d0 con 0x7f244010c0f0 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.099+0000 7f244b3e0740 1 Processor -- start 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 -- start start 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d74ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d7f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562aa5cd92f0 con 0x562aa5d7fcb0 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562aa5c81270 con 0x562aa5d74af0 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f244b3e0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aa5cd52b0 con 0x562aa5d75410 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50940/0 (socket says 172.21.15.17:50940) 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 -- 172.21.15.17:0/1645703564 learned_addr learned my addr 172.21.15.17:0/1645703564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f243f7fe640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 0x7f24280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d74ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f24463e3640 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d7f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2446be4640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 0x7f24280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 -- 172.21.15.17:0/1645703564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 msgr2=0x562aa5d7f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d7f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 -- 172.21.15.17:0/1645703564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 msgr2=0x562aa5d74ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d74ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.100+0000 7f2445be2640 1 -- 172.21.15.17:0/1645703564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa5c80340 con 0x562aa5d7fcb0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f243f7fe640 1 -- 172.21.15.17:0/3919483453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f24380cfee0 con 0x7f244010c0f0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f2445be2640 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f24340149c0 tx=0x7f243400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdc47bd466520b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f2446be4640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 0x7f24280a5920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f243809be60 tx=0x7f24380bc040 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f243cbfe640 1 -- 172.21.15.17:0/1645703564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340142d0 con 0x562aa5d7fcb0 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f243cbfe640 1 -- 172.21.15.17:0/1645703564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f243400fc10 con 0x562aa5d7fcb0 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.101+0000 7f243cbfe640 1 -- 172.21.15.17:0/1645703564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434012ae0 con 0x562aa5d7fcb0 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- 172.21.15.17:0/1645703564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 msgr2=0x562aa5d820a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f24340149c0 tx=0x7f243400c4d0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- 172.21.15.17:0/1645703564 shutdown_connections 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d820a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d7f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 --2- 172.21.15.17:0/1645703564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d74ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- 172.21.15.17:0/1645703564 >> 172.21.15.17:0/1645703564 conn(0x562aa5d71060 msgr2=0x562aa5d71440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- 172.21.15.17:0/1645703564 shutdown_connections 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- 172.21.15.17:0/1645703564 wait complete. 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 -- start start 2024-09-16T01:11:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.102+0000 7f244b3e0740 1 Processor -- start 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d7fcb0 0x562aa5d7d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562aa5d82880 con 0x562aa5d75410 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x562aa5c62290 con 0x562aa5d74af0 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aa5d82a00 con 0x562aa5d7fcb0 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f244b3e0740 10 client.0 _ll_register_callbacks cb 0x562aa5c93140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50952/0 (socket says 172.21.15.17:50952) 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 -- 172.21.15.17:0/2486101591 learned_addr learned my addr 172.21.15.17:0/2486101591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f2445be2640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d7fcb0 0x562aa5d7d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f2445be2640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 -- 172.21.15.17:0/2486101591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d7fcb0 msgr2=0x562aa5d7d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d7fcb0 0x562aa5d7d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 -- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 msgr2=0x562aa5d7cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 -- 172.21.15.17:0/2486101591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa59ec210 con 0x562aa5d75410 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f24463e3640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f243002a9a0 tx=0x7f2430031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f323f765b06122 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.103+0000 7f2425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430035040 con 0x562aa5d75410 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2430004240 con 0x562aa5d75410 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f243400fc10 con 0x562aa5d75410 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2430004440 con 0x562aa5d75410 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 10 client.16089 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aa5ab8620 con 0x562aa5d75410 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f243400fc10 con 0x562aa5d75410 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2430004b90 con 0x562aa5d75410 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 10 client.16089 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 20 client.16089 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5d8fbb0 0x562aa5d91fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 4 client.16089 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.104+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa5ce6a20 con 0x562aa5d8fbb0 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.105+0000 7f2445be2640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5d8fbb0 0x562aa5d91fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.105+0000 7f2425ffb640 10 client.16089 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.105+0000 7f2445be2640 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5d8fbb0 0x562aa5d91fc0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e6547345cce4a6 server_cookie=e3d4963aa457183e in_seq=0 out_seq=0 2024-09-16T01:11:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f2425ffb640 1 -- 172.21.15.17:0/2486101591 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562aa5ce6a20 con 0x562aa5d8fbb0 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f2425ffb640 10 client.16089 handle_command_reply: tid=0 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 client.16089 shutdown 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 msgr2=0x562aa5d7d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f243002a9a0 tx=0x7f2430031810 comp rx=0 tx=0).stop 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 shutdown_connections 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5d8fbb0 0x562aa5d91fc0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d7fcb0 0x562aa5d7d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d7d0e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f2425ffb640 0 client.16089 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2486101591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 >> 172.21.15.17:0/2486101591 conn(0x562aa5d71060 msgr2=0x562aa5d76d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 shutdown_connections 2024-09-16T01:11:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 1 -- 172.21.15.17:0/2486101591 wait complete. 2024-09-16T01:11:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.106+0000 7f244b3e0740 20 client.16089 trim_cache size 0 max 16384 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 Processor -- start 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 -- start start 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24401af990 con 0x562aa5d7fcb0 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24401b14d0 con 0x562aa5d74af0 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f244b3e0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24401b0060 con 0x562aa5d75410 2024-09-16T01:11:38.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50966/0 (socket says 172.21.15.17:50966) 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 -- 172.21.15.17:0/2407514933 learned_addr learned my addr 172.21.15.17:0/2407514933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f24463e3640 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 -- 172.21.15.17:0/2407514933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 msgr2=0x562aa5d978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 -- 172.21.15.17:0/2407514933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 msgr2=0x562aa5d7d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.121+0000 7f2445be2640 1 -- 172.21.15.17:0/2407514933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa5d70e90 con 0x562aa5d7fcb0 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f2445be2640 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f24340149c0 tx=0x7f243400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b07edb57ef04cff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f2427fff640 1 -- 172.21.15.17:0/2407514933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434014680 con 0x562aa5d7fcb0 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f2427fff640 1 -- 172.21.15.17:0/2407514933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2434012830 con 0x562aa5d7fcb0 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f2427fff640 1 -- 172.21.15.17:0/2407514933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243400fab0 con 0x562aa5d7fcb0 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 -- 172.21.15.17:0/2407514933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 msgr2=0x562aa5d97e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f24340149c0 tx=0x7f243400cd00 comp rx=0 tx=0).stop 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 -- 172.21.15.17:0/2407514933 shutdown_connections 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d7fcb0 0x562aa5d97e10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d75410 0x562aa5d978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 --2- 172.21.15.17:0/2407514933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d74af0 0x562aa5d7d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 -- 172.21.15.17:0/2407514933 >> 172.21.15.17:0/2407514933 conn(0x562aa5d71060 msgr2=0x562aa5d7ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.122+0000 7f244b3e0740 1 -- 172.21.15.17:0/2407514933 shutdown_connections 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 -- 172.21.15.17:0/2407514933 wait complete. 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 -- start start 2024-09-16T01:11:38.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 Processor -- start 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d74af0 0x562aa5d884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d7fcb0 0x562aa5d83de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24401b0e00 con 0x562aa5d75410 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f24401b0730 con 0x562aa5d7fcb0 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24401ad990 con 0x562aa5d74af0 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f244b3e0740 10 client.0 _ll_register_callbacks cb 0x7f2430005d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f24463e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f24463e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50976/0 (socket says 172.21.15.17:50976) 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f24463e3640 1 -- 172.21.15.17:0/654422033 learned_addr learned my addr 172.21.15.17:0/654422033 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.123+0000 7f2445be2640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d7fcb0 0x562aa5d83de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 -- 172.21.15.17:0/654422033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d74af0 msgr2=0x562aa5d884d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d74af0 0x562aa5d884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 -- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d7fcb0 msgr2=0x562aa5d83de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d7fcb0 0x562aa5d83de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 -- 172.21.15.17:0/654422033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa5d6c2d0 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f24463e3640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f2430005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a336acaea82dea8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430004b80 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2430004d20 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2434012830 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f243005e050 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 10 client.16095 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aa5dfa7c0 con 0x562aa5d75410 2024-09-16T01:11:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2434012830 con 0x562aa5d75410 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f243004ea50 con 0x562aa5d75410 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.124+0000 7f244b3e0740 20 client.16095 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5dfaee0 0x562aa5dfd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f244b3e0740 4 client.16095 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aa5ce0d70 con 0x562aa5dfaee0 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f2445be2640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5dfaee0 0x562aa5dfd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f2445be2640 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5dfaee0 0x562aa5dfd300 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85fdf0b3adbd414 server_cookie=880cba83d7218b9b in_seq=0 out_seq=0 2024-09-16T01:11:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.125+0000 7f2425ffb640 10 client.16095 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.140+0000 7f2425ffb640 1 -- 172.21.15.17:0/654422033 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aa5ce0d70 con 0x562aa5dfaee0 2024-09-16T01:11:38.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.140+0000 7f2425ffb640 10 client.16095 handle_command_reply: tid=0 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.140+0000 7f244b3e0740 1 client.16095 shutdown 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.140+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 msgr2=0x562aa5d837f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f2430005660 comp rx=0 tx=0).stop 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 shutdown_connections 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x562aa5dfaee0 0x562aa5dfd300 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562aa5d7fcb0 0x562aa5d83de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aa5d75410 0x562aa5d837f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 --2- 172.21.15.17:0/654422033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa5d74af0 0x562aa5d884d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2425ffb640 0 client.16095 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 >> 172.21.15.17:0/654422033 conn(0x562aa5d71060 msgr2=0x562aa5d6f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 shutdown_connections 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 1 -- 172.21.15.17:0/654422033 wait complete. 2024-09-16T01:11:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f244b3e0740 20 client.16095 trim_cache size 0 max 16384 2024-09-16T01:11:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:11:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:11:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:11:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 msgr2=0x7f24280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 0x7f24280a5920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f243809be60 tx=0x7f24380bc040 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 msgr2=0x7f244019ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f243800eaa0 tx=0x7f243800ef60 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 shutdown_connections 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f24280a3460 0x7f24280a5920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f244010c0f0 0x7f244019ed70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2440103680 0x7f244019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 --2- 172.21.15.17:0/3919483453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2440102d60 0x7f244019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.141+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 >> 172.21.15.17:0/3919483453 conn(0x7f24400fc6f0 msgr2=0x7f24400fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.142+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 shutdown_connections 2024-09-16T01:11:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:38.142+0000 7f2448647640 1 -- 172.21.15.17:0/3919483453 wait complete. 2024-09-16T01:11:39.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:39 smithi088 ceph-mon[34093]: pgmap v287: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:39.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:39 smithi154 ceph-mon[34759]: pgmap v287: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:39 smithi017 ceph-mon[31211]: pgmap v287: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:41.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:41 smithi088 ceph-mon[34093]: pgmap v288: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:41.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:41 smithi154 ceph-mon[34759]: pgmap v288: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:41.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:41 smithi017 ceph-mon[31211]: pgmap v288: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:43.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:43 smithi088 ceph-mon[34093]: pgmap v289: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:43.657 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:43 smithi154 ceph-mon[34759]: pgmap v289: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:43.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:43 smithi017 ceph-mon[31211]: pgmap v289: 97 pgs: 97 active+clean; 4.9 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:11:45.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:45 smithi088 ceph-mon[34093]: pgmap v290: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:45.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:45 smithi154 ceph-mon[34759]: pgmap v290: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:45.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:45 smithi017 ceph-mon[31211]: pgmap v290: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:47.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:47 smithi088 ceph-mon[34093]: pgmap v291: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:47.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:47 smithi154 ceph-mon[34759]: pgmap v291: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:47.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:47 smithi017 ceph-mon[31211]: pgmap v291: 97 pgs: 97 active+clean; 5.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:47.778 INFO:tasks.workunit.client.0.smithi017.stdout:437/600: open fd = 3 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:438/600: open fd = 3 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:439/600: open fd = 3 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.779 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:440/600: open fd = 3 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:441/600: open fd = 3 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:442/600: open fd = 3 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.780 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:443/600: open fd = 3 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:444/600: open fd = 3 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:445/600: open fd = 3 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.781 INFO:tasks.workunit.client.0.smithi017.stdout:446/600: open fd = 3 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:447/600: open fd = 3 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:448/600: open fd = 3 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:449/600: open fd = 3 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.782 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:450/600: open fd = 3 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:451/600: open fd = 3 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:452/600: open fd = 3 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.783 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:453/600: open fd = 3 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:454/600: open fd = 3 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:455/600: open fd = 3 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.784 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:456/600: open fd = 3 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:457/600: open fd = 3 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:458/600: open fd = 3 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.785 INFO:tasks.workunit.client.0.smithi017.stdout:459/600: open fd = 3 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:460/600: open fd = 3 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:461/600: open fd = 3 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:462/600: open fd = 3 2024-09-16T01:11:47.786 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:463/600: open fd = 3 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:464/600: open fd = 3 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:465/600: open fd = 3 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.787 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:466/600: open fd = 3 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:467/600: open fd = 3 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:468/600: open fd = 3 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:469/600: open fd = 3 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.788 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:470/600: open fd = 3 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:471/600: open fd = 3 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:472/600: open fd = 3 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.789 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:473/600: open fd = 3 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:474/600: open fd = 3 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:475/600: open fd = 3 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:476/600: open fd = 3 2024-09-16T01:11:47.790 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:477/600: open fd = 3 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:478/600: open fd = 3 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:479/600: open fd = 3 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.791 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:480/600: open fd = 3 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:481/600: open fd = 3 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:482/600: open fd = 3 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:483/600: open fd = 3 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.792 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:484/600: open fd = 3 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:485/600: open fd = 3 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:486/600: open fd = 3 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.793 INFO:tasks.workunit.client.0.smithi017.stdout:487/600: open fd = 3 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:488/600: open fd = 3 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:489/600: open fd = 3 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:490/600: open fd = 3 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.794 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:491/600: open fd = 3 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:492/600: open fd = 3 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:493/600: open fd = 3 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:494/600: open fd = 3 2024-09-16T01:11:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:495/600: open fd = 3 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:496/600: open fd = 3 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:497/600: open fd = 3 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.796 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.797 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:47.797 INFO:tasks.workunit.client.0.smithi017.stdout:498/600: open fd = 3 2024-09-16T01:11:47.797 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.797 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:11:47.797 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:11:49.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:49 smithi088 ceph-mon[34093]: pgmap v292: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:49.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:49 smithi154 ceph-mon[34759]: pgmap v292: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:49.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:49 smithi017 ceph-mon[31211]: pgmap v292: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:11:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 -- 172.21.15.17:0/3746545251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df8106a00 msgr2=0x7f8df8106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 --2- 172.21.15.17:0/3746545251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df8106a00 0x7f8df8106de0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009930 tx=0x7f8de802a420 comp rx=0 tx=0).stop 2024-09-16T01:11:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 -- 172.21.15.17:0/3746545251 shutdown_connections 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 --2- 172.21.15.17:0/3746545251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 0x7f8df810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 --2- 172.21.15.17:0/3746545251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df81009f0 0x7f8df8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 --2- 172.21.15.17:0/3746545251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df8106a00 0x7f8df8106de0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 -- 172.21.15.17:0/3746545251 >> 172.21.15.17:0/3746545251 conn(0x7f8df80fc6b0 msgr2=0x7f8df80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 -- 172.21.15.17:0/3746545251 shutdown_connections 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.241+0000 7f8dfe627640 1 -- 172.21.15.17:0/3746545251 wait complete. 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 Processor -- start 2024-09-16T01:11:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 -- start start 2024-09-16T01:11:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 0x7f8df8199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df8106a00 0x7f8df81a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8110d40 con 0x7f8df81009f0 2024-09-16T01:11:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8110bc0 con 0x7f8df8106a00 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.242+0000 7f8dfe627640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8df8110ec0 con 0x7f8df8101390 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36302/0 (socket says 172.21.15.17:36302) 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 -- 172.21.15.17:0/4174865875 learned_addr learned my addr 172.21.15.17:0/4174865875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df77fe640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 0x7f8df8199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df8106a00 0x7f8df81a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 -- 172.21.15.17:0/4174865875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 msgr2=0x7f8df8199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 0x7f8df8199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 -- 172.21.15.17:0/4174865875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df8106a00 msgr2=0x7f8df81a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df8106a00 0x7f8df81a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 -- 172.21.15.17:0/4174865875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df81a46d0 con 0x7f8df81009f0 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df7fff640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8de8031440 tx=0x7f8de8003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df57fa640 1 -- 172.21.15.17:0/4174865875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de803f070 con 0x7f8df81009f0 2024-09-16T01:11:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df57fa640 1 -- 172.21.15.17:0/4174865875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8de8031d60 con 0x7f8df81009f0 2024-09-16T01:11:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df81a48a0 con 0x7f8df81009f0 2024-09-16T01:11:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.243+0000 7f8df57fa640 1 -- 172.21.15.17:0/4174865875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8035030 con 0x7f8df81009f0 2024-09-16T01:11:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.244+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df81a4d00 con 0x7f8df81009f0 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.246+0000 7f8df57fa640 1 -- 172.21.15.17:0/4174865875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8de8042070 con 0x7f8df81009f0 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.246+0000 7f8e013c7740 1 Processor -- start 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.246+0000 7f8e013c7740 1 -- start start 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291265af0 0x561291265ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x561291270770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612911ca2f0 con 0x561291270cb0 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561291172270 con 0x561291265af0 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8e013c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5612911c62b0 con 0x561291266410 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36306/0 (socket says 172.21.15.17:36306) 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 -- 172.21.15.17:0/3654391248 learned_addr learned my addr 172.21.15.17:0/3654391248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291265af0 0x561291265ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df7fff640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x561291270770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df57fa640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 0x7f8de00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 -- 172.21.15.17:0/3654391248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 msgr2=0x561291270770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x561291270770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 -- 172.21.15.17:0/3654391248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291265af0 msgr2=0x561291265ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 0x7f8de00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291265af0 0x561291265ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 -- 172.21.15.17:0/3654391248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291171340 con 0x561291270cb0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df7fff640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x561291270770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df57fa640 1 -- 172.21.15.17:0/4174865875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f8de80f05c0 con 0x7f8df81009f0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.247+0000 7f8df77fe640 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00aca0 tx=0x7f8dec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53fdd9172db3dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8dde7fc640 1 -- 172.21.15.17:0/3654391248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec01d070 con 0x561291270cb0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 0x7f8de00a5920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009fd0 tx=0x7f8df0004a40 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8dde7fc640 1 -- 172.21.15.17:0/3654391248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dec018af0 con 0x561291270cb0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8dde7fc640 1 -- 172.21.15.17:0/3654391248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec010b60 con 0x561291270cb0 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 -- 172.21.15.17:0/3654391248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 msgr2=0x5612912730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00aca0 tx=0x7f8dec00f790 comp rx=0 tx=0).stop 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 -- 172.21.15.17:0/3654391248 shutdown_connections 2024-09-16T01:11:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291270cb0 0x5612912730a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x561291270770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 --2- 172.21.15.17:0/3654391248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291265af0 0x561291265ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 -- 172.21.15.17:0/3654391248 >> 172.21.15.17:0/3654391248 conn(0x561291262060 msgr2=0x561291262440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 -- 172.21.15.17:0/3654391248 shutdown_connections 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.248+0000 7f8e013c7740 1 -- 172.21.15.17:0/3654391248 wait complete. 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 -- start start 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 Processor -- start 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x56129126e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x56129126e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561291273880 con 0x561291265af0 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x561291153290 con 0x561291270cb0 2024-09-16T01:11:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561291273a00 con 0x561291266410 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8e013c7740 10 client.0 _ll_register_callbacks cb 0x561291184140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36312/0 (socket says 172.21.15.17:36312) 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.249+0000 7f8df7fff640 1 -- 172.21.15.17:0/80895155 learned_addr learned my addr 172.21.15.17:0/80895155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x56129126e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df77fe640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x56129126e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 -- 172.21.15.17:0/80895155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 msgr2=0x56129126e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x56129126e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 -- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 msgr2=0x56129126e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x56129126e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 -- 172.21.15.17:0/80895155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561290edd210 con 0x561291265af0 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x56129126e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:11:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df77fe640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x56129126e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8df7fff640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000c00 tx=0x7f8de803b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e157e3631ceccf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8049050 con 0x561291265af0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f8de803b5f0 con 0x561291265af0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dec018af0 con 0x561291265af0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8de80bc1a0 con 0x561291265af0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8e013c7740 10 client.16107 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.250+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561290fa9620 con 0x561291265af0 2024-09-16T01:11:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dec018af0 con 0x561291265af0 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8de80edf30 con 0x561291265af0 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 10 client.16107 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 20 client.16107 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561291280bf0 0x5612912830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 4 client.16107 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612911d7a20 con 0x561291280bf0 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.251+0000 7f8df77fe640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561291280bf0 0x5612912830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.252+0000 7f8df77fe640 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561291280bf0 0x5612912830b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702e260f8ad2aa4b server_cookie=bd6a9639cbb1ea40 in_seq=0 out_seq=0 2024-09-16T01:11:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.252+0000 7f8dd77fe640 10 client.16107 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.252+0000 7f8dd77fe640 1 -- 172.21.15.17:0/80895155 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612911d7a20 con 0x561291280bf0 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.252+0000 7f8dd77fe640 10 client.16107 handle_command_reply: tid=0 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.252+0000 7f8e013c7740 1 client.16107 shutdown 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 msgr2=0x56129126dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000c00 tx=0x7f8de803b560 comp rx=0 tx=0).stop 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 shutdown_connections 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x561291280bf0 0x5612912830b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x56129126e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291266410 0x56129126e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8dd77fe640 0 client.16107 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 --2- 172.21.15.17:0/80895155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x56129126dba0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 >> 172.21.15.17:0/80895155 conn(0x561291262060 msgr2=0x561291267d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 shutdown_connections 2024-09-16T01:11:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 1 -- 172.21.15.17:0/80895155 wait complete. 2024-09-16T01:11:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.253+0000 7f8e013c7740 20 client.16107 trim_cache size 0 max 16384 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.267+0000 7f8e013c7740 1 Processor -- start 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.267+0000 7f8e013c7740 1 -- start start 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291265af0 0x56129126e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x5612912889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81ad700 con 0x561291266410 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81af240 con 0x561291270cb0 2024-09-16T01:11:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8e013c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81addd0 con 0x561291265af0 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36326/0 (socket says 172.21.15.17:36326) 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 -- 172.21.15.17:0/4084915125 learned_addr learned my addr 172.21.15.17:0/4084915125 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x5612912889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 -- 172.21.15.17:0/4084915125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291265af0 msgr2=0x56129126e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291265af0 0x56129126e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 -- 172.21.15.17:0/4084915125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 msgr2=0x5612912889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x5612912889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 -- 172.21.15.17:0/4084915125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291260790 con 0x561291266410 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8df77fe640 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8dec01b040 tx=0x7f8dec010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25752c4ac98996c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8dddffb640 1 -- 172.21.15.17:0/4084915125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec032070 con 0x561291266410 2024-09-16T01:11:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8dddffb640 1 -- 172.21.15.17:0/4084915125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dec01e040 con 0x561291266410 2024-09-16T01:11:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.268+0000 7f8dddffb640 1 -- 172.21.15.17:0/4084915125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec01d040 con 0x561291266410 2024-09-16T01:11:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- 172.21.15.17:0/4084915125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 msgr2=0x56129126fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8dec01b040 tx=0x7f8dec010650 comp rx=0 tx=0).stop 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- 172.21.15.17:0/4084915125 shutdown_connections 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291270cb0 0x5612912889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291266410 0x56129126fb10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 --2- 172.21.15.17:0/4084915125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291265af0 0x56129126e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- 172.21.15.17:0/4084915125 >> 172.21.15.17:0/4084915125 conn(0x561291262060 msgr2=0x56129126f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- 172.21.15.17:0/4084915125 shutdown_connections 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- 172.21.15.17:0/4084915125 wait complete. 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.269+0000 7f8e013c7740 1 -- start start 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 Processor -- start 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 0x5612912745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291270cb0 0x561291274af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81aeb70 con 0x561291265af0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81ae4a0 con 0x561291266410 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8df81ab700 con 0x561291270cb0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8e013c7740 10 client.0 _ll_register_callbacks cb 0x7f8de8005e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36332/0 (socket says 172.21.15.17:36332) 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 -- 172.21.15.17:0/2357347702 learned_addr learned my addr 172.21.15.17:0/2357347702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8dfcbc4640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291270cb0 0x561291274af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df77fe640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 0x5612912745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 -- 172.21.15.17:0/2357347702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291270cb0 msgr2=0x561291274af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291270cb0 0x561291274af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 -- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 msgr2=0x5612912745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:11:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 0x5612912745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 -- 172.21.15.17:0/2357347702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612912751e0 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df77fe640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 0x5612912745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8df7fff640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8de80bc4f0 tx=0x7f8de80bc840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e412c20d86c67b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.270+0000 7f8dd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80f4070 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f8de80bdb70 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dec01e040 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8de8049070 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 10 client.16113 fetch_fsmap learned FSMap version 28 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5612912eb840 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dec01e040 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8de80f00d0 con 0x561291265af0 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 10 client.16113 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:11:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 20 client.16113 populate_metadata read hostname 'smithi017' 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5612912ebdd0 0x5612912ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 4 client.16113 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.271+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612911d1d70 con 0x5612912ebdd0 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.272+0000 7f8df77fe640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5612912ebdd0 0x5612912ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.272+0000 7f8df77fe640 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5612912ebdd0 0x5612912ee1c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=505b6750004b2626 server_cookie=21bcc167d7888452 in_seq=0 out_seq=0 2024-09-16T01:11:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.272+0000 7f8dd77fe640 10 client.16113 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.286+0000 7f8dd77fe640 1 -- 172.21.15.17:0/2357347702 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612911d1d70 con 0x5612912ebdd0 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.286+0000 7f8dd77fe640 10 client.16113 handle_command_reply: tid=0 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 client.16113 shutdown 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 msgr2=0x561291279290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8de80bc4f0 tx=0x7f8de80bc840 comp rx=0 tx=0).stop 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 shutdown_connections 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5612912ebdd0 0x5612912ee1c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561291270cb0 0x561291274af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8dd77fe640 0 client.16113 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:11:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x561291266410 0x5612912745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 --2- 172.21.15.17:0/2357347702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561291265af0 0x561291279290 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 >> 172.21.15.17:0/2357347702 conn(0x561291262060 msgr2=0x5612912611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 shutdown_connections 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 1 -- 172.21.15.17:0/2357347702 wait complete. 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.287+0000 7f8e013c7740 20 client.16113 trim_cache size 0 max 16384 2024-09-16T01:11:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:11:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:11:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:11:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:11:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 msgr2=0x7f8de00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 0x7f8de00a5920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009fd0 tx=0x7f8df0004a40 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 msgr2=0x7f8df8199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8de8031440 tx=0x7f8de8003d50 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 shutdown_connections 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f8de00a3460 0x7f8de00a5920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8df8106a00 0x7f8df81a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df8101390 0x7f8df8199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 --2- 172.21.15.17:0/4174865875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8df81009f0 0x7f8df8199110 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 >> 172.21.15.17:0/4174865875 conn(0x7f8df80fc6b0 msgr2=0x7f8df80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 shutdown_connections 2024-09-16T01:11:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:11:51.288+0000 7f8dfe627640 1 -- 172.21.15.17:0/4174865875 wait complete. 2024-09-16T01:11:51.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:51 smithi088 ceph-mon[34093]: pgmap v293: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:51.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:51 smithi154 ceph-mon[34759]: pgmap v293: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:51 smithi017 ceph-mon[31211]: pgmap v293: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:53.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:53 smithi088 ceph-mon[34093]: pgmap v294: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:53.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:53 smithi154 ceph-mon[34759]: pgmap v294: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:53.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:53 smithi017 ceph-mon[31211]: pgmap v294: 97 pgs: 97 active+clean; 5.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:11:55.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:55 smithi088 ceph-mon[34093]: pgmap v295: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-09-16T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:55 smithi154 ceph-mon[34759]: pgmap v295: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-09-16T01:11:55.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:55 smithi017 ceph-mon[31211]: pgmap v295: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-09-16T01:11:57.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:57 smithi088 ceph-mon[34093]: pgmap v296: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-16T01:11:57.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:57 smithi154 ceph-mon[34759]: pgmap v296: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-16T01:11:57.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:57 smithi017 ceph-mon[31211]: pgmap v296: 97 pgs: 97 active+clean; 1.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-16T01:11:59.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:11:59 smithi088 ceph-mon[34093]: pgmap v297: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:11:59.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:11:59 smithi154 ceph-mon[34759]: pgmap v297: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:11:59.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:11:59 smithi017 ceph-mon[31211]: pgmap v297: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:12:01.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:01 smithi088 ceph-mon[34093]: pgmap v298: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:01.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:01 smithi154 ceph-mon[34759]: pgmap v298: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:01.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:01 smithi017 ceph-mon[31211]: pgmap v298: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:03 smithi088 ceph-mon[34093]: pgmap v299: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:03.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:03 smithi154 ceph-mon[34759]: pgmap v299: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:03 smithi017 ceph-mon[31211]: pgmap v299: 97 pgs: 97 active+clean; 1.7 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-16T01:12:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.389+0000 7fa425cae640 1 -- 172.21.15.17:0/1600328120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 msgr2=0x7fa42010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.389+0000 7fa425cae640 1 --2- 172.21.15.17:0/1600328120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa42010d8c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa418009cd0 tx=0x7fa41802a8e0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.389+0000 7fa425cae640 1 -- 172.21.15.17:0/1600328120 shutdown_connections 2024-09-16T01:12:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.389+0000 7fa425cae640 1 --2- 172.21.15.17:0/1600328120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa42010d8c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.389+0000 7fa425cae640 1 --2- 172.21.15.17:0/1600328120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4201009f0 0x7fa420100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 --2- 172.21.15.17:0/1600328120 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa420106a00 0x7fa420106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- 172.21.15.17:0/1600328120 >> 172.21.15.17:0/1600328120 conn(0x7fa4200fc6b0 msgr2=0x7fa4200fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- 172.21.15.17:0/1600328120 shutdown_connections 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- 172.21.15.17:0/1600328120 wait complete. 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 Processor -- start 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- start start 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4201009f0 0x7fa4201990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 0x7fa4201a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110d40 con 0x7fa420101390 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110bc0 con 0x7fa4201009f0 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.390+0000 7fa425cae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110ec0 con 0x7fa420106a00 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36436/0 (socket says 172.21.15.17:36436) 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 -- 172.21.15.17:0/4240778725 learned_addr learned my addr 172.21.15.17:0/4240778725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4201009f0 0x7fa4201990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41ffff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 0x7fa4201a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 -- 172.21.15.17:0/4240778725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 msgr2=0x7fa4201a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 0x7fa4201a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 -- 172.21.15.17:0/4240778725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4201009f0 msgr2=0x7fa4201990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4201009f0 0x7fa4201990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 -- 172.21.15.17:0/4240778725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201a46b0 con 0x7fa420101390 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41ffff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 0x7fa4201a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa417fff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa40800d770 tx=0x7fa40800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41d7fa640 1 -- 172.21.15.17:0/4240778725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408017070 con 0x7fa420101390 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41d7fa640 1 -- 172.21.15.17:0/4240778725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4080054d0 con 0x7fa420101390 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4201a4880 con 0x7fa420101390 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa41d7fa640 1 -- 172.21.15.17:0/4240778725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408004cf0 con 0x7fa420101390 2024-09-16T01:12:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.391+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4201a4d50 con 0x7fa420101390 2024-09-16T01:12:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41d7fa640 1 -- 172.21.15.17:0/4240778725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa408004e90 con 0x7fa420101390 2024-09-16T01:12:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 Processor -- start 2024-09-16T01:12:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 -- start start 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e8fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 0x556e02e9d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e02df42f0 con 0x556e02e90410 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e02d9c270 con 0x556e02e9acb0 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa428a48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e02df02b0 con 0x556e02e8faf0 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36448/0 (socket says 172.21.15.17:36448) 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 -- 172.21.15.17:0/664401735 learned_addr learned my addr 172.21.15.17:0/664401735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41ffff640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e8fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa417fff640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 0x556e02e9d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41d7fa640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 0x7fa40c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 -- 172.21.15.17:0/664401735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 msgr2=0x556e02e8fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e8fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 -- 172.21.15.17:0/664401735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 msgr2=0x556e02e9d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 0x556e02e9d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa41f7fe640 1 -- 172.21.15.17:0/664401735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e02d9b340 con 0x556e02e90410 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.395+0000 7fa417fff640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 0x556e02e9d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa41ffff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 0x7fa40c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa41d7fa640 1 -- 172.21.15.17:0/4240778725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa4080cf7b0 con 0x7fa420101390 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa410009c70 tx=0x7fa410011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd5385ea77c4d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa415ffb640 1 -- 172.21.15.17:0/664401735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410004230 con 0x556e02e90410 2024-09-16T01:12:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa415ffb640 1 -- 172.21.15.17:0/664401735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4100043d0 con 0x556e02e90410 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.396+0000 7fa415ffb640 1 -- 172.21.15.17:0/664401735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4100196d0 con 0x556e02e90410 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- 172.21.15.17:0/664401735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 msgr2=0x556e02e9a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa410009c70 tx=0x7fa410011810 comp rx=0 tx=0).stop 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa41ffff640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 0x7fa40c0a5920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa418004af0 tx=0x7fa41803f040 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- 172.21.15.17:0/664401735 shutdown_connections 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e9acb0 0x556e02e9d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e90410 0x556e02e9a770 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 --2- 172.21.15.17:0/664401735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e8fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- 172.21.15.17:0/664401735 >> 172.21.15.17:0/664401735 conn(0x556e02e8c060 msgr2=0x556e02e8c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- 172.21.15.17:0/664401735 shutdown_connections 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- 172.21.15.17:0/664401735 wait complete. 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 -- start start 2024-09-16T01:12:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.397+0000 7fa428a48740 1 Processor -- start 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e97b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e90410 0x556e02e98070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e02e9d880 con 0x556e02e9acb0 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556e02d7d290 con 0x556e02e90410 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e02e9da00 con 0x556e02e8faf0 2024-09-16T01:12:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa428a48740 10 client.0 _ll_register_callbacks cb 0x556e02dae140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36450/0 (socket says 172.21.15.17:36450) 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 -- 172.21.15.17:0/566049798 learned_addr learned my addr 172.21.15.17:0/566049798 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e97b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa417fff640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e90410 0x556e02e98070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 -- 172.21.15.17:0/566049798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 msgr2=0x556e02e97b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e97b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 -- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e90410 msgr2=0x556e02e98070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e90410 0x556e02e98070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 -- 172.21.15.17:0/566049798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e02b07210 con 0x556e02e9acb0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa41ffff640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa418035000 tx=0x7fa418004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fb8a89349e548 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.398+0000 7fa3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418031ce0 con 0x556e02e9acb0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa4180305a0 con 0x556e02e9acb0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4100043d0 con 0x556e02e9acb0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4180307a0 con 0x556e02e9acb0 2024-09-16T01:12:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 10 client.16125 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e02bd3620 con 0x556e02e9acb0 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4100043d0 con 0x556e02e9acb0 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa418030070 con 0x556e02e9acb0 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 10 client.16125 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 20 client.16125 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02eaeeb0 0x556e02eb12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 4 client.16125 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:12:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.399+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e02e01a20 con 0x556e02eaeeb0 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.400+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02eaeeb0 0x556e02eb12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.400+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02eaeeb0 0x556e02eb12c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa5edbc8ea0def0 server_cookie=3623a20ce23a3997 in_seq=0 out_seq=0 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.400+0000 7fa3feffd640 10 client.16125 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa3feffd640 1 -- 172.21.15.17:0/566049798 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e02e01a20 con 0x556e02eaeeb0 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa3feffd640 10 client.16125 handle_command_reply: tid=0 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 client.16125 shutdown 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 msgr2=0x556e02e985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa418035000 tx=0x7fa418004a40 comp rx=0 tx=0).stop 2024-09-16T01:12:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 shutdown_connections 2024-09-16T01:12:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02eaeeb0 0x556e02eb12c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02e985b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e90410 0x556e02e98070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 --2- 172.21.15.17:0/566049798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e8faf0 0x556e02e97b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa3feffd640 0 client.16125 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 >> 172.21.15.17:0/566049798 conn(0x556e02e8c060 msgr2=0x556e02e91d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 shutdown_connections 2024-09-16T01:12:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 1 -- 172.21.15.17:0/566049798 wait complete. 2024-09-16T01:12:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.401+0000 7fa428a48740 20 client.16125 trim_cache size 0 max 16384 2024-09-16T01:12:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 Processor -- start 2024-09-16T01:12:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 -- start start 2024-09-16T01:12:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02e92560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02e99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201ab640 con 0x556e02e9acb0 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201ad180 con 0x556e02e8faf0 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa428a48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201abd10 con 0x556e02e90410 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36454/0 (socket says 172.21.15.17:36454) 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 -- 172.21.15.17:0/420424852 learned_addr learned my addr 172.21.15.17:0/420424852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa417fff640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02e99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 -- 172.21.15.17:0/420424852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 msgr2=0x556e02e99aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02e99aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02e92560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 -- 172.21.15.17:0/420424852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 msgr2=0x556e02e92560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02e92560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41ffff640 1 -- 172.21.15.17:0/420424852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e02e8be90 con 0x556e02e9acb0 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa417fff640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02e99aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.416+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02e92560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa41ffff640 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa418030360 tx=0x7fa4180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22811c5c0ad5ed49 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa4157fa640 1 -- 172.21.15.17:0/420424852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41805c070 con 0x556e02e9acb0 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa4157fa640 1 -- 172.21.15.17:0/420424852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa41804b070 con 0x556e02e9acb0 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa4157fa640 1 -- 172.21.15.17:0/420424852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418030dc0 con 0x556e02e9acb0 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 -- 172.21.15.17:0/420424852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 msgr2=0x556e02eb6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa418030360 tx=0x7fa4180095c0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 -- 172.21.15.17:0/420424852 shutdown_connections 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02eb6bd0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02e99aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 --2- 172.21.15.17:0/420424852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02e92560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 -- 172.21.15.17:0/420424852 >> 172.21.15.17:0/420424852 conn(0x556e02e8c060 msgr2=0x556e02e99390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 -- 172.21.15.17:0/420424852 shutdown_connections 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.417+0000 7fa428a48740 1 -- 172.21.15.17:0/420424852 wait complete. 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 -- start start 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 Processor -- start 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02ea7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02ea7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201acab0 con 0x556e02e9acb0 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201ac3e0 con 0x556e02e8faf0 2024-09-16T01:12:04.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201a9660 con 0x556e02e90410 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa428a48740 10 client.0 _ll_register_callbacks cb 0x7fa410005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36470/0 (socket says 172.21.15.17:36470) 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa41ffff640 1 -- 172.21.15.17:0/473793363 learned_addr learned my addr 172.21.15.17:0/473793363 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa417fff640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02ea7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.418+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02ea7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 -- 172.21.15.17:0/473793363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 msgr2=0x556e02ea7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02ea7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 -- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 msgr2=0x556e02ea7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02ea7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 -- 172.21.15.17:0/473793363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e02ea2f10 con 0x556e02e9acb0 2024-09-16T01:12:04.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa417fff640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02ea7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa41ffff640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa418005ba0 tx=0x7fa418009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c171e35d325b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41805c070 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa4180309e0 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa41804b070 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa418030be0 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa428a48740 10 client.16131 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e02f19650 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa41804b070 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.419+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa418030040 con 0x556e02e9acb0 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 20 client.16131 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:04.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02f19c00 0x556e02f1bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 4 client.16131 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:12:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e02dfbd70 con 0x556e02f19c00 2024-09-16T01:12:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02f19c00 0x556e02f1bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa41f7fe640 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02f19c00 0x556e02f1bff0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2697344c88444a server_cookie=d6002f6f745730bb in_seq=0 out_seq=0 2024-09-16T01:12:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.420+0000 7fa3feffd640 10 client.16131 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa3feffd640 1 -- 172.21.15.17:0/473793363 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e02dfbd70 con 0x556e02f19c00 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa3feffd640 10 client.16131 handle_command_reply: tid=0 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 client.16131 shutdown 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 msgr2=0x556e02ea26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa418005ba0 tx=0x7fa418009b20 comp rx=0 tx=0).stop 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 shutdown_connections 2024-09-16T01:12:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x556e02f19c00 0x556e02f1bff0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e02e9acb0 0x556e02ea26e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e02e90410 0x556e02ea7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa3feffd640 0 client.16131 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 --2- 172.21.15.17:0/473793363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556e02e8faf0 0x556e02ea7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 >> 172.21.15.17:0/473793363 conn(0x556e02e8c060 msgr2=0x556e02e8b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 shutdown_connections 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 1 -- 172.21.15.17:0/473793363 wait complete. 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.442+0000 7fa428a48740 20 client.16131 trim_cache size 0 max 16384 2024-09-16T01:12:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:12:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:12:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:12:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 msgr2=0x7fa40c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 0x7fa40c0a5920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa418004af0 tx=0x7fa41803f040 comp rx=0 tx=0).stop 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 msgr2=0x7fa420199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa40800d770 tx=0x7fa40800dc30 comp rx=0 tx=0).stop 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 shutdown_connections 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa40c0a3460 0x7fa40c0a5920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa420106a00 0x7fa4201a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa420101390 0x7fa420199630 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 --2- 172.21.15.17:0/4240778725 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4201009f0 0x7fa4201990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 >> 172.21.15.17:0/4240778725 conn(0x7fa4200fc6b0 msgr2=0x7fa4200fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 shutdown_connections 2024-09-16T01:12:04.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:04.443+0000 7fa425cae640 1 -- 172.21.15.17:0/4240778725 wait complete. 2024-09-16T01:12:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:05 smithi088 ceph-mon[34093]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:12:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:05 smithi088 ceph-mon[34093]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:12:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:05 smithi154 ceph-mon[34759]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:12:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:05 smithi154 ceph-mon[34759]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:12:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:05 smithi017 ceph-mon[31211]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 102 KiB/s wr, 40 op/s 2024-09-16T01:12:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:05 smithi017 ceph-mon[31211]: osdmap e90: 12 total, 12 up, 12 in 2024-09-16T01:12:07.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:07 smithi088 ceph-mon[34093]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-09-16T01:12:07.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:07 smithi154 ceph-mon[34759]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-09-16T01:12:07.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:07 smithi017 ceph-mon[31211]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 96 KiB/s wr, 36 op/s 2024-09-16T01:12:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:09 smithi088 ceph-mon[34093]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:09.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:09 smithi154 ceph-mon[34759]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:09 smithi017 ceph-mon[31211]: pgmap v303: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:11 smithi088 ceph-mon[34093]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:11.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:11 smithi154 ceph-mon[34759]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:11 smithi017 ceph-mon[31211]: pgmap v304: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-16T01:12:13.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:13 smithi088 ceph-mon[34093]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:12:13.394 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:13 smithi088 ceph-mon[34093]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-16T01:12:13.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:13 smithi154 ceph-mon[34759]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:12:13.405 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:13 smithi154 ceph-mon[34759]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-16T01:12:13.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:13 smithi017 ceph-mon[31211]: osdmap e91: 12 total, 12 up, 12 in 2024-09-16T01:12:13.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:13 smithi017 ceph-mon[31211]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-16T01:12:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:15 smithi088 ceph-mon[34093]: pgmap v307: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:15.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:15 smithi154 ceph-mon[34759]: pgmap v307: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:15 smithi017 ceph-mon[31211]: pgmap v307: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 -- 172.21.15.17:0/636931576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208106a00 msgr2=0x7f4208106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 --2- 172.21.15.17:0/636931576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208106a00 0x7f4208106de0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4204009930 tx=0x7f420402a420 comp rx=0 tx=0).stop 2024-09-16T01:12:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 -- 172.21.15.17:0/636931576 shutdown_connections 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 --2- 172.21.15.17:0/636931576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4208101390 0x7f420810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 --2- 172.21.15.17:0/636931576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42081009f0 0x7f4208100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 --2- 172.21.15.17:0/636931576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208106a00 0x7f4208106de0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 -- 172.21.15.17:0/636931576 >> 172.21.15.17:0/636931576 conn(0x7f42080fc6b0 msgr2=0x7f42080fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 -- 172.21.15.17:0/636931576 shutdown_connections 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.543+0000 7f420fb68640 1 -- 172.21.15.17:0/636931576 wait complete. 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 Processor -- start 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 -- start start 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42081009f0 0x7f42081971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4208106a00 0x7f420819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4208110cf0 con 0x7f4208101390 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4208110b70 con 0x7f4208106a00 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420fb68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4208110e70 con 0x7f42081009f0 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51910/0 (socket says 172.21.15.17:51910) 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 -- 172.21.15.17:0/1979214749 learned_addr learned my addr 172.21.15.17:0/1979214749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d904640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42081009f0 0x7f42081971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420e105640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4208106a00 0x7f420819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 -- 172.21.15.17:0/1979214749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42081009f0 msgr2=0x7f42081971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42081009f0 0x7f42081971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 -- 172.21.15.17:0/1979214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4208106a00 msgr2=0x7f420819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4208106a00 0x7f420819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.544+0000 7f420d103640 1 -- 172.21.15.17:0/1979214749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420819c190 con 0x7f4208101390 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f420d103640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9f0 tx=0x7f41f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f41feffd640 1 -- 172.21.15.17:0/1979214749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f800cd80 con 0x7f4208101390 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f41feffd640 1 -- 172.21.15.17:0/1979214749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41f80108e0 con 0x7f4208101390 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420819c480 con 0x7f4208101390 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f41feffd640 1 -- 172.21.15.17:0/1979214749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8018920 con 0x7f4208101390 2024-09-16T01:12:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.545+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42081a3d10 con 0x7f4208101390 2024-09-16T01:12:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.547+0000 7f41feffd640 1 -- 172.21.15.17:0/1979214749 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f41f8010a90 con 0x7f4208101390 2024-09-16T01:12:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 Processor -- start 2024-09-16T01:12:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 -- start start 2024-09-16T01:12:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc306b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 0x55acc306e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55acc2fc32f0 con 0x55acc305e970 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55acc2f6b270 con 0x55acc306bec0 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f42129da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acc2fbf2b0 con 0x55acc305f290 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f41feffd640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 0x7f41f40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f420e105640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f420e105640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51916/0 (socket says 172.21.15.17:51916) 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f420e105640 1 -- 172.21.15.17:0/1453677832 learned_addr learned my addr 172.21.15.17:0/1453677832 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f420d103640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 0x55acc306e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.548+0000 7f420e105640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 0x7f41f40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f41feffd640 1 -- 172.21.15.17:0/1979214749 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f41f80d0150 con 0x7f4208101390 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420d904640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc306b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 -- 172.21.15.17:0/1453677832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 msgr2=0x55acc306b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc306b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 -- 172.21.15.17:0/1453677832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 msgr2=0x55acc306e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 0x55acc306e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 -- 172.21.15.17:0/1453677832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc2f6a340 con 0x55acc305e970 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420d103640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 0x55acc306e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4200012c50 tx=0x7f4200010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a6126f3b71d4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f420e105640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 0x7f41f40a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4200010c40 tx=0x7f4200017000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f41f3fff640 1 -- 172.21.15.17:0/1453677832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000127f0 con 0x55acc305e970 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f41f3fff640 1 -- 172.21.15.17:0/1453677832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4200009c00 con 0x55acc305e970 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.549+0000 7f41f3fff640 1 -- 172.21.15.17:0/1453677832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200005260 con 0x55acc305e970 2024-09-16T01:12:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 -- 172.21.15.17:0/1453677832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 msgr2=0x55acc305ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4200012c50 tx=0x7f4200010740 comp rx=0 tx=0).stop 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 -- 172.21.15.17:0/1453677832 shutdown_connections 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc306bec0 0x55acc306e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc306b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 --2- 172.21.15.17:0/1453677832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305e970 0x55acc305ed50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 -- 172.21.15.17:0/1453677832 >> 172.21.15.17:0/1453677832 conn(0x55acc305b060 msgr2=0x55acc305b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 -- 172.21.15.17:0/1453677832 shutdown_connections 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.550+0000 7f42129da740 1 -- 172.21.15.17:0/1453677832 wait complete. 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 -- start start 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 Processor -- start 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3068e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55acc306ea90 con 0x55acc305f290 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55acc2f4c290 con 0x55acc305e970 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acc306ec10 con 0x55acc306bec0 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f42129da740 10 client.0 _ll_register_callbacks cb 0x55acc2f7d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.551+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51926/0 (socket says 172.21.15.17:51926) 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 -- 172.21.15.17:0/702012679 learned_addr learned my addr 172.21.15.17:0/702012679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d904640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420e105640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 -- 172.21.15.17:0/702012679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 msgr2=0x55acc3069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 -- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 msgr2=0x55acc3068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 -- 172.21.15.17:0/702012679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc2cd6210 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d904640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f420d103640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f41f809c130 tx=0x7f41f801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683f8f6ea8ca4bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f41f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80a4e10 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f41f80b52c0 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55acc2fd0a20 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41f809cb30 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f42129da740 10 client.16143 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.552+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55acc2da2620 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55acc2fd0a20 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41f809b880 con 0x55acc305f290 2024-09-16T01:12:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 10 client.16143 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 20 client.16143 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc307be50 0x55acc307e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 4 client.16143 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acc2fcad70 con 0x55acc307be50 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.553+0000 7f420d904640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc307be50 0x55acc307e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f420d904640 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc307be50 0x55acc307e240 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0e9ad99f792022 server_cookie=44053895d5782815 in_seq=0 out_seq=0 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f41f17fa640 10 client.16143 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f41f17fa640 1 -- 172.21.15.17:0/702012679 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acc2fcad70 con 0x55acc307be50 2024-09-16T01:12:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f41f17fa640 10 client.16143 handle_command_reply: tid=0 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f42129da740 1 client.16143 shutdown 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 msgr2=0x55acc30693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.554+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f41f809c130 tx=0x7f41f801c850 comp rx=0 tx=0).stop 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 shutdown_connections 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc307be50 0x55acc307e240 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc30693d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f41f17fa640 0 client.16143 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 --2- 172.21.15.17:0/702012679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 >> 172.21.15.17:0/702012679 conn(0x55acc305b060 msgr2=0x55acc3060dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 shutdown_connections 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 1 -- 172.21.15.17:0/702012679 wait complete. 2024-09-16T01:12:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.555+0000 7f42129da740 20 client.16143 trim_cache size 0 max 16384 2024-09-16T01:12:17.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.569+0000 7f42129da740 1 Processor -- start 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.569+0000 7f42129da740 1 -- start start 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc3084000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42081ab550 con 0x55acc306bec0 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f42081ad090 con 0x55acc305e970 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f42129da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42081abc20 con 0x55acc305f290 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51934/0 (socket says 172.21.15.17:51934) 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 -- 172.21.15.17:0/3747762939 learned_addr learned my addr 172.21.15.17:0/3747762939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420d904640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 -- 172.21.15.17:0/3747762939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 msgr2=0x55acc3084000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420d103640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc3084000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc3084000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 -- 172.21.15.17:0/3747762939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 msgr2=0x55acc3083ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3083ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 -- 172.21.15.17:0/3747762939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc3064a50 con 0x55acc306bec0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420d904640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3083ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f420e105640 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f42000097c0 tx=0x7f4200009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743cf954cd3892c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.570+0000 7f41f37fe640 1 -- 172.21.15.17:0/3747762939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200012e00 con 0x55acc306bec0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f41f37fe640 1 -- 172.21.15.17:0/3747762939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f420002a070 con 0x55acc306bec0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f41f37fe640 1 -- 172.21.15.17:0/3747762939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200005260 con 0x55acc306bec0 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- 172.21.15.17:0/3747762939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 msgr2=0x55acc30660f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f42000097c0 tx=0x7f4200009dc0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- 172.21.15.17:0/3747762939 shutdown_connections 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc306bec0 0x55acc30660f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc305f290 0x55acc3084000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 --2- 172.21.15.17:0/3747762939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3083ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- 172.21.15.17:0/3747762939 >> 172.21.15.17:0/3747762939 conn(0x55acc305b060 msgr2=0x55acc3069670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- 172.21.15.17:0/3747762939 shutdown_connections 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- 172.21.15.17:0/3747762939 wait complete. 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.571+0000 7f42129da740 1 -- start start 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 Processor -- start 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3074780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3066440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42081ac9c0 con 0x55acc305f290 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f42081ac2f0 con 0x55acc305e970 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42081a9550 con 0x55acc306bec0 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f42129da740 10 client.0 _ll_register_callbacks cb 0x7f41f800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51948/0 (socket says 172.21.15.17:51948) 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 -- 172.21.15.17:0/1646870198 learned_addr learned my addr 172.21.15.17:0/1646870198 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d904640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 -- 172.21.15.17:0/1646870198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 msgr2=0x55acc3066440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420e105640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3066440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 -- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 msgr2=0x55acc3074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3074780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.572+0000 7f420d103640 1 -- 172.21.15.17:0/1646870198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc30e5a90 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f420d103640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41f8098890 tx=0x7f41f80b5490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62577c21b1d0b34d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f809c430 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f41f8098250 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420002a070 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f41f80a07e0 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 10 client.16149 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55acc30e6c40 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f420002a070 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41f80a1970 con 0x55acc305f290 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 20 client.16149 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc30e73e0 0x55acc30e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 4 client.16149 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.573+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55acc2f47900 con 0x55acc30e73e0 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.574+0000 7f420d904640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc30e73e0 0x55acc30e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.574+0000 7f41f17fa640 10 client.16149 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.574+0000 7f420d904640 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc30e73e0 0x55acc30e9800 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4dd9130295a4e96 server_cookie=2224c82db111cbf9 in_seq=0 out_seq=0 2024-09-16T01:12:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f41f17fa640 1 -- 172.21.15.17:0/1646870198 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55acc2f47900 con 0x55acc30e73e0 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f41f17fa640 10 client.16149 handle_command_reply: tid=0 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 client.16149 shutdown 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 msgr2=0x55acc3065d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41f8098890 tx=0x7f41f80b5490 comp rx=0 tx=0).stop 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 shutdown_connections 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55acc30e73e0 0x55acc30e9800 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acc306bec0 0x55acc3066440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acc305f290 0x55acc3065d00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f41f17fa640 0 client.16149 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 --2- 172.21.15.17:0/1646870198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55acc305e970 0x55acc3074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 >> 172.21.15.17:0/1646870198 conn(0x55acc305b060 msgr2=0x55acc30599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 shutdown_connections 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 1 -- 172.21.15.17:0/1646870198 wait complete. 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.589+0000 7f42129da740 20 client.16149 trim_cache size 0 max 16384 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:12:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 msgr2=0x7f41f40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 0x7f41f40a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4200010c40 tx=0x7f4200017000 comp rx=0 tx=0).stop 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 msgr2=0x7f42081976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f41f800e9f0 tx=0x7f41f800eeb0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 shutdown_connections 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f41f40a3460 0x7f41f40a5920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4208106a00 0x7f420819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4208101390 0x7f42081976e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 --2- 172.21.15.17:0/1979214749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42081009f0 0x7f42081971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 >> 172.21.15.17:0/1979214749 conn(0x7f42080fc6b0 msgr2=0x7f42080fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 shutdown_connections 2024-09-16T01:12:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:17.590+0000 7f420fb68640 1 -- 172.21.15.17:0/1979214749 wait complete. 2024-09-16T01:12:17.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:17 smithi088 ceph-mon[34093]: pgmap v308: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:12:17.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:17 smithi154 ceph-mon[34759]: pgmap v308: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:12:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:17 smithi017 ceph-mon[31211]: pgmap v308: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-16T01:12:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:19 smithi088 ceph-mon[34093]: pgmap v309: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:19.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:19 smithi154 ceph-mon[34759]: pgmap v309: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:19 smithi017 ceph-mon[31211]: pgmap v309: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:21 smithi088 ceph-mon[34093]: pgmap v310: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:21.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:21 smithi154 ceph-mon[34759]: pgmap v310: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:21 smithi017 ceph-mon[31211]: pgmap v310: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:23 smithi088 ceph-mon[34093]: pgmap v311: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:23 smithi154 ceph-mon[34759]: pgmap v311: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:23 smithi017 ceph-mon[31211]: pgmap v311: 97 pgs: 97 active+clean; 2.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:12:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:25 smithi088 ceph-mon[34093]: pgmap v312: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:25 smithi154 ceph-mon[34759]: pgmap v312: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:25 smithi017 ceph-mon[31211]: pgmap v312: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:27 smithi088 ceph-mon[34093]: pgmap v313: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:27 smithi154 ceph-mon[34759]: pgmap v313: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:27.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:27 smithi017 ceph-mon[31211]: pgmap v313: 97 pgs: 97 active+clean; 2.8 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:29 smithi088 ceph-mon[34093]: pgmap v314: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:12:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:29 smithi154 ceph-mon[34759]: pgmap v314: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:12:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:29 smithi017 ceph-mon[31211]: pgmap v314: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-16T01:12:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.689+0000 7f732d0e6640 1 -- 172.21.15.17:0/3236177158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 msgr2=0x7f7328100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 --2- 172.21.15.17:0/3236177158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328100c80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7318009900 tx=0x7f731802a410 comp rx=0 tx=0).stop 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 -- 172.21.15.17:0/3236177158 shutdown_connections 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 --2- 172.21.15.17:0/3236177158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73281080f0 0x7f732810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 --2- 172.21.15.17:0/3236177158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7328101250 0x7f7328107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 --2- 172.21.15.17:0/3236177158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328100c80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 -- 172.21.15.17:0/3236177158 >> 172.21.15.17:0/3236177158 conn(0x7f7328075ef0 msgr2=0x7f7328076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 -- 172.21.15.17:0/3236177158 shutdown_connections 2024-09-16T01:12:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 -- 172.21.15.17:0/3236177158 wait complete. 2024-09-16T01:12:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.690+0000 7f732d0e6640 1 Processor -- start 2024-09-16T01:12:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 -- start start 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73281080f0 0x7f7328198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732819cad0 0x7f732819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7328111e20 con 0x7f73281008a0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7328111ca0 con 0x7f73281080f0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732d0e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7328111fa0 con 0x7f732819cad0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57666/0 (socket says 172.21.15.17:57666) 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f7326d9d640 1 -- 172.21.15.17:0/4045818367 learned_addr learned my addr 172.21.15.17:0/4045818367 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732759e640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732819cad0 0x7f732819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f732659c640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73281080f0 0x7f7328198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f7326d9d640 1 -- 172.21.15.17:0/4045818367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732819cad0 msgr2=0x7f732819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.691+0000 7f7326d9d640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732819cad0 0x7f732819cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f7326d9d640 1 -- 172.21.15.17:0/4045818367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73281080f0 msgr2=0x7f7328198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f7326d9d640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73281080f0 0x7f7328198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f7326d9d640 1 -- 172.21.15.17:0/4045818367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732819d5c0 con 0x7f73281008a0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f7326d9d640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7318005ab0 tx=0x7f7318003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f730ffff640 1 -- 172.21.15.17:0/4045818367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731803f070 con 0x7f73281008a0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f730ffff640 1 -- 172.21.15.17:0/4045818367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7318031d60 con 0x7f73281008a0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732819d850 con 0x7f73281008a0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f730ffff640 1 -- 172.21.15.17:0/4045818367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318035030 con 0x7f73281008a0 2024-09-16T01:12:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.692+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a5070 con 0x7f73281008a0 2024-09-16T01:12:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f730ffff640 1 -- 172.21.15.17:0/4045818367 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7318042070 con 0x7f73281008a0 2024-09-16T01:12:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 Processor -- start 2024-09-16T01:12:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 -- start start 2024-09-16T01:12:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f692d0 0x55a615f77b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a615ecd2f0 con 0x55a615f780c0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a615e75270 con 0x55a615f689b0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f732fe77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a615ec92b0 con 0x55a615f692d0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.695+0000 7f730ffff640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 0x7f73100a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.17:34212/0 (socket says 172.21.15.17:34212) 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 -- 172.21.15.17:0/741900601 learned_addr learned my addr 172.21.15.17:0/741900601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 0x7f73100a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f730ffff640 1 -- 172.21.15.17:0/4045818367 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f73180f0430 con 0x7f73281008a0 2024-09-16T01:12:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f7326d9d640 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f692d0 0x55a615f77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 -- 172.21.15.17:0/741900601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f692d0 msgr2=0x55a615f77b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f692d0 0x55a615f77b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 -- 172.21.15.17:0/741900601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 msgr2=0x55a615f7a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 -- 172.21.15.17:0/741900601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a615e74340 con 0x55a615f689b0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732659c640 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 0x7f73100a59a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7320010c40 tx=0x7f732000c000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.696+0000 7f732759e640 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7320012d80 tx=0x7f7320010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740b607eddaca0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f730d7fa640 1 -- 172.21.15.17:0/741900601 <== mon.2 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320024070 con 0x55a615f689b0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f730d7fa640 1 -- 172.21.15.17:0/741900601 <== mon.2 v2:172.21.15.88:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73200125a0 con 0x55a615f689b0 2024-09-16T01:12:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f730d7fa640 1 -- 172.21.15.17:0/741900601 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320005220 con 0x55a615f689b0 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 -- 172.21.15.17:0/741900601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 msgr2=0x55a615f68d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7320012d80 tx=0x7f7320010740 comp rx=0 tx=0).stop 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 -- 172.21.15.17:0/741900601 shutdown_connections 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f692d0 0x55a615f77b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 --2- 172.21.15.17:0/741900601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f689b0 0x55a615f68d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 -- 172.21.15.17:0/741900601 >> 172.21.15.17:0/741900601 conn(0x55a615f65060 msgr2=0x55a615f65440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 -- 172.21.15.17:0/741900601 shutdown_connections 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.697+0000 7f732fe77740 1 -- 172.21.15.17:0/741900601 wait complete. 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 -- start start 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 Processor -- start 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f780c0 0x55a615f75b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a615f7ac30 con 0x55a615f689b0 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55a615e56290 con 0x55a615f692d0 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a615f7adb0 con 0x55a615f780c0 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732fe77740 10 client.0 _ll_register_callbacks cb 0x55a615e87140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f7326d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57694/0 (socket says 172.21.15.17:57694) 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f7326d9d640 1 -- 172.21.15.17:0/1883916929 learned_addr learned my addr 172.21.15.17:0/1883916929 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.698+0000 7f732759e640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f780c0 0x55a615f75b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 -- 172.21.15.17:0/1883916929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f780c0 msgr2=0x55a615f75b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f780c0 0x55a615f75b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 -- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 msgr2=0x55a615f75600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f75600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 -- 172.21.15.17:0/1883916929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a615be0210 con 0x55a615f689b0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f732659c640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f7326d9d640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f73180b8bd0 tx=0x7f7318031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfc2ec0acd61c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f730aff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318049070 con 0x55a615f689b0 2024-09-16T01:12:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f731803b560 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73200125a0 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73180bc7c0 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f732fe77740 10 client.16161 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a615cac620 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.699+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73200125a0 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73180bca20 con 0x55a615f689b0 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 10 client.16161 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 20 client.16161 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615f88100 0x55a615f8a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 4 client.16161 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a615edaa20 con 0x55a615f88100 2024-09-16T01:12:30.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.700+0000 7f732659c640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615f88100 0x55a615f8a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f730aff5640 10 client.16161 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732659c640 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615f88100 0x55a615f8a530 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6cef0c69d0cf90 server_cookie=779667250843829b in_seq=0 out_seq=0 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f730aff5640 1 -- 172.21.15.17:0/1883916929 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a615edaa20 con 0x55a615f88100 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f730aff5640 10 client.16161 handle_command_reply: tid=0 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 client.16161 shutdown 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 msgr2=0x55a615f750c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f73180b8bd0 tx=0x7f7318031400 comp rx=0 tx=0).stop 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 shutdown_connections 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615f88100 0x55a615f8a530 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f780c0 0x55a615f75b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f730aff5640 0 client.16161 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:30.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f75600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 --2- 172.21.15.17:0/1883916929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f689b0 0x55a615f750c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.701+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 >> 172.21.15.17:0/1883916929 conn(0x55a615f65060 msgr2=0x55a615f6adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.702+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 shutdown_connections 2024-09-16T01:12:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.702+0000 7f732fe77740 1 -- 172.21.15.17:0/1883916929 wait complete. 2024-09-16T01:12:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.702+0000 7f732fe77740 20 client.16161 trim_cache size 0 max 16384 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 Processor -- start 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 -- start start 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f8fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ab4e0 con 0x55a615f780c0 2024-09-16T01:12:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ad020 con 0x55a615f692d0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732fe77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73281abbb0 con 0x55a615f689b0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57700/0 (socket says 172.21.15.17:57700) 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 -- 172.21.15.17:0/2250513660 learned_addr learned my addr 172.21.15.17:0/2250513660 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f7326d9d640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732659c640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f8fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 -- 172.21.15.17:0/2250513660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 msgr2=0x55a615f640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 -- 172.21.15.17:0/2250513660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 msgr2=0x55a615f8fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f8fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732759e640 1 -- 172.21.15.17:0/2250513660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a615f69100 con 0x55a615f780c0 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.717+0000 7f732659c640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f732759e640 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7320009df0 tx=0x7f7320009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e072a5a70bec0fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f730cff9640 1 -- 172.21.15.17:0/2250513660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732001b040 con 0x55a615f780c0 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f730cff9640 1 -- 172.21.15.17:0/2250513660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7320012890 con 0x55a615f780c0 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f730cff9640 1 -- 172.21.15.17:0/2250513660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320024040 con 0x55a615f780c0 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f732fe77740 1 -- 172.21.15.17:0/2250513660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 msgr2=0x55a615f90380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.718+0000 7f732fe77740 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7320009df0 tx=0x7f7320009400 comp rx=0 tx=0).stop 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- 172.21.15.17:0/2250513660 shutdown_connections 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f90380 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- 172.21.15.17:0/2250513660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- 172.21.15.17:0/2250513660 >> 172.21.15.17:0/2250513660 conn(0x55a615f65060 msgr2=0x55a615f639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- 172.21.15.17:0/2250513660 shutdown_connections 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- 172.21.15.17:0/2250513660 wait complete. 2024-09-16T01:12:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- start start 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 Processor -- start 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f7b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ac950 con 0x55a615f780c0 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f73281ac280 con 0x55a615f692d0 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73281a94c0 con 0x55a615f689b0 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732fe77740 10 client.0 _ll_register_callbacks cb 0x7f7318003e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57710/0 (socket says 172.21.15.17:57710) 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.719+0000 7f732759e640 1 -- 172.21.15.17:0/3987801798 learned_addr learned my addr 172.21.15.17:0/3987801798 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f7326d9d640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732659c640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f7b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 -- 172.21.15.17:0/3987801798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 msgr2=0x55a615f805c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f805c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 -- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 msgr2=0x55a615f7b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f7b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 -- 172.21.15.17:0/3987801798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a615f7c460 con 0x55a615f780c0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f7326d9d640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732659c640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f7b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732759e640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7320009dc0 tx=0x7f732000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd66cfc65c47a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f730aff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320036070 con 0x55a615f780c0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7320012890 con 0x55a615f780c0 2024-09-16T01:12:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f7320004a00 con 0x55a615f780c0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7320024070 con 0x55a615f780c0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732fe77740 10 client.16167 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.720+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a615ff2c50 con 0x55a615f780c0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7320012890 con 0x55a615f780c0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f732000f040 con 0x55a615f780c0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 20 client.16167 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615ff3130 0x55a615ff5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 4 client.16167 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a615ed4d70 con 0x55a615ff3130 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f7326d9d640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615ff3130 0x55a615ff5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f730aff5640 10 client.16167 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.721+0000 7f7326d9d640 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615ff3130 0x55a615ff5520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eae54a83bb6c9797 server_cookie=d364e2573aff9d1f in_seq=0 out_seq=0 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f730aff5640 1 -- 172.21.15.17:0/3987801798 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a615ed4d70 con 0x55a615ff3130 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f730aff5640 10 client.16167 handle_command_reply: tid=0 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 client.16167 shutdown 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 msgr2=0x55a615f7be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7320009dc0 tx=0x7f732000cdf0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 shutdown_connections 2024-09-16T01:12:30.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55a615ff3130 0x55a615ff5520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a615f780c0 0x55a615f7be20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f730aff5640 0 client.16167 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a615f692d0 0x55a615f7b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 --2- 172.21.15.17:0/3987801798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a615f689b0 0x55a615f805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 >> 172.21.15.17:0/3987801798 conn(0x55a615f65060 msgr2=0x55a615f641c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 shutdown_connections 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 1 -- 172.21.15.17:0/3987801798 wait complete. 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.736+0000 7f732fe77740 20 client.16167 trim_cache size 0 max 16384 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:12:30.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:12:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:12:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:12:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 msgr2=0x7f73100a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 0x7f73100a59a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7320010c40 tx=0x7f732000c000 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 msgr2=0x7f7328198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7318005ab0 tx=0x7f7318003c80 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 shutdown_connections 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f73100a34e0 0x7f73100a59a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732819cad0 0x7f732819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73281080f0 0x7f7328198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 --2- 172.21.15.17:0/4045818367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73281008a0 0x7f7328198210 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 >> 172.21.15.17:0/4045818367 conn(0x7f7328075ef0 msgr2=0x7f73280ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 shutdown_connections 2024-09-16T01:12:30.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:30.737+0000 7f732d0e6640 1 -- 172.21.15.17:0/4045818367 wait complete. 2024-09-16T01:12:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:31 smithi088 ceph-mon[34093]: pgmap v315: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:31 smithi154 ceph-mon[34759]: pgmap v315: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:31.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:31 smithi017 ceph-mon[31211]: pgmap v315: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:33.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:33 smithi088 ceph-mon[34093]: pgmap v316: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:33.533 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:33 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:12:33.633 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:33 smithi154 ceph-mon[34759]: pgmap v316: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:33.633 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:33 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:12:33.649 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:33 smithi017 ceph-mon[31211]: pgmap v316: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-16T01:12:33.649 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:33 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.645 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.648 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.649 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.650 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:12:35.650 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:12:35.650 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:12:35.650 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:12:35.650 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:12:35.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:12:35.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:12:35.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:12:35.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi088 to 176.0M 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi154 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-16T01:12:35.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi088 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: Unable to set osd_memory_target on smithi017 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:12:35.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:12:37.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:37 smithi088 ceph-mon[34093]: pgmap v318: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:12:37.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:37 smithi154 ceph-mon[34759]: pgmap v318: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:12:37.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:37 smithi017 ceph-mon[31211]: pgmap v318: 97 pgs: 97 active+clean; 3.2 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-16T01:12:39.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:39 smithi088 ceph-mon[34093]: pgmap v319: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:39.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:39 smithi154 ceph-mon[34759]: pgmap v319: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:39 smithi017 ceph-mon[31211]: pgmap v319: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-16T01:12:41.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:41 smithi088 ceph-mon[34093]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:41.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:41 smithi154 ceph-mon[34759]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:41.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:41 smithi017 ceph-mon[31211]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:43.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:43 smithi088 ceph-mon[34093]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:43.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:43 smithi154 ceph-mon[34759]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:43.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:43 smithi017 ceph-mon[31211]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.836+0000 7fac862af640 1 -- 172.21.15.17:0/3203579356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100630 msgr2=0x7fac80100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.836+0000 7fac862af640 1 --2- 172.21.15.17:0/3203579356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100630 0x7fac80100a90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fac74009930 tx=0x7fac7402a420 comp rx=0 tx=0).stop 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.836+0000 7fac862af640 1 -- 172.21.15.17:0/3203579356 shutdown_connections 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.836+0000 7fac862af640 1 --2- 172.21.15.17:0/3203579356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100fd0 0x7fac8010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.836+0000 7fac862af640 1 --2- 172.21.15.17:0/3203579356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100630 0x7fac80100a90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 --2- 172.21.15.17:0/3203579356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac80106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 -- 172.21.15.17:0/3203579356 >> 172.21.15.17:0/3203579356 conn(0x7fac80075ef0 msgr2=0x7fac80076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 -- 172.21.15.17:0/3203579356 shutdown_connections 2024-09-16T01:12:43.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 -- 172.21.15.17:0/3203579356 wait complete. 2024-09-16T01:12:43.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 Processor -- start 2024-09-16T01:12:43.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.837+0000 7fac862af640 1 -- start start 2024-09-16T01:12:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100630 0x7fac80197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac8019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac80110cf0 con 0x7fac80100fd0 2024-09-16T01:12:43.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fac80110b70 con 0x7fac80100630 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac862af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac80110e70 con 0x7fac80106220 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54346/0 (socket says 172.21.15.17:54346) 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2867465375 learned_addr learned my addr 172.21.15.17:0/2867465375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac8484c640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac8019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7ffff640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100630 0x7fac80197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2867465375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 msgr2=0x7fac8019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac8019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2867465375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100630 msgr2=0x7fac80197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100630 0x7fac80197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2867465375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8019c200 con 0x7fac80100fd0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac8484c640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac8019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.838+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac74005940 tx=0x7fac740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.839+0000 7fac7d7fa640 1 -- 172.21.15.17:0/2867465375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7403f030 con 0x7fac80100fd0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.839+0000 7fac7d7fa640 1 -- 172.21.15.17:0/2867465375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac740318a0 con 0x7fac80100fd0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.839+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8019c490 con 0x7fac80100fd0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.839+0000 7fac7d7fa640 1 -- 172.21.15.17:0/2867465375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74035070 con 0x7fac80100fd0 2024-09-16T01:12:43.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.839+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801a3d80 con 0x7fac80100fd0 2024-09-16T01:12:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.841+0000 7fac7d7fa640 1 -- 172.21.15.17:0/2867465375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fac74042030 con 0x7fac80100fd0 2024-09-16T01:12:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 Processor -- start 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 -- start start 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8502610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8511180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5604b84642f0 con 0x5604b8503360 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5604b840c270 con 0x5604b850ed70 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac89042740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604b84602b0 con 0x5604b85021b0 2024-09-16T01:12:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54352/0 (socket says 172.21.15.17:54352) 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 -- 172.21.15.17:0/540242466 learned_addr learned my addr 172.21.15.17:0/540242466 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8511180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac7d7fa640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 0x7fac680a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac7ffff640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8502610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 -- 172.21.15.17:0/540242466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 msgr2=0x5604b8502610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8502610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 -- 172.21.15.17:0/540242466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 msgr2=0x5604b8511180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8511180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac8484c640 1 -- 172.21.15.17:0/540242466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b840b340 con 0x5604b8503360 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.842+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8511180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac7d7fa640 1 -- 172.21.15.17:0/2867465375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fac740f0550 con 0x7fac80100fd0 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac8484c640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 0x7fac680a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac8484c640 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac7800f530 tx=0x7fac7800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e424652b924e3d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac667fc640 1 -- 172.21.15.17:0/540242466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7801c400 con 0x5604b8503360 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac667fc640 1 -- 172.21.15.17:0/540242466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac7801ca50 con 0x5604b8503360 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.843+0000 7fac667fc640 1 -- 172.21.15.17:0/540242466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7800d7a0 con 0x5604b8503360 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- 172.21.15.17:0/540242466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 msgr2=0x5604b8501be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fac7800f530 tx=0x7fac7800f9f0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac8484c640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 0x7fac680a5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac78020000 tx=0x7fac7801d000 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- 172.21.15.17:0/540242466 shutdown_connections 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8511180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8502610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 --2- 172.21.15.17:0/540242466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b8501be0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- 172.21.15.17:0/540242466 >> 172.21.15.17:0/540242466 conn(0x5604b84fe270 msgr2=0x5604b84fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- 172.21.15.17:0/540242466 shutdown_connections 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- 172.21.15.17:0/540242466 wait complete. 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 -- start start 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.844+0000 7fac89042740 1 Processor -- start 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b85021b0 0x5604b850bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b850c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5604b8511ca0 con 0x5604b850ed70 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5604b83ed290 con 0x5604b85021b0 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604b8511e20 con 0x5604b8503360 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac89042740 10 client.0 _ll_register_callbacks cb 0x5604b841e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54368/0 (socket says 172.21.15.17:54368) 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 -- 172.21.15.17:0/3881238850 learned_addr learned my addr 172.21.15.17:0/3881238850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b850c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b85021b0 0x5604b850bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 -- 172.21.15.17:0/3881238850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 msgr2=0x5604b850c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b850c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 -- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b85021b0 msgr2=0x5604b850bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b85021b0 0x5604b850bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 -- 172.21.15.17:0/3881238850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b8177210 con 0x5604b850ed70 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac8484c640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fac78012640 tx=0x7fac7801ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960ce849fab8632 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.845+0000 7fac5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7800d770 con 0x5604b850ed70 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac7801ca50 con 0x5604b850ed70 2024-09-16T01:12:43.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fac7800dac0 con 0x5604b850ed70 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac7803c050 con 0x5604b850ed70 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 10 client.16179 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604b8243620 con 0x5604b850ed70 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac7801ca50 con 0x5604b850ed70 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac78037030 con 0x5604b850ed70 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 10 client.16179 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 20 client.16179 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b851f050 0x5604b8521440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 4 client.16179 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:12:43.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.846+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b8471a20 con 0x5604b851f050 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.847+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b851f050 0x5604b8521440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.847+0000 7fac7ffff640 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b851f050 0x5604b8521440 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fa589dc3bc8fe server_cookie=d5f466a1e92e802 in_seq=0 out_seq=0 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.847+0000 7fac5f7fe640 10 client.16179 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac5f7fe640 1 -- 172.21.15.17:0/3881238850 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604b8471a20 con 0x5604b851f050 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac5f7fe640 10 client.16179 handle_command_reply: tid=0 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 client.16179 shutdown 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 msgr2=0x5604b850c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fac78012640 tx=0x7fac7801ce30 comp rx=0 tx=0).stop 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 shutdown_connections 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b851f050 0x5604b8521440 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b850ed70 0x5604b850c7b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b850c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 --2- 172.21.15.17:0/3881238850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b85021b0 0x5604b850bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac5f7fe640 0 client.16179 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 >> 172.21.15.17:0/3881238850 conn(0x5604b84fe270 msgr2=0x5604b8503fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 shutdown_connections 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 1 -- 172.21.15.17:0/3881238850 wait complete. 2024-09-16T01:12:43.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.848+0000 7fac89042740 20 client.16179 trim_cache size 0 max 16384 2024-09-16T01:12:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 Processor -- start 2024-09-16T01:12:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 -- start start 2024-09-16T01:12:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b8526bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b85270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ab560 con 0x5604b85021b0 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ad0a0 con 0x5604b850ed70 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac89042740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac801abc30 con 0x5604b8503360 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54372/0 (socket says 172.21.15.17:54372) 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac7ffff640 1 -- 172.21.15.17:0/1461244696 learned_addr learned my addr 172.21.15.17:0/1461244696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.863+0000 7fac8484c640 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b85270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 -- 172.21.15.17:0/1461244696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 msgr2=0x5604b8526bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b8526bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 -- 172.21.15.17:0/1461244696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 msgr2=0x5604b85270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b85270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 -- 172.21.15.17:0/1461244696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b851af70 con 0x5604b85021b0 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac7ffff640 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fac70004700 tx=0x7fac70004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bc7fe135eec689 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac65ffb640 1 -- 172.21.15.17:0/1461244696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70003de0 con 0x5604b85021b0 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac65ffb640 1 -- 172.21.15.17:0/1461244696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac7001e8d0 con 0x5604b85021b0 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.864+0000 7fac65ffb640 1 -- 172.21.15.17:0/1461244696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70012a00 con 0x5604b85021b0 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- 172.21.15.17:0/1461244696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 msgr2=0x5604b84fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fac70004700 tx=0x7fac70004410 comp rx=0 tx=0).stop 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- 172.21.15.17:0/1461244696 shutdown_connections 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b85270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b8503360 0x5604b8526bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- 172.21.15.17:0/1461244696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b85021b0 0x5604b84fd3f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- 172.21.15.17:0/1461244696 >> 172.21.15.17:0/1461244696 conn(0x5604b84fe270 msgr2=0x5604b84fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- 172.21.15.17:0/1461244696 shutdown_connections 2024-09-16T01:12:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- 172.21.15.17:0/1461244696 wait complete. 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- start start 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 Processor -- start 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8517930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8514680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ac9d0 con 0x5604b8503360 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fac801ac300 con 0x5604b850ed70 2024-09-16T01:12:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.865+0000 7fac89042740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac801a9560 con 0x5604b85021b0 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac89042740 10 client.0 _ll_register_callbacks cb 0x7fac7801f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54378/0 (socket says 172.21.15.17:54378) 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2228285146 learned_addr learned my addr 172.21.15.17:0/2228285146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7ffff640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8517930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac8484c640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8514680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2228285146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 msgr2=0x5604b8517930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8517930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 msgr2=0x5604b8514680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8514680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 -- 172.21.15.17:0/2228285146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b8514eb0 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac8484c640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8514680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac7f7fe640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fac740bc7c0 tx=0x7fac740bc600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9517242bf4365a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74049030 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fac740bca90 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac7001e8d0 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac740044e0 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac89042740 10 client.16185 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.866+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604b858aca0 con 0x5604b8503360 2024-09-16T01:12:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac7001e8d0 con 0x5604b8503360 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac740c5010 con 0x5604b8503360 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 10 client.16185 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 20 client.16185 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b858b420 0x5604b858d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 4 client.16185 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604b846bd70 con 0x5604b858b420 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.867+0000 7fac7ffff640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b858b420 0x5604b858d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.868+0000 7fac7ffff640 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b858b420 0x5604b858d840 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842f6137f4741552 server_cookie=713a329f02bbbb59 in_seq=0 out_seq=0 2024-09-16T01:12:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.868+0000 7fac5f7fe640 10 client.16185 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac5f7fe640 1 -- 172.21.15.17:0/2228285146 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604b846bd70 con 0x5604b858b420 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac5f7fe640 10 client.16185 handle_command_reply: tid=0 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 client.16185 shutdown 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 msgr2=0x5604b85140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fac740bc7c0 tx=0x7fac740bc600 comp rx=0 tx=0).stop 2024-09-16T01:12:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 shutdown_connections 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5604b858b420 0x5604b858d840 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5604b850ed70 0x5604b8514680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac5f7fe640 0 client.16185 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604b8503360 0x5604b85140b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 --2- 172.21.15.17:0/2228285146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604b85021b0 0x5604b8517930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 >> 172.21.15.17:0/2228285146 conn(0x5604b84fe270 msgr2=0x5604b84fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 shutdown_connections 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.882+0000 7fac89042740 1 -- 172.21.15.17:0/2228285146 wait complete. 2024-09-16T01:12:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac89042740 20 client.16185 trim_cache size 0 max 16384 2024-09-16T01:12:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:12:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:12:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:12:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 msgr2=0x7fac680a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 0x7fac680a5920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac78020000 tx=0x7fac7801d000 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 msgr2=0x7fac80197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fac74005940 tx=0x7fac740042f0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 shutdown_connections 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fac680a3460 0x7fac680a5920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac80106220 0x7fac8019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac80100fd0 0x7fac80197750 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 --2- 172.21.15.17:0/2867465375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac80100630 0x7fac80197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 >> 172.21.15.17:0/2867465375 conn(0x7fac80075ef0 msgr2=0x7fac800ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:43.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 shutdown_connections 2024-09-16T01:12:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:43.883+0000 7fac862af640 1 -- 172.21.15.17:0/2867465375 wait complete. 2024-09-16T01:12:45.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:45 smithi088 ceph-mon[34093]: pgmap v322: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:45.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:45 smithi154 ceph-mon[34759]: pgmap v322: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:45.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:45 smithi017 ceph-mon[31211]: pgmap v322: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:47.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:47 smithi088 ceph-mon[34093]: pgmap v323: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:12:47.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:47 smithi154 ceph-mon[34759]: pgmap v323: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:12:47.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:47 smithi017 ceph-mon[31211]: pgmap v323: 97 pgs: 97 active+clean; 3.5 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-16T01:12:49.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:49 smithi088 ceph-mon[34093]: pgmap v324: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:49.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:49 smithi154 ceph-mon[34759]: pgmap v324: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:49.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:49 smithi017 ceph-mon[31211]: pgmap v324: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:50.309 INFO:tasks.workunit.client.0.smithi017.stdout:499/600: open fd = 3 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:500/600: open fd = 3 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:501/600: open fd = 3 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:502/600: open fd = 3 2024-09-16T01:12:50.310 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:503/600: open fd = 3 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:504/600: open fd = 3 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:505/600: open fd = 3 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.311 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:506/600: open fd = 3 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:507/600: open fd = 3 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.312 INFO:tasks.workunit.client.0.smithi017.stdout:508/600: open fd = 3 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:509/600: open fd = 3 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:510/600: open fd = 3 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:511/600: open fd = 3 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.313 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:512/600: open fd = 3 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:513/600: open fd = 3 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:514/600: open fd = 3 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.314 INFO:tasks.workunit.client.0.smithi017.stdout:515/600: open fd = 3 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:516/600: open fd = 3 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:517/600: open fd = 3 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.315 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:518/600: open fd = 3 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:519/600: open fd = 3 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:520/600: open fd = 3 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.316 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:521/600: open fd = 3 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:522/600: open fd = 3 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:523/600: open fd = 3 2024-09-16T01:12:50.317 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:524/600: open fd = 3 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:525/600: open fd = 3 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:526/600: open fd = 3 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.318 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:527/600: open fd = 3 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:528/600: open fd = 3 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:529/600: open fd = 3 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.319 INFO:tasks.workunit.client.0.smithi017.stdout:530/600: open fd = 3 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:531/600: open fd = 3 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:532/600: open fd = 3 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:533/600: open fd = 3 2024-09-16T01:12:50.320 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:534/600: open fd = 3 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:535/600: open fd = 3 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:536/600: open fd = 3 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.321 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:537/600: open fd = 3 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:538/600: open fd = 3 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:539/600: open fd = 3 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.322 INFO:tasks.workunit.client.0.smithi017.stdout:540/600: open fd = 3 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:541/600: open fd = 3 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:542/600: open fd = 3 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:543/600: open fd = 3 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.323 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:544/600: open fd = 3 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:545/600: open fd = 3 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:546/600: open fd = 3 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.324 INFO:tasks.workunit.client.0.smithi017.stdout:547/600: open fd = 3 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:548/600: open fd = 3 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:549/600: open fd = 3 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:550/600: open fd = 3 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.325 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:551/600: open fd = 3 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:552/600: open fd = 3 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.326 INFO:tasks.workunit.client.0.smithi017.stdout:553/600: open fd = 3 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:554/600: open fd = 3 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:555/600: open fd = 3 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:556/600: open fd = 3 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.327 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:557/600: open fd = 3 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:558/600: open fd = 3 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:559/600: open fd = 3 2024-09-16T01:12:50.328 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:560/600: open fd = 3 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:12:50.329 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:12:51.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:51 smithi088 ceph-mon[34093]: pgmap v325: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:51.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:51 smithi154 ceph-mon[34759]: pgmap v325: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:51.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:51 smithi017 ceph-mon[31211]: pgmap v325: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:53.403 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:53 smithi154 ceph-mon[34759]: pgmap v326: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:53.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:53 smithi017 ceph-mon[31211]: pgmap v326: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:53.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:53 smithi088 ceph-mon[34093]: pgmap v326: 97 pgs: 97 active+clean; 3.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:12:55.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:55 smithi088 ceph-mon[34093]: pgmap v327: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:55.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:55 smithi154 ceph-mon[34759]: pgmap v327: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:55.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:55 smithi017 ceph-mon[31211]: pgmap v327: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 -- 172.21.15.17:0/2347072600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 msgr2=0x7f30a410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/2347072600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a410baa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3098009900 tx=0x7f309802a410 comp rx=0 tx=0).stop 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 -- 172.21.15.17:0/2347072600 shutdown_connections 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/2347072600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 0x7f30a410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/2347072600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a410baa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/2347072600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 0x7f30a4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 -- 172.21.15.17:0/2347072600 >> 172.21.15.17:0/2347072600 conn(0x7f30a40fc6f0 msgr2=0x7f30a40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 -- 172.21.15.17:0/2347072600 shutdown_connections 2024-09-16T01:12:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.984+0000 7f30a8b9f640 1 -- 172.21.15.17:0/2347072600 wait complete. 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 Processor -- start 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 -- start start 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 0x7f30a41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 0x7f30a419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30a4111d70 con 0x7f30a41035c0 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f30a4111bf0 con 0x7f30a4102c10 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a8b9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30a4111ef0 con 0x7f30a410c110 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38196/0 (socket says 172.21.15.17:38196) 2024-09-16T01:12:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a1d9b640 1 -- 172.21.15.17:0/1871141973 learned_addr learned my addr 172.21.15.17:0/1871141973 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.985+0000 7f30a259c640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 0x7f30a41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 0x7f30a419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 -- 172.21.15.17:0/1871141973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 msgr2=0x7f30a419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 0x7f30a419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 -- 172.21.15.17:0/1871141973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 msgr2=0x7f30a41982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 0x7f30a41982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 -- 172.21.15.17:0/1871141973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a419d2d0 con 0x7f30a41035c0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3098005940 tx=0x7f3098004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30937fe640 1 -- 172.21.15.17:0/1871141973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309803f030 con 0x7f30a41035c0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30937fe640 1 -- 172.21.15.17:0/1871141973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3098003aa0 con 0x7f30a41035c0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a419d560 con 0x7f30a41035c0 2024-09-16T01:12:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30937fe640 1 -- 172.21.15.17:0/1871141973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098035070 con 0x7f30a41035c0 2024-09-16T01:12:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.986+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a41a4e50 con 0x7f30a41035c0 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.989+0000 7f30937fe640 1 -- 172.21.15.17:0/1871141973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3098042030 con 0x7f30a41035c0 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.989+0000 7f30aba16740 1 Processor -- start 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 -- start start 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bedded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586beeb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55586be422f0 con 0x55586bede410 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55586bdea270 con 0x55586beddaf0 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30aba16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55586be3e2b0 con 0x55586bee8cb0 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38206/0 (socket says 172.21.15.17:38206) 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 -- 172.21.15.17:0/3963947291 learned_addr learned my addr 172.21.15.17:0/3963947291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586beeb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bedded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30937fe640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 0x7f308c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 -- 172.21.15.17:0/3963947291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 msgr2=0x55586beeb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586beeb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 -- 172.21.15.17:0/3963947291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 msgr2=0x55586bedded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.990+0000 7f30a259c640 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bedded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f30a259c640 1 -- 172.21.15.17:0/3963947291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55586bde9340 con 0x55586bede410 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 0x7f308c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f30937fe640 1 -- 172.21.15.17:0/1871141973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f30980f0450 con 0x7f30a41035c0 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f30a259c640 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f309400bd10 tx=0x7f30940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86423b5ab386cceb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f3090ff9640 1 -- 172.21.15.17:0/3963947291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094004030 con 0x55586bede410 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f3090ff9640 1 -- 172.21.15.17:0/3963947291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30940035f0 con 0x55586bede410 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.991+0000 7f3090ff9640 1 -- 172.21.15.17:0/3963947291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094011750 con 0x55586bede410 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- 172.21.15.17:0/3963947291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 msgr2=0x55586bee8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f309400bd10 tx=0x7f30940107a0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 0x7f308c0a59a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f309c008d40 tx=0x7f309c004a40 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- 172.21.15.17:0/3963947291 shutdown_connections 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586beeb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bee8770 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 --2- 172.21.15.17:0/3963947291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bedded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- 172.21.15.17:0/3963947291 >> 172.21.15.17:0/3963947291 conn(0x55586beda060 msgr2=0x55586beda440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:56.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- 172.21.15.17:0/3963947291 shutdown_connections 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- 172.21.15.17:0/3963947291 wait complete. 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 -- start start 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.992+0000 7f30aba16740 1 Processor -- start 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bede410 0x55586bee6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 0x55586bee65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55586beeb880 con 0x55586beddaf0 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55586bdcb290 con 0x55586bee8cb0 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55586beeba00 con 0x55586bede410 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30aba16740 10 client.0 _ll_register_callbacks cb 0x55586bdfc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38212/0 (socket says 172.21.15.17:38212) 2024-09-16T01:12:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 -- 172.21.15.17:0/3583131423 learned_addr learned my addr 172.21.15.17:0/3583131423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bede410 0x55586bee6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 0x55586bee65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 -- 172.21.15.17:0/3583131423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bede410 msgr2=0x55586bee6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bede410 0x55586bee6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 -- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 msgr2=0x55586bee65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 0x55586bee65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 -- 172.21.15.17:0/3583131423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55586bb55210 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 0x55586bee65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f30a259c640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3094005910 tx=0x7f30940037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d407f21a5b32f524 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f3089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.993+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094029060 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f3094003b20 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30940035f0 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3094004000 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 10 client.16197 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55586bc21620 con 0x55586beddaf0 2024-09-16T01:12:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30940035f0 con 0x55586beddaf0 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30940047e0 con 0x55586beddaf0 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 20 client.16197 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bef8b20 0x55586befaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 4 client.16197 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55586be4fa20 con 0x55586bef8b20 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.994+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bef8b20 0x55586befaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.995+0000 7f3089ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:57.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.995+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bef8b20 0x55586befaf10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27dcb5d976db898f server_cookie=2b5a0cf89cab9919 in_seq=0 out_seq=0 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f3089ffb640 1 -- 172.21.15.17:0/3583131423 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55586be4fa20 con 0x55586bef8b20 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f3089ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 client.16197 shutdown 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 msgr2=0x55586bee5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3094005910 tx=0x7f30940037a0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 shutdown_connections 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bef8b20 0x55586befaf10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586bee8cb0 0x55586bee65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f3089ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bede410 0x55586bee6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 --2- 172.21.15.17:0/3583131423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586beddaf0 0x55586bee5b20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 >> 172.21.15.17:0/3583131423 conn(0x55586beda060 msgr2=0x55586bedfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 shutdown_connections 2024-09-16T01:12:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 1 -- 172.21.15.17:0/3583131423 wait complete. 2024-09-16T01:12:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:56.996+0000 7f30aba16740 20 client.16197 trim_cache size 0 max 16384 2024-09-16T01:12:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.010+0000 7f30aba16740 1 Processor -- start 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 -- start start 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bee63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586befe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41ad720 con 0x55586bede410 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41af260 con 0x55586beddaf0 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30aba16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41addf0 con 0x55586bee8cb0 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38224/0 (socket says 172.21.15.17:38224) 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 -- 172.21.15.17:0/163739036 learned_addr learned my addr 172.21.15.17:0/163739036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a259c640 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bee63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 -- 172.21.15.17:0/163739036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 msgr2=0x55586befe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586befe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 -- 172.21.15.17:0/163739036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 msgr2=0x55586bee63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bee63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 -- 172.21.15.17:0/163739036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55586bed9e90 con 0x55586bede410 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a259c640 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bee63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3098031440 tx=0x7f30980f2960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f661e6d752f1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.011+0000 7f308bfff640 1 -- 172.21.15.17:0/163739036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098049040 con 0x55586bede410 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f308bfff640 1 -- 172.21.15.17:0/163739036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30980bce30 con 0x55586bede410 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f308bfff640 1 -- 172.21.15.17:0/163739036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098003c50 con 0x55586bede410 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- 172.21.15.17:0/163739036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 msgr2=0x55586befe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3098031440 tx=0x7f30980f2960 comp rx=0 tx=0).stop 2024-09-16T01:12:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- 172.21.15.17:0/163739036 shutdown_connections 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586befe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586befe320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 --2- 172.21.15.17:0/163739036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bee63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- 172.21.15.17:0/163739036 >> 172.21.15.17:0/163739036 conn(0x55586beda060 msgr2=0x55586bee7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- 172.21.15.17:0/163739036 shutdown_connections 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- 172.21.15.17:0/163739036 wait complete. 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.012+0000 7f30aba16740 1 -- start start 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 Processor -- start 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bf5a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586bf5eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41aeb90 con 0x55586bede410 2024-09-16T01:12:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41ae4c0 con 0x55586beddaf0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30a41ab720 con 0x55586bee8cb0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30aba16740 10 client.0 _ll_register_callbacks cb 0x7f309400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38236/0 (socket says 172.21.15.17:38236) 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 -- 172.21.15.17:0/2641007509 learned_addr learned my addr 172.21.15.17:0/2641007509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a259c640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bf5a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586bf5eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 -- 172.21.15.17:0/2641007509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 msgr2=0x55586bf5eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586bf5eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 -- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 msgr2=0x55586bf5a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bf5a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 -- 172.21.15.17:0/2641007509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55586bf5f140 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a2d9d640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586bf5eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f30a1d9b640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f30980ee1a0 tx=0x7f30980c0b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3391cc4883ea9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.013+0000 7f3089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980d4030 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f30980baa30 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30980bce30 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3098049070 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 10 client.16203 fetch_fsmap learned FSMap version 28 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55586bf67670 con 0x55586bede410 2024-09-16T01:12:57.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30980bce30 con 0x55586bede410 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f30980ef040 con 0x55586bede410 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 10 client.16203 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 20 client.16203 populate_metadata read hostname 'smithi017' 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bf67dc0 0x55586bf6a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 4 client.16203 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55586be49d70 con 0x55586bf67dc0 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.014+0000 7f30a259c640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bf67dc0 0x55586bf6a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.015+0000 7f3089ffb640 10 client.16203 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:57.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.015+0000 7f30a259c640 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bf67dc0 0x55586bf6a1e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=378e1359c2f9624d server_cookie=f728e07a5cb36292 in_seq=0 out_seq=0 2024-09-16T01:12:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f3089ffb640 1 -- 172.21.15.17:0/2641007509 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55586be49d70 con 0x55586bf67dc0 2024-09-16T01:12:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f3089ffb640 10 client.16203 handle_command_reply: tid=0 2024-09-16T01:12:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 client.16203 shutdown 2024-09-16T01:12:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 msgr2=0x55586bf5a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f30980ee1a0 tx=0x7f30980c0b50 comp rx=0 tx=0).stop 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 shutdown_connections 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x55586bf67dc0 0x55586bf6a1e0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55586bee8cb0 0x55586bf5eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55586bede410 0x55586bf5a9e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 --2- 172.21.15.17:0/2641007509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55586beddaf0 0x55586bf5a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f3089ffb640 0 client.16203 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 >> 172.21.15.17:0/2641007509 conn(0x55586beda060 msgr2=0x55586bed89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 shutdown_connections 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 1 -- 172.21.15.17:0/2641007509 wait complete. 2024-09-16T01:12:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.030+0000 7f30aba16740 20 client.16203 trim_cache size 0 max 16384 2024-09-16T01:12:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:12:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:12:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:12:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:12:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 msgr2=0x7f308c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 0x7f308c0a59a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f309c008d40 tx=0x7f309c004a40 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 msgr2=0x7f30a4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3098005940 tx=0x7f3098004270 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 shutdown_connections 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f308c0a34e0 0x7f308c0a59a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30a410c110 0x7f30a419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a41035c0 0x7f30a4198820 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 --2- 172.21.15.17:0/1871141973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30a4102c10 0x7f30a41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 >> 172.21.15.17:0/1871141973 conn(0x7f30a40fc6f0 msgr2=0x7f30a40fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 shutdown_connections 2024-09-16T01:12:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:12:57.031+0000 7f30a8b9f640 1 -- 172.21.15.17:0/1871141973 wait complete. 2024-09-16T01:12:57.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:57 smithi088 ceph-mon[34093]: pgmap v328: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:57.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:57 smithi154 ceph-mon[34759]: pgmap v328: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:57.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:57 smithi017 ceph-mon[31211]: pgmap v328: 97 pgs: 97 active+clean; 3.9 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-16T01:12:59.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:12:59 smithi088 ceph-mon[34093]: pgmap v329: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:12:59 smithi154 ceph-mon[34759]: pgmap v329: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:12:59.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:12:59 smithi017 ceph-mon[31211]: pgmap v329: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-16T01:13:01.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:01 smithi088 ceph-mon[34093]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:01 smithi154 ceph-mon[34759]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:01.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:01 smithi017 ceph-mon[31211]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:03.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:03 smithi088 ceph-mon[34093]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:03 smithi154 ceph-mon[34759]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:03.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:03 smithi017 ceph-mon[31211]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-16T01:13:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:05 smithi088 ceph-mon[34093]: pgmap v332: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-16T01:13:05.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:05 smithi088 ceph-mon[34093]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:05 smithi154 ceph-mon[34759]: pgmap v332: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-16T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:05 smithi154 ceph-mon[34759]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:13:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:05 smithi017 ceph-mon[31211]: pgmap v332: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-16T01:13:05.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:05 smithi017 ceph-mon[31211]: osdmap e92: 12 total, 12 up, 12 in 2024-09-16T01:13:07.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:07 smithi088 ceph-mon[34093]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:13:07.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:07 smithi154 ceph-mon[34759]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:13:07.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:07 smithi017 ceph-mon[31211]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-16T01:13:09.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:09 smithi088 ceph-mon[34093]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:09.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:09 smithi154 ceph-mon[34759]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:09.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:09 smithi017 ceph-mon[31211]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 -- 172.21.15.17:0/980048451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881069c0 msgr2=0x7fa088106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 --2- 172.21.15.17:0/980048451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881069c0 0x7fa088106da0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa078009930 tx=0x7fa07802a420 comp rx=0 tx=0).stop 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 -- 172.21.15.17:0/980048451 shutdown_connections 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 --2- 172.21.15.17:0/980048451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa088101350 0x7fa08810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 --2- 172.21.15.17:0/980048451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0881009b0 0x7fa088100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 --2- 172.21.15.17:0/980048451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881069c0 0x7fa088106da0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 -- 172.21.15.17:0/980048451 >> 172.21.15.17:0/980048451 conn(0x7fa088077990 msgr2=0x7fa0880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 -- 172.21.15.17:0/980048451 shutdown_connections 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.131+0000 7fa08f18d640 1 -- 172.21.15.17:0/980048451 wait complete. 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 Processor -- start 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 -- start start 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 0x7fa088197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0881069c0 0x7fa08819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa088110cb0 con 0x7fa0881009b0 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa088110b30 con 0x7fa0881069c0 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08f18d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa088110e30 con 0x7fa088101350 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08cf29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08cf29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49994/0 (socket says 172.21.15.17:49994) 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08cf29640 1 -- 172.21.15.17:0/3824015287 learned_addr learned my addr 172.21.15.17:0/3824015287 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.132+0000 7fa08d72a640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0881069c0 0x7fa08819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa087fff640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 0x7fa088197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 -- 172.21.15.17:0/3824015287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 msgr2=0x7fa088197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 0x7fa088197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 -- 172.21.15.17:0/3824015287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0881069c0 msgr2=0x7fa08819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0881069c0 0x7fa08819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 -- 172.21.15.17:0/3824015287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08819c200 con 0x7fa0881009b0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa087fff640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 0x7fa088197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08cf29640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa078004770 tx=0x7fa0780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa085ffb640 1 -- 172.21.15.17:0/3824015287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07803f070 con 0x7fa0881009b0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa085ffb640 1 -- 172.21.15.17:0/3824015287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa07803b460 con 0x7fa0881009b0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08819c490 con 0x7fa0881009b0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa085ffb640 1 -- 172.21.15.17:0/3824015287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078035070 con 0x7fa0881009b0 2024-09-16T01:13:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.133+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0881a3d80 con 0x7fa0881009b0 2024-09-16T01:13:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.136+0000 7fa092004740 1 Processor -- start 2024-09-16T01:13:10.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 -- start start 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa085ffb640 1 -- 172.21.15.17:0/3824015287 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa07803b610 con 0x7fa0881009b0 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52bfec0 0x5578b52c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5578b52172f0 con 0x5578b52b3330 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5578b51bf270 con 0x5578b52bfec0 2024-09-16T01:13:10.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa092004740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5578b52132b0 con 0x5578b52b2a10 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49998/0 (socket says 172.21.15.17:49998) 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 -- 172.21.15.17:0/4040648669 learned_addr learned my addr 172.21.15.17:0/4040648669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08d72a640 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa087fff640 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52bfec0 0x5578b52c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 -- 172.21.15.17:0/4040648669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 msgr2=0x5578b52b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 -- 172.21.15.17:0/4040648669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52bfec0 msgr2=0x5578b52c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52bfec0 0x5578b52c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa08cf29640 1 -- 172.21.15.17:0/4040648669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578b51be340 con 0x5578b52b3330 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.137+0000 7fa085ffb640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 0x7fa0700a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa08d72a640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 0x7fa0700a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa085ffb640 1 -- 172.21.15.17:0/3824015287 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa0780f0100 con 0x7fa0881009b0 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa08cf29640 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa0780ed7a0 tx=0x7fa0780f8540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9028d846935981 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa06effd640 1 -- 172.21.15.17:0/4040648669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780b8660 con 0x5578b52b3330 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa06effd640 1 -- 172.21.15.17:0/4040648669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0780bcac0 con 0x5578b52b3330 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.138+0000 7fa06effd640 1 -- 172.21.15.17:0/4040648669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780044e0 con 0x5578b52b3330 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- 172.21.15.17:0/4040648669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 msgr2=0x5578b52bf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa08d72a640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 0x7fa0700a59a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0800092f0 tx=0x7fa080009280 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa0780ed7a0 tx=0x7fa0780f8540 comp rx=0 tx=0).stop 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- 172.21.15.17:0/4040648669 shutdown_connections 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52bfec0 0x5578b52c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bf980 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 --2- 172.21.15.17:0/4040648669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- 172.21.15.17:0/4040648669 >> 172.21.15.17:0/4040648669 conn(0x5578b52af060 msgr2=0x5578b52af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- 172.21.15.17:0/4040648669 shutdown_connections 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- 172.21.15.17:0/4040648669 wait complete. 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 -- start start 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.139+0000 7fa092004740 1 Processor -- start 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52bfec0 0x5578b52bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5578b52c2850 con 0x5578b52b3330 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x5578b51a0290 con 0x5578b52b2a10 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5578b52c29d0 con 0x5578b52bfec0 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa092004740 10 client.0 _ll_register_callbacks cb 0x5578b51d1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50000/0 (socket says 172.21.15.17:50000) 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 -- 172.21.15.17:0/798508704 learned_addr learned my addr 172.21.15.17:0/798508704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa08d72a640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52bfec0 0x5578b52bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa08cf29640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 -- 172.21.15.17:0/798508704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52bfec0 msgr2=0x5578b52bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52bfec0 0x5578b52bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 -- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 msgr2=0x5578b52bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 -- 172.21.15.17:0/798508704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578b4f2a210 con 0x5578b52b3330 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa087fff640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0106a0 tx=0x7fa07c010aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f480f136aa9b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.140+0000 7fa067fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c012920 con 0x5578b52b3330 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa07c012ac0 con 0x5578b52b3330 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0780bcac0 con 0x5578b52b3330 2024-09-16T01:13:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa07c012cc0 con 0x5578b52b3330 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 10 client.16215 fetch_fsmap learned FSMap version 28 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578b4ff6620 con 0x5578b52b3330 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0780bcac0 con 0x5578b52b3330 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa07c00f040 con 0x5578b52b3330 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 10 client.16215 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 20 client.16215 populate_metadata read hostname 'smithi017' 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b52cfb30 0x5578b52d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 4 client.16215 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.141+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578b5224a20 con 0x5578b52cfb30 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.142+0000 7fa08cf29640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b52cfb30 0x5578b52d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.142+0000 7fa067fff640 10 client.16215 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:10.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.142+0000 7fa08cf29640 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b52cfb30 0x5578b52d1f40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc4e820f1b45ec7 server_cookie=b76b383ce2c841f7 in_seq=0 out_seq=0 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa067fff640 1 -- 172.21.15.17:0/798508704 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578b5224a20 con 0x5578b52cfb30 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa067fff640 10 client.16215 handle_command_reply: tid=0 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 client.16215 shutdown 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 msgr2=0x5578b52bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0106a0 tx=0x7fa07c010aa0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 shutdown_connections 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b52cfb30 0x5578b52d1f40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52bfec0 0x5578b52bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52b3330 0x5578b52bd220 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa067fff640 0 client.16215 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:10.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 --2- 172.21.15.17:0/798508704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 >> 172.21.15.17:0/798508704 conn(0x5578b52af060 msgr2=0x5578b52ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 shutdown_connections 2024-09-16T01:13:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 1 -- 172.21.15.17:0/798508704 wait complete. 2024-09-16T01:13:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.143+0000 7fa092004740 20 client.16215 trim_cache size 0 max 16384 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 Processor -- start 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 -- start start 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b3330 0x5578b52d7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881ab610 con 0x5578b52bfec0 2024-09-16T01:13:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881ad150 con 0x5578b52b2a10 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa092004740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881abce0 con 0x5578b52b3330 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50010/0 (socket says 172.21.15.17:50010) 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 -- 172.21.15.17:0/107906280 learned_addr learned my addr 172.21.15.17:0/107906280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa087fff640 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b3330 0x5578b52d7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08cf29640 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 -- 172.21.15.17:0/107906280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b3330 msgr2=0x5578b52d7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b3330 0x5578b52d7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 -- 172.21.15.17:0/107906280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 msgr2=0x5578b52d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52d1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.158+0000 7fa08d72a640 1 -- 172.21.15.17:0/107906280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578b52aee90 con 0x5578b52bfec0 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa08d72a640 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0800128c0 tx=0x7fa080014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196da4a074f013a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa06e7fc640 1 -- 172.21.15.17:0/107906280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080020bb0 con 0x5578b52bfec0 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa06e7fc640 1 -- 172.21.15.17:0/107906280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa080020d50 con 0x5578b52bfec0 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa06e7fc640 1 -- 172.21.15.17:0/107906280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08001b600 con 0x5578b52bfec0 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa092004740 1 -- 172.21.15.17:0/107906280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 msgr2=0x5578b52d7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.159+0000 7fa092004740 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0800128c0 tx=0x7fa080014000 comp rx=0 tx=0).stop 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- 172.21.15.17:0/107906280 shutdown_connections 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52d7d90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b3330 0x5578b52d7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- 172.21.15.17:0/107906280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b2a10 0x5578b52d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- 172.21.15.17:0/107906280 >> 172.21.15.17:0/107906280 conn(0x5578b52af060 msgr2=0x5578b52bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- 172.21.15.17:0/107906280 shutdown_connections 2024-09-16T01:13:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- 172.21.15.17:0/107906280 wait complete. 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- start start 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 Processor -- start 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b3330 0x5578b52ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881aca80 con 0x5578b52bfec0 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881ac3b0 con 0x5578b52b3330 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0881a9610 con 0x5578b52b2a10 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.160+0000 7fa092004740 10 client.0 _ll_register_callbacks cb 0x7fa07c0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50022/0 (socket says 172.21.15.17:50022) 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 -- 172.21.15.17:0/1429836653 learned_addr learned my addr 172.21.15.17:0/1429836653 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa087fff640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b3330 0x5578b52ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08cf29640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 -- 172.21.15.17:0/1429836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 msgr2=0x5578b52b9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 -- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b3330 msgr2=0x5578b52ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b3330 0x5578b52ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 -- 172.21.15.17:0/1429836653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578b52c6580 con 0x5578b52bfec0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa08d72a640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa080020800 tx=0x7fa080012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76e1e70df6c6f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa067fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080038020 con 0x5578b52bfec0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa080020d50 con 0x5578b52bfec0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.161+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa0800209b0 con 0x5578b52bfec0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa080043050 con 0x5578b52bfec0 2024-09-16T01:13:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 10 client.16221 fetch_fsmap learned FSMap version 28 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578b533acd0 con 0x5578b52bfec0 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa080020d50 con 0x5578b52bfec0 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa080027070 con 0x5578b52bfec0 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 10 client.16221 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 20 client.16221 populate_metadata read hostname 'smithi017' 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b533b3c0 0x5578b533d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 4 client.16221 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578b521ed70 con 0x5578b533b3c0 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.162+0000 7fa08cf29640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b533b3c0 0x5578b533d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.163+0000 7fa067fff640 10 client.16221 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:10.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.163+0000 7fa08cf29640 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b533b3c0 0x5578b533d7e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213fa77a2f1a7cab server_cookie=a4bcf83f51aab561 in_seq=0 out_seq=0 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa067fff640 1 -- 172.21.15.17:0/1429836653 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578b521ed70 con 0x5578b533b3c0 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa067fff640 10 client.16221 handle_command_reply: tid=0 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 client.16221 shutdown 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 msgr2=0x5578b52ba8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa080020800 tx=0x7fa080012f90 comp rx=0 tx=0).stop 2024-09-16T01:13:10.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 shutdown_connections 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x5578b533b3c0 0x5578b533d7e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5578b52bfec0 0x5578b52ba8c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5578b52b3330 0x5578b52ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa067fff640 0 client.16221 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 --2- 172.21.15.17:0/1429836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578b52b2a10 0x5578b52b9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 >> 172.21.15.17:0/1429836653 conn(0x5578b52af060 msgr2=0x5578b52be540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 shutdown_connections 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.178+0000 7fa092004740 1 -- 172.21.15.17:0/1429836653 wait complete. 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa092004740 20 client.16221 trim_cache size 0 max 16384 2024-09-16T01:13:10.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:13:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:13:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:13:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:13:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 msgr2=0x7fa0700a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 0x7fa0700a59a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0800092f0 tx=0x7fa080009280 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 msgr2=0x7fa088197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa078004770 tx=0x7fa0780042f0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 shutdown_connections 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fa0700a34e0 0x7fa0700a59a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0881069c0 0x7fa08819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa088101350 0x7fa088197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 --2- 172.21.15.17:0/3824015287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0881009b0 0x7fa088197210 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 >> 172.21.15.17:0/3824015287 conn(0x7fa088077990 msgr2=0x7fa0881039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 shutdown_connections 2024-09-16T01:13:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:10.179+0000 7fa08f18d640 1 -- 172.21.15.17:0/3824015287 wait complete. 2024-09-16T01:13:11.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:11 smithi088 ceph-mon[34093]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:11.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:11 smithi154 ceph-mon[34759]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:11.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:11 smithi017 ceph-mon[31211]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-16T01:13:13.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:13 smithi154 ceph-mon[34759]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:13:13.404 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:13 smithi154 ceph-mon[34759]: pgmap v338: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-16T01:13:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:13 smithi017 ceph-mon[31211]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:13:13.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:13 smithi017 ceph-mon[31211]: pgmap v338: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-16T01:13:13.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:13 smithi088 ceph-mon[34093]: osdmap e93: 12 total, 12 up, 12 in 2024-09-16T01:13:13.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:13 smithi088 ceph-mon[34093]: pgmap v338: 97 pgs: 97 active+clean; 4.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-16T01:13:15.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:15 smithi088 ceph-mon[34093]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:15.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:15 smithi154 ceph-mon[34759]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:15.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:15 smithi017 ceph-mon[31211]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:17.644 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:17 smithi088 ceph-mon[34093]: pgmap v340: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:17.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:17 smithi154 ceph-mon[34759]: pgmap v340: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:17.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:17 smithi017 ceph-mon[31211]: pgmap v340: 97 pgs: 97 active+clean; 4.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-16T01:13:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:19 smithi088 ceph-mon[34093]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:19.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:19 smithi154 ceph-mon[34759]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:19.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:19 smithi017 ceph-mon[31211]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:21.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:21 smithi088 ceph-mon[34093]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:21.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:21 smithi154 ceph-mon[34759]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:21.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:21 smithi017 ceph-mon[31211]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 -- 172.21.15.17:0/2111537515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560106a00 msgr2=0x7f9560106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 --2- 172.21.15.17:0/2111537515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560106a00 0x7f9560106de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9550009930 tx=0x7f955002a420 comp rx=0 tx=0).stop 2024-09-16T01:13:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 -- 172.21.15.17:0/2111537515 shutdown_connections 2024-09-16T01:13:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 --2- 172.21.15.17:0/2111537515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9560101390 0x7f956010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 --2- 172.21.15.17:0/2111537515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95601009f0 0x7f9560100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 --2- 172.21.15.17:0/2111537515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560106a00 0x7f9560106de0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 -- 172.21.15.17:0/2111537515 >> 172.21.15.17:0/2111537515 conn(0x7f95600fc6b0 msgr2=0x7f95600fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 -- 172.21.15.17:0/2111537515 shutdown_connections 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.279+0000 7f95650ac640 1 -- 172.21.15.17:0/2111537515 wait complete. 2024-09-16T01:13:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.280+0000 7f95650ac640 1 Processor -- start 2024-09-16T01:13:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.280+0000 7f95650ac640 1 -- start start 2024-09-16T01:13:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 0x7f9560199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9560106a00 0x7f95601a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9560110cf0 con 0x7f9560101390 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9560110b70 con 0x7f9560106a00 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f95650ac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9560110e70 con 0x7f95601009f0 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45196/0 (socket says 172.21.15.17:45196) 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 -- 172.21.15.17:0/30912971 learned_addr learned my addr 172.21.15.17:0/30912971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955f59e640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9560106a00 0x7f95601a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955ed9d640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 0x7f9560199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 -- 172.21.15.17:0/30912971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 msgr2=0x7f9560199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 0x7f9560199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 -- 172.21.15.17:0/30912971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9560106a00 msgr2=0x7f95601a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9560106a00 0x7f95601a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 -- 172.21.15.17:0/30912971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95601a46f0 con 0x7f9560101390 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955ed9d640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 0x7f9560199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f955e59c640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f955400d950 tx=0x7f955400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.281+0000 7f9547fff640 1 -- 172.21.15.17:0/30912971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554017070 con 0x7f9560101390 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.282+0000 7f9547fff640 1 -- 172.21.15.17:0/30912971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9554009c30 con 0x7f9560101390 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.282+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95601a48c0 con 0x7f9560101390 2024-09-16T01:13:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.282+0000 7f9547fff640 1 -- 172.21.15.17:0/30912971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955400f620 con 0x7f9560101390 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.282+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95601a4de0 con 0x7f9560101390 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 Processor -- start 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9547fff640 1 -- 172.21.15.17:0/30912971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f95540109a0 con 0x7f9560101390 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 -- start start 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f469ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.284+0000 7f9567e4d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56161f3ce2f0 con 0x56161f46a410 2024-09-16T01:13:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f9567e4d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56161f376270 con 0x56161f469af0 2024-09-16T01:13:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f9567e4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56161f3ca2b0 con 0x56161f474cb0 2024-09-16T01:13:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45200/0 (socket says 172.21.15.17:45200) 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 -- 172.21.15.17:0/1055318426 learned_addr learned my addr 172.21.15.17:0/1055318426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955f59e640 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f469ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955e59c640 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 -- 172.21.15.17:0/1055318426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 msgr2=0x56161f4770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 -- 172.21.15.17:0/1055318426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 msgr2=0x56161f469ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f469ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 -- 172.21.15.17:0/1055318426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161f375340 con 0x56161f46a410 2024-09-16T01:13:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f9547fff640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 0x7f95480a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955f59e640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 0x7f95480a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f955ed9d640 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9550031440 tx=0x7f9550032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c50205a6fe1b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.285+0000 7f9547fff640 1 -- 172.21.15.17:0/30912971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f95540cf9b0 con 0x7f9560101390 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f95457fa640 1 -- 172.21.15.17:0/1055318426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955003f070 con 0x56161f46a410 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f95457fa640 1 -- 172.21.15.17:0/1055318426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9550031760 con 0x56161f46a410 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f95457fa640 1 -- 172.21.15.17:0/1055318426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550035070 con 0x56161f46a410 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 -- 172.21.15.17:0/1055318426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 msgr2=0x56161f474770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f955f59e640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 0x7f95480a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f955800ae90 tx=0x7f955800a4d0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9550031440 tx=0x7f9550032e70 comp rx=0 tx=0).stop 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 -- 172.21.15.17:0/1055318426 shutdown_connections 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f474770 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 --2- 172.21.15.17:0/1055318426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f469ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 -- 172.21.15.17:0/1055318426 >> 172.21.15.17:0/1055318426 conn(0x56161f466060 msgr2=0x56161f466440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 -- 172.21.15.17:0/1055318426 shutdown_connections 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.286+0000 7f9567e4d740 1 -- 172.21.15.17:0/1055318426 wait complete. 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 -- start start 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 Processor -- start 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f46a410 0x56161f4796b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 0x56161f47d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56161f477880 con 0x56161f469af0 2024-09-16T01:13:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x56161f357290 con 0x56161f474cb0 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56161f477a00 con 0x56161f46a410 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f9567e4d740 10 client.0 _ll_register_callbacks cb 0x56161f388140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45212/0 (socket says 172.21.15.17:45212) 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f955ed9d640 1 -- 172.21.15.17:0/2065891089 learned_addr learned my addr 172.21.15.17:0/2065891089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.287+0000 7f955e59c640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f46a410 0x56161f4796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955f59e640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 0x56161f47d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 -- 172.21.15.17:0/2065891089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f46a410 msgr2=0x56161f4796b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f46a410 0x56161f4796b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 -- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 msgr2=0x56161f47d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 0x56161f47d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 -- 172.21.15.17:0/2065891089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56161f0e1210 con 0x56161f469af0 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955f59e640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 0x56161f47d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f955ed9d640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9550009900 tx=0x7f955003c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d374389b9898383 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9542ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955003f070 con 0x56161f469af0 2024-09-16T01:13:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9550031760 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f9550031d00 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9550054050 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9567e4d740 10 client.16233 fetch_fsmap learned FSMap version 28 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56161f1ad620 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.288+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9550031760 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95500035f0 con 0x56161f469af0 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 10 client.16233 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:13:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 20 client.16233 populate_metadata read hostname 'smithi017' 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f488e50 0x56161f48b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 4 client.16233 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56161f3dba20 con 0x56161f488e50 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f955e59c640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f488e50 0x56161f48b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f9542ff5640 10 client.16233 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.289+0000 7f955e59c640 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f488e50 0x56161f48b240 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=553a15775bc7b910 server_cookie=a6055769b948f87b in_seq=0 out_seq=0 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9542ff5640 1 -- 172.21.15.17:0/2065891089 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56161f3dba20 con 0x56161f488e50 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9542ff5640 10 client.16233 handle_command_reply: tid=0 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 client.16233 shutdown 2024-09-16T01:13:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 msgr2=0x56161f479170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9550009900 tx=0x7f955003c6f0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 shutdown_connections 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f488e50 0x56161f48b240 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f474cb0 0x56161f47d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f46a410 0x56161f4796b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9542ff5640 0 client.16233 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 --2- 172.21.15.17:0/2065891089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f469af0 0x56161f479170 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 >> 172.21.15.17:0/2065891089 conn(0x56161f466060 msgr2=0x56161f46bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 shutdown_connections 2024-09-16T01:13:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.290+0000 7f9567e4d740 1 -- 172.21.15.17:0/2065891089 wait complete. 2024-09-16T01:13:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.291+0000 7f9567e4d740 20 client.16233 trim_cache size 0 max 16384 2024-09-16T01:13:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.305+0000 7f9567e4d740 1 Processor -- start 2024-09-16T01:13:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.305+0000 7f9567e4d740 1 -- start start 2024-09-16T01:13:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.305+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f47d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4907e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9567e4d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95601ab470 con 0x56161f46a410 2024-09-16T01:13:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9567e4d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f95601acfb0 con 0x56161f469af0 2024-09-16T01:13:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9567e4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95601abb40 con 0x56161f474cb0 2024-09-16T01:13:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45218/0 (socket says 172.21.15.17:45218) 2024-09-16T01:13:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 -- 172.21.15.17:0/3413668427 learned_addr learned my addr 172.21.15.17:0/3413668427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f47d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 -- 172.21.15.17:0/3413668427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 msgr2=0x56161f4907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955f59e640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4907e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4907e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 -- 172.21.15.17:0/3413668427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 msgr2=0x56161f47d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f47d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 -- 172.21.15.17:0/3413668427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161f48b5b0 con 0x56161f46a410 2024-09-16T01:13:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f47d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:13:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955f59e640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f955e59c640 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f955409b930 tx=0x7f9554086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daed9b05df0652ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9544ff9640 1 -- 172.21.15.17:0/3413668427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554020040 con 0x56161f46a410 2024-09-16T01:13:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9544ff9640 1 -- 172.21.15.17:0/3413668427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f955409ffe0 con 0x56161f46a410 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.306+0000 7f9544ff9640 1 -- 172.21.15.17:0/3413668427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540860b0 con 0x56161f46a410 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- 172.21.15.17:0/3413668427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 msgr2=0x56161f477c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f955409b930 tx=0x7f9554086040 comp rx=0 tx=0).stop 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- 172.21.15.17:0/3413668427 shutdown_connections 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f477c50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3413668427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f47d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- 172.21.15.17:0/3413668427 >> 172.21.15.17:0/3413668427 conn(0x56161f466060 msgr2=0x56161f4651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- 172.21.15.17:0/3413668427 shutdown_connections 2024-09-16T01:13:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- 172.21.15.17:0/3413668427 wait complete. 2024-09-16T01:13:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 -- start start 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.307+0000 7f9567e4d740 1 Processor -- start 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f485190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95601ac8e0 con 0x56161f46a410 2024-09-16T01:13:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f95601ac210 con 0x56161f469af0 2024-09-16T01:13:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95601a9470 con 0x56161f474cb0 2024-09-16T01:13:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9567e4d740 10 client.0 _ll_register_callbacks cb 0x7f955800a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:13:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45230/0 (socket says 172.21.15.17:45230) 2024-09-16T01:13:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 -- 172.21.15.17:0/3447795070 learned_addr learned my addr 172.21.15.17:0/3447795070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955f59e640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f485190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 -- 172.21.15.17:0/3447795070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 msgr2=0x56161f4808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4808a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 -- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 msgr2=0x56161f485190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:13:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f485190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 -- 172.21.15.17:0/3447795070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56161f4810a0 con 0x56161f46a410 2024-09-16T01:13:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955f59e640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f485190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f955e59c640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f95540d1010 tx=0x7f95540cd0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65da31d5989458ef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9542ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.308+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540b9060 con 0x56161f46a410 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f955409ffe0 con 0x56161f46a410 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f95540cd320 con 0x56161f46a410 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9554020070 con 0x56161f46a410 2024-09-16T01:13:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 10 client.16239 fetch_fsmap learned FSMap version 28 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56161f4f3350 con 0x56161f46a410 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f955409ffe0 con 0x56161f46a410 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f95540b4070 con 0x56161f46a410 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 10 client.16239 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-16T01:13:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 20 client.16239 populate_metadata read hostname 'smithi017' 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f4f3830 0x56161f4f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 4 client.16239 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 --> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56161f3d5d70 con 0x56161f4f3830 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.309+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f4f3830 0x56161f4f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.310+0000 7f9542ff5640 10 client.16239 ms_handle_connect on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.310+0000 7f955ed9d640 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f4f3830 0x56161f4f5c20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f34e2d7d55e42a7c server_cookie=1dfd6b37591ec4f5 in_seq=0 out_seq=0 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9542ff5640 1 -- 172.21.15.17:0/3447795070 <== mds.0 v2:172.21.15.88:6838/2954076302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56161f3d5d70 con 0x56161f4f3830 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9542ff5640 10 client.16239 handle_command_reply: tid=0 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 client.16239 shutdown 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 msgr2=0x56161f4856d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f95540d1010 tx=0x7f95540cd0b0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 shutdown_connections 2024-09-16T01:13:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:6838/2954076302,v1:172.21.15.88:6839/2954076302] conn(0x56161f4f3830 0x56161f4f5c20 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56161f474cb0 0x56161f4808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56161f46a410 0x56161f4856d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 --2- 172.21.15.17:0/3447795070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56161f469af0 0x56161f485190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9542ff5640 0 client.16239 ms_handle_reset on v2:172.21.15.88:6838/2954076302 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 >> 172.21.15.17:0/3447795070 conn(0x56161f466060 msgr2=0x56161f46b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 shutdown_connections 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.324+0000 7f9567e4d740 1 -- 172.21.15.17:0/3447795070 wait complete. 2024-09-16T01:13:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f9567e4d740 20 client.16239 trim_cache size 0 max 16384 2024-09-16T01:13:23.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-09-16T01:13:23.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-09-16T01:13:23.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-09-16T01:13:23.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-09-16T01:13:23.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 msgr2=0x7f95480a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 0x7f95480a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f955800ae90 tx=0x7f955800a4d0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 msgr2=0x7f9560199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f955400d950 tx=0x7f955400de10 comp rx=0 tx=0).stop 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 shutdown_connections 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f95480a3460 0x7f95480a5920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9560106a00 0x7f95601a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9560101390 0x7f9560199670 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 --2- 172.21.15.17:0/30912971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95601009f0 0x7f9560199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:23.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 >> 172.21.15.17:0/30912971 conn(0x7f95600fc6b0 msgr2=0x7f95600fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:23.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 shutdown_connections 2024-09-16T01:13:23.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-09-16T01:13:23.325+0000 7f95650ac640 1 -- 172.21.15.17:0/30912971 wait complete. 2024-09-16T01:13:23.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:23 smithi088 ceph-mon[34093]: pgmap v343: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:23.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:23 smithi154 ceph-mon[34759]: pgmap v343: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:23.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:23 smithi017 ceph-mon[31211]: pgmap v343: 97 pgs: 97 active+clean; 5.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-16T01:13:25.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:25 smithi088 ceph-mon[34093]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:25 smithi154 ceph-mon[34759]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:13:25.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:25 smithi017 ceph-mon[31211]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-16T01:13:27.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:27 smithi088 ceph-mon[34093]: pgmap v345: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:13:27.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:27 smithi154 ceph-mon[34759]: pgmap v345: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:13:27.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:27 smithi017 ceph-mon[31211]: pgmap v345: 97 pgs: 97 active+clean; 5.2 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-16T01:13:29.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:29 smithi088 ceph-mon[34093]: pgmap v346: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:13:29.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:29 smithi154 ceph-mon[34759]: pgmap v346: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:13:29.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:29 smithi017 ceph-mon[31211]: pgmap v346: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-09-16T01:13:30.673 INFO:tasks.workunit.client.0.smithi017.stdout:561/600: open fd = 3 2024-09-16T01:13:30.673 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:562/600: open fd = 3 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:563/600: open fd = 3 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:564/600: open fd = 3 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:565/600: open fd = 3 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:566/600: open fd = 3 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:567/600: open fd = 3 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.675 INFO:tasks.workunit.client.0.smithi017.stdout:568/600: open fd = 3 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:569/600: open fd = 3 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:570/600: open fd = 3 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:571/600: open fd = 3 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.676 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:572/600: open fd = 3 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:573/600: open fd = 3 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:574/600: open fd = 3 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:575/600: open fd = 3 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:576/600: open fd = 3 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:577/600: open fd = 3 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:578/600: open fd = 3 2024-09-16T01:13:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:579/600: open fd = 3 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:580/600: open fd = 3 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:581/600: open fd = 3 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:582/600: open fd = 3 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:583/600: open fd = 3 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.680 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:584/600: open fd = 3 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:585/600: open fd = 3 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:586/600: open fd = 3 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:587/600: open fd = 3 2024-09-16T01:13:30.681 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:588/600: open fd = 3 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:589/600: open fd = 3 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:590/600: open fd = 3 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.682 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:591/600: open fd = 3 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:592/600: open fd = 3 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:593/600: open fd = 3 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:594/600: open fd = 3 2024-09-16T01:13:30.683 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:595/600: open fd = 3 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:596/600: open fd = 3 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:597/600: open fd = 3 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:598/600: open fd = 3 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:599/600: open fd = 3 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:600/600: open fd = 3 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:write ret = 32 2024-09-16T01:13:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:pread ret = 64 2024-09-16T01:13:30.686 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo OK 2024-09-16T01:13:30.686 INFO:tasks.workunit.client.0.smithi017.stdout:OK 2024-09-16T01:13:30.687 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T01:13:30.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:13:30.779 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-16T01:13:30.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T01:13:31.091 DEBUG:teuthology.parallel:result is None 2024-09-16T01:13:31.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:13:31.130 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:13:31.130 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-16T01:13:31.144 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:13:31.178 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-16T01:13:31.187 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-16T01:13:31.188 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:13:31.188 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:13:31.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-16T01:13:31.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-16T01:13:31.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-16T01:13:31.375 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:31 smithi017 ceph-mon[31211]: pgmap v347: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 -- 172.21.15.17:0/200304481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc0410c130 msgr2=0x7fcc0410e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 --2- 172.21.15.17:0/200304481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc0410c130 0x7fcc0410e5a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009ca0 tx=0x7fcbfc02a950 comp rx=0 tx=0).stop 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 -- 172.21.15.17:0/200304481 shutdown_connections 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 --2- 172.21.15.17:0/200304481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc0410c130 0x7fcc0410e5a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 --2- 172.21.15.17:0/200304481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04103680 0x7fcc0410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 --2- 172.21.15.17:0/200304481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc04102d60 0x7fcc04103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 -- 172.21.15.17:0/200304481 >> 172.21.15.17:0/200304481 conn(0x7fcc040fc6b0 msgr2=0x7fcc040fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 -- 172.21.15.17:0/200304481 shutdown_connections 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.457+0000 7fcc089bd640 1 -- 172.21.15.17:0/200304481 wait complete. 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 Processor -- start 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 -- start start 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04102d60 0x7fcc041982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0410c130 0x7fcc0419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111db0 con 0x7fcc04103680 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111c30 con 0x7fcc04102d60 2024-09-16T01:13:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc089bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111f30 con 0x7fcc0410c130 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc01d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc01d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59644/0 (socket says 172.21.15.17:59644) 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc01d9b640 1 -- 172.21.15.17:0/172324235 learned_addr learned my addr 172.21.15.17:0/172324235 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc02d9d640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0410c130 0x7fcc0419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.458+0000 7fcc0259c640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04102d60 0x7fcc041982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 -- 172.21.15.17:0/172324235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0410c130 msgr2=0x7fcc0419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0410c130 0x7fcc0419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 -- 172.21.15.17:0/172324235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04102d60 msgr2=0x7fcc041982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04102d60 0x7fcc041982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 -- 172.21.15.17:0/172324235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0419d2d0 con 0x7fcc04103680 2024-09-16T01:13:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc01d9b640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800d950 tx=0x7fcbf800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8017070 con 0x7fcc04103680 2024-09-16T01:13:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbf8009c30 con 0x7fcc04103680 2024-09-16T01:13:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0419d5c0 con 0x7fcc04103680 2024-09-16T01:13:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800f620 con 0x7fcc04103680 2024-09-16T01:13:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.459+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc041a4e50 con 0x7fcc04103680 2024-09-16T01:13:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.460+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc04103140 con 0x7fcc04103680 2024-09-16T01:13:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.462+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcbf80109a0 con 0x7fcc04103680 2024-09-16T01:13:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.463+0000 7fcbf37fe640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 0x7fcbec0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.463+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7fcbf80cfa00 con 0x7fcc04103680 2024-09-16T01:13:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.463+0000 7fcc0259c640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 0x7fcbec0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.463+0000 7fcc0259c640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 0x7fcbec0a5920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4005fd0 tx=0x7fcbf4005850 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.466+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbf8009de0 con 0x7fcc04103680 2024-09-16T01:13:31.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:31 smithi088 ceph-mon[34093]: pgmap v347: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:31.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:31 smithi154 ceph-mon[34759]: pgmap v347: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:31.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.661+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fcc04107240 con 0x7fcbec0a3460 2024-09-16T01:13:31.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.668+0000 7fcbf37fe640 1 -- 172.21.15.17:0/172324235 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fcc04107240 con 0x7fcbec0a3460 2024-09-16T01:13:31.669 INFO:teuthology.orchestra.run.smithi017.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-16T00:00:00", "created": "2024-09-16T01:02:24", "first": "2024-09-16T01:03:00", "last": "2024-09-16T01:13:00", "last_pruned": "2024-09-16T01:13:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-16T01:13:31.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 msgr2=0x7fcbec0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 0x7fcbec0a5920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4005fd0 tx=0x7fcbf4005850 comp rx=0 tx=0).stop 2024-09-16T01:13:31.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 msgr2=0x7fcc04198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800d950 tx=0x7fcbf800de10 comp rx=0 tx=0).stop 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 shutdown_connections 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcbec0a3460 0x7fcbec0a5920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0410c130 0x7fcc0419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc04103680 0x7fcc04198820 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 --2- 172.21.15.17:0/172324235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc04102d60 0x7fcc041982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 >> 172.21.15.17:0/172324235 conn(0x7fcc040fc6b0 msgr2=0x7fcc040fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 shutdown_connections 2024-09-16T01:13:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.670+0000 7fcc089bd640 1 -- 172.21.15.17:0/172324235 wait complete. 2024-09-16T01:13:31.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-16T01:13:31.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 -- 172.21.15.17:0/2111739131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2038101390 msgr2=0x7f203810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 --2- 172.21.15.17:0/2111739131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2038101390 0x7f203810d8c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2030009cd0 tx=0x7f203002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 -- 172.21.15.17:0/2111739131 shutdown_connections 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 --2- 172.21.15.17:0/2111739131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2038101390 0x7f203810d8c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 --2- 172.21.15.17:0/2111739131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20381009f0 0x7f2038100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 --2- 172.21.15.17:0/2111739131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f2038106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 -- 172.21.15.17:0/2111739131 >> 172.21.15.17:0/2111739131 conn(0x7f20380fc6b0 msgr2=0x7f20380fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 -- 172.21.15.17:0/2111739131 shutdown_connections 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.828+0000 7f203cb9f640 1 -- 172.21.15.17:0/2111739131 wait complete. 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 Processor -- start 2024-09-16T01:13:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 -- start start 2024-09-16T01:13:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 0x7f20380fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f20380fd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2038110cf0 con 0x7f20381009f0 2024-09-16T01:13:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2038110b70 con 0x7f2038101390 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203cb9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2038110e70 con 0x7f2038106a00 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59656/0 (socket says 172.21.15.17:59656) 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f203659c640 1 -- 172.21.15.17:0/772542656 learned_addr learned my addr 172.21.15.17:0/772542656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.829+0000 7f2035d9b640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 0x7f20380fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 -- 172.21.15.17:0/772542656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 msgr2=0x7f20380fd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f2036d9d640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f20380fd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f20380fd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 -- 172.21.15.17:0/772542656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 msgr2=0x7f20380fd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 0x7f20380fd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 -- 172.21.15.17:0/772542656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20381a66b0 con 0x7f20381009f0 2024-09-16T01:13:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f2035d9b640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 0x7f20380fd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f2036d9d640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f20380fd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203659c640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f202800c920 tx=0x7f202800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028007c70 con 0x7f20381009f0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2028007e10 con 0x7f20381009f0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20381a69a0 con 0x7f20381009f0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028018820 con 0x7f20381009f0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.830+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20381a6f40 con 0x7f20381009f0 2024-09-16T01:13:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.831+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2038100e50 con 0x7f20381009f0 2024-09-16T01:13:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.833+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f20280189c0 con 0x7f20381009f0 2024-09-16T01:13:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.834+0000 7f20277fe640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 0x7f20200a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.834+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f20280d00b0 con 0x7f20381009f0 2024-09-16T01:13:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.834+0000 7f2035d9b640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 0x7f20200a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.834+0000 7f2035d9b640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 0x7f20200a59a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20380fe640 tx=0x7f202c00a5c0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:31.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:31.837+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2028014030 con 0x7f20381009f0 2024-09-16T01:13:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.037+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 --> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2038062630 con 0x7f20200a34e0 2024-09-16T01:13:32.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.044+0000 7f20277fe640 1 -- 172.21.15.17:0/772542656 <== mgr.15225 v2:172.21.15.17:6800/1687735498 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2038062630 con 0x7f20200a34e0 2024-09-16T01:13:32.045 INFO:teuthology.orchestra.run.smithi017.stdout:/ 1m 6m3h 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 msgr2=0x7f20200a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 0x7f20200a59a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20380fe640 tx=0x7f202c00a5c0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 msgr2=0x7f20380fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f202800c920 tx=0x7f202800cde0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 shutdown_connections 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f20200a34e0 0x7f20200a59a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2038106a00 0x7f20380fd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2038101390 0x7f20380fd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 --2- 172.21.15.17:0/772542656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20381009f0 0x7f20380fcbb0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 >> 172.21.15.17:0/772542656 conn(0x7f20380fc6b0 msgr2=0x7f203806a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 shutdown_connections 2024-09-16T01:13:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.046+0000 7f203cb9f640 1 -- 172.21.15.17:0/772542656 wait complete. 2024-09-16T01:13:32.058 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-16T01:13:32.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.173+0000 7f451c9a6640 1 -- 172.21.15.17:0/2019757443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 msgr2=0x7f4518106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.173+0000 7f451c9a6640 1 --2- 172.21.15.17:0/2019757443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f4518106d70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4508009930 tx=0x7f450802a420 comp rx=0 tx=0).stop 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 -- 172.21.15.17:0/2019757443 shutdown_connections 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 --2- 172.21.15.17:0/2019757443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f451810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 --2- 172.21.15.17:0/2019757443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f4518100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 --2- 172.21.15.17:0/2019757443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f4518106d70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 -- 172.21.15.17:0/2019757443 >> 172.21.15.17:0/2019757443 conn(0x7f4518077a10 msgr2=0x7f45180fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 -- 172.21.15.17:0/2019757443 shutdown_connections 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 -- 172.21.15.17:0/2019757443 wait complete. 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 Processor -- start 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.174+0000 7f451c9a6640 1 -- start start 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f45181971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f45181976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4518110c50 con 0x7f4518106990 2024-09-16T01:13:32.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4518110ad0 con 0x7f4518100980 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4518110dd0 con 0x7f4518101320 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59668/0 (socket says 172.21.15.17:59668) 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 -- 172.21.15.17:0/4166546755 learned_addr learned my addr 172.21.15.17:0/4166546755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451659c640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f45181971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4515d9b640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f45181976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 -- 172.21.15.17:0/4166546755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 msgr2=0x7f45181976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f45181976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 -- 172.21.15.17:0/4166546755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 msgr2=0x7f45181971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f45181971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 -- 172.21.15.17:0/4166546755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451819c190 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451659c640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f45181971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4515d9b640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f45181976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f4516d9d640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f451000cce0 tx=0x7f451000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451000f450 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f451000faa0 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451819c480 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510018b70 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.175+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45181a3d10 con 0x7f4518106990 2024-09-16T01:13:32.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.177+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4518100de0 con 0x7f4518106990 2024-09-16T01:13:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.178+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4510018d10 con 0x7f4518106990 2024-09-16T01:13:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.178+0000 7f45077fe640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 0x7f45000a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.179+0000 7f451659c640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 0x7f45000a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.179+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f45100d0240 con 0x7f4518106990 2024-09-16T01:13:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.179+0000 7f451659c640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 0x7f45000a5880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4508000c00 tx=0x7f4508031cf0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.182+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4510014030 con 0x7f4518106990 2024-09-16T01:13:32.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.363+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4518108960 con 0x7f4518106990 2024-09-16T01:13:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.364+0000 7f45077fe640 1 -- 172.21.15.17:0/4166546755 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23106 (secure 0 0 0) 0x7f451009ccb0 con 0x7f4518106990 2024-09-16T01:13:32.365 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:13:32.365 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:13:12.141387+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/4120022701":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6801/333607551":"2024-09-17T01:02:22.003910+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1167321081":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3103598954":"2024-09-17T01:02:22.003910+0000","172.21.15.17:0/1301615150":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6800/333607551":"2024-09-17T01:02:22.003910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:13:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 msgr2=0x7f45000a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 0x7f45000a5880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4508000c00 tx=0x7f4508031cf0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 msgr2=0x7f451819ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f451000cce0 tx=0x7f451000a620 comp rx=0 tx=0).stop 2024-09-16T01:13:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 shutdown_connections 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f45000a33c0 0x7f45000a5880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4518106990 0x7f451819ba60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4518101320 0x7f45181976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 --2- 172.21.15.17:0/4166546755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4518100980 0x7f45181971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 >> 172.21.15.17:0/4166546755 conn(0x7f4518077a10 msgr2=0x7f4518103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 shutdown_connections 2024-09-16T01:13:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.366+0000 7f451c9a6640 1 -- 172.21.15.17:0/4166546755 wait complete. 2024-09-16T01:13:32.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:32 smithi017 ceph-mon[31211]: from='client.16245 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:32.378 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:55:49.344475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T01:00:25.290298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T01:00:27.415501+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:13:32.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:13:32.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.487+0000 7f96917af640 1 -- 172.21.15.17:0/632947153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 msgr2=0x7f968c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.487+0000 7f96917af640 1 --2- 172.21.15.17:0/632947153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c10d850 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9684009cd0 tx=0x7f968402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 -- 172.21.15.17:0/632947153 shutdown_connections 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 --2- 172.21.15.17:0/632947153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c10d850 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 --2- 172.21.15.17:0/632947153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 0x7f968c100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 --2- 172.21.15.17:0/632947153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 0x7f968c106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 -- 172.21.15.17:0/632947153 >> 172.21.15.17:0/632947153 conn(0x7f968c0779d0 msgr2=0x7f968c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 -- 172.21.15.17:0/632947153 shutdown_connections 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 -- 172.21.15.17:0/632947153 wait complete. 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 Processor -- start 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.488+0000 7f96917af640 1 -- start start 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 0x7f968c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 0x7f968c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f968c110cd0 con 0x7f968c101320 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f968c110b50 con 0x7f968c100980 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f968c110e50 con 0x7f968c106990 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59696/0 (socket says 172.21.15.17:59696) 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 -- 172.21.15.17:0/1973410291 learned_addr learned my addr 172.21.15.17:0/1973410291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968affd640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 0x7f968c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968b7fe640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 0x7f968c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 -- 172.21.15.17:0/1973410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 msgr2=0x7f968c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 0x7f968c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 -- 172.21.15.17:0/1973410291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 msgr2=0x7f968c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 0x7f968c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 -- 172.21.15.17:0/1973410291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c19d390 con 0x7f968c101320 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f968a7fc640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f968000e9f0 tx=0x7f968000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968000cd80 con 0x7f968c101320 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96800108e0 con 0x7f968c101320 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680018920 con 0x7f968c101320 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.489+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c19d680 con 0x7f968c101320 2024-09-16T01:13:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.490+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a4f10 con 0x7f968c101320 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.491+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c100de0 con 0x7f968c101320 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.493+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9680010a90 con 0x7f968c101320 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.493+0000 7f9673fff640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 0x7f96740a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.493+0000 7f968affd640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 0x7f96740a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.493+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f96800d0680 con 0x7f968c101320 2024-09-16T01:13:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.494+0000 7f968affd640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 0x7f96740a5880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c00b510 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.496+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f968009d060 con 0x7f968c101320 2024-09-16T01:13:32.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:32 smithi088 ceph-mon[34093]: from='client.16245 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:32.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:32 smithi154 ceph-mon[34759]: from='client.16245 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.672+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f968c109f60 con 0x7f968c101320 2024-09-16T01:13:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.673+0000 7f9673fff640 1 -- 172.21.15.17:0/1973410291 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f968009c960 con 0x7f968c101320 2024-09-16T01:13:32.674 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 msgr2=0x7f96740a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 0x7f96740a5880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c00b510 comp rx=0 tx=0).stop 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 msgr2=0x7f968c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f968000e9f0 tx=0x7f968000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 shutdown_connections 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f96740a33c0 0x7f96740a5880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f968c106990 0x7f968c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f968c101320 0x7f968c1988e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 --2- 172.21.15.17:0/1973410291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968c100980 0x7f968c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 >> 172.21.15.17:0/1973410291 conn(0x7f968c0779d0 msgr2=0x7f968c069730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 shutdown_connections 2024-09-16T01:13:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.675+0000 7f96917af640 1 -- 172.21.15.17:0/1973410291 wait complete. 2024-09-16T01:13:32.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 -- 172.21.15.17:0/2998362432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 msgr2=0x7fbe1c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 --2- 172.21.15.17:0/2998362432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c100e10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009930 tx=0x7fbe0402a420 comp rx=0 tx=0).stop 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 -- 172.21.15.17:0/2998362432 shutdown_connections 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 --2- 172.21.15.17:0/2998362432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c101350 0x7fbe1c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 --2- 172.21.15.17:0/2998362432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c100e10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 --2- 172.21.15.17:0/2998362432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 -- 172.21.15.17:0/2998362432 >> 172.21.15.17:0/2998362432 conn(0x7fbe1c0fc690 msgr2=0x7fbe1c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 -- 172.21.15.17:0/2998362432 shutdown_connections 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.793+0000 7fbe21de4640 1 -- 172.21.15.17:0/2998362432 wait complete. 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 Processor -- start 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 -- start start 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c101350 0x7fbe1c0fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c0fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c110cb0 con 0x7fbe1c1009b0 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c110b30 con 0x7fbe1c101350 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe21de4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c110e30 con 0x7fbe1c1069c0 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59702/0 (socket says 172.21.15.17:59702) 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe1b7fe640 1 -- 172.21.15.17:0/380501598 learned_addr learned my addr 172.21.15.17:0/380501598 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.794+0000 7fbe13fff640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c101350 0x7fbe1c0fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 -- 172.21.15.17:0/380501598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 msgr2=0x7fbe1c0fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1bfff640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c0fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c0fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 -- 172.21.15.17:0/380501598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c101350 msgr2=0x7fbe1c0fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c101350 0x7fbe1c0fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 -- 172.21.15.17:0/380501598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c1a6870 con 0x7fbe1c1009b0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1bfff640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c0fd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe1b7fe640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00d950 tx=0x7fbe0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c017030 con 0x7fbe1c1009b0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe0c004020 con 0x7fbe1c1009b0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1a6b60 con 0x7fbe1c1009b0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0047a0 con 0x7fbe1c1009b0 2024-09-16T01:13:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.795+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c1a70d0 con 0x7fbe1c1009b0 2024-09-16T01:13:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.796+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1c100e10 con 0x7fbe1c1009b0 2024-09-16T01:13:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.797+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbe0c0041d0 con 0x7fbe1c1009b0 2024-09-16T01:13:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.798+0000 7fbe197fa640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 0x7fbe080a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.798+0000 7fbe13fff640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 0x7fbe080a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.798+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7fbe0c0cfd20 con 0x7fbe1c1009b0 2024-09-16T01:13:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.799+0000 7fbe13fff640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 0x7fbe080a5900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009900 tx=0x7fbe04000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:32.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.801+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe0c09c780 con 0x7fbe1c1009b0 2024-09-16T01:13:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.982+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbe1c1099c0 con 0x7fbe1c1009b0 2024-09-16T01:13:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.982+0000 7fbe197fa640 1 -- 172.21.15.17:0/380501598 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7fbe0c09c080 con 0x7fbe1c1009b0 2024-09-16T01:13:32.983 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-16T01:13:32.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 msgr2=0x7fbe080a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 0x7fbe080a5900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009900 tx=0x7fbe04000bc0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 msgr2=0x7fbe1c0fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00d950 tx=0x7fbe0c00de10 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 shutdown_connections 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fbe080a3440 0x7fbe080a5900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe1c1069c0 0x7fbe1c0fd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe1c101350 0x7fbe1c0fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 --2- 172.21.15.17:0/380501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe1c1009b0 0x7fbe1c0fcd70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 >> 172.21.15.17:0/380501598 conn(0x7fbe1c0fc690 msgr2=0x7fbe1c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 shutdown_connections 2024-09-16T01:13:32.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:32.985+0000 7fbe21de4640 1 -- 172.21.15.17:0/380501598 wait complete. 2024-09-16T01:13:32.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:13:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 -- 172.21.15.17:0/3272374936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc102c80 msgr2=0x7f67dc103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 --2- 172.21.15.17:0/3272374936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc102c80 0x7f67dc103060 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009900 tx=0x7f67cc02a480 comp rx=0 tx=0).stop 2024-09-16T01:13:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 -- 172.21.15.17:0/3272374936 shutdown_connections 2024-09-16T01:13:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 --2- 172.21.15.17:0/3272374936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc10c0d0 0x7f67dc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 --2- 172.21.15.17:0/3272374936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc1035a0 0x7f67dc10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 --2- 172.21.15.17:0/3272374936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc102c80 0x7f67dc103060 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 -- 172.21.15.17:0/3272374936 >> 172.21.15.17:0/3272374936 conn(0x7f67dc0fc690 msgr2=0x7f67dc0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 -- 172.21.15.17:0/3272374936 shutdown_connections 2024-09-16T01:13:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.103+0000 7f67e0b26640 1 -- 172.21.15.17:0/3272374936 wait complete. 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 Processor -- start 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 -- start start 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc102c80 0x7f67dc1008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc1035a0 0x7f67dc100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc111d60 con 0x7f67dc10c0d0 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc111be0 con 0x7f67dc102c80 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.104+0000 7f67e0b26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc111ee0 con 0x7f67dc1035a0 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59714/0 (socket says 172.21.15.17:59714) 2024-09-16T01:13:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 -- 172.21.15.17:0/1222142508 learned_addr learned my addr 172.21.15.17:0/1222142508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67d9d9b640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc1035a0 0x7f67dc100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67da59c640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc102c80 0x7f67dc1008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 -- 172.21.15.17:0/1222142508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc1035a0 msgr2=0x7f67dc100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc1035a0 0x7f67dc100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 -- 172.21.15.17:0/1222142508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc102c80 msgr2=0x7f67dc1008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc102c80 0x7f67dc1008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 -- 172.21.15.17:0/1222142508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc1a68b0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67dad9d640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f67d400cad0 tx=0x7f67d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d400ae20 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67d4005020 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d400f6b0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc1a6ba0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.105+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67dc1a70f0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.106+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc103060 con 0x7f67dc10c0d0 2024-09-16T01:13:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.108+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f67d40051d0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.108+0000 7f67cb7fe640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 0x7f67c40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.109+0000 7f67da59c640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 0x7f67c40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.109+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f67d40cfce0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.109+0000 7f67da59c640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 0x7f67c40a5900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67cc031440 tx=0x7f67cc0095f0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.113+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67d4014030 con 0x7f67dc10c0d0 2024-09-16T01:13:33.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.294+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67dc107120 con 0x7f67dc10c0d0 2024-09-16T01:13:33.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.294+0000 7f67cb7fe640 1 -- 172.21.15.17:0/1222142508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f67d409c6c0 con 0x7f67dc10c0d0 2024-09-16T01:13:33.295 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-16T01:13:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 msgr2=0x7f67c40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 0x7f67c40a5900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67cc031440 tx=0x7f67cc0095f0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 msgr2=0x7f67dc101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f67d400cad0 tx=0x7f67d400cf90 comp rx=0 tx=0).stop 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 shutdown_connections 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f67c40a3440 0x7f67c40a5900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67dc10c0d0 0x7f67dc101350 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67dc1035a0 0x7f67dc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 --2- 172.21.15.17:0/1222142508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67dc102c80 0x7f67dc1008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 >> 172.21.15.17:0/1222142508 conn(0x7f67dc0fc690 msgr2=0x7f67dc0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.296+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 shutdown_connections 2024-09-16T01:13:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.297+0000 7f67e0b26640 1 -- 172.21.15.17:0/1222142508 wait complete. 2024-09-16T01:13:33.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.410+0000 7ffacceba640 1 -- 172.21.15.17:0/791104636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8102c90 msgr2=0x7ffac8103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.410+0000 7ffacceba640 1 --2- 172.21.15.17:0/791104636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8102c90 0x7ffac8103070 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009900 tx=0x7ffab802a480 comp rx=0 tx=0).stop 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 -- 172.21.15.17:0/791104636 shutdown_connections 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 --2- 172.21.15.17:0/791104636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 0x7ffac810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 --2- 172.21.15.17:0/791104636 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac81035b0 0x7ffac810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 --2- 172.21.15.17:0/791104636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8102c90 0x7ffac8103070 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 -- 172.21.15.17:0/791104636 >> 172.21.15.17:0/791104636 conn(0x7ffac80fc6a0 msgr2=0x7ffac80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 -- 172.21.15.17:0/791104636 shutdown_connections 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 -- 172.21.15.17:0/791104636 wait complete. 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 Processor -- start 2024-09-16T01:13:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.411+0000 7ffacceba640 1 -- start start 2024-09-16T01:13:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 0x7ffac81008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 0x7ffac8101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffac8111dc0 con 0x7ffac81035b0 2024-09-16T01:13:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffac8111c40 con 0x7ffac8102c90 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffac8111f40 con 0x7ffac810c0e0 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59726/0 (socket says 172.21.15.17:59726) 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 -- 172.21.15.17:0/3905652694 learned_addr learned my addr 172.21.15.17:0/3905652694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac659c640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 0x7ffac81008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac6d9d640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 0x7ffac8101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 -- 172.21.15.17:0/3905652694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 msgr2=0x7ffac8101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 0x7ffac8101360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 -- 172.21.15.17:0/3905652694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 msgr2=0x7ffac81008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 0x7ffac81008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 -- 172.21.15.17:0/3905652694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac81a6790 con 0x7ffac81035b0 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac659c640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 0x7ffac81008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:13:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffac5d9b640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c970 tx=0x7ffabc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc007bb0 con 0x7ffac81035b0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffabc007d50 con 0x7ffac81035b0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc018780 con 0x7ffac81035b0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac81a6a80 con 0x7ffac81035b0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.412+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac81a7020 con 0x7ffac81035b0 2024-09-16T01:13:33.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.414+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac8103070 con 0x7ffac81035b0 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.415+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ffabc00f450 con 0x7ffac81035b0 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.415+0000 7ffab77fe640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 0x7ffab00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.415+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7ffabc0cfe00 con 0x7ffac81035b0 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.415+0000 7ffac659c640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 0x7ffab00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.416+0000 7ffac659c640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 0x7ffab00a5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffab8005ab0 tx=0x7ffab8000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:33.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.419+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffabc014030 con 0x7ffac81035b0 2024-09-16T01:13:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:33 smithi088 ceph-mon[34093]: from='client.16251 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:33 smithi088 ceph-mon[34093]: pgmap v348: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/4166546755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:13:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1973410291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:13:33.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:33 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/380501598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:13:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.644+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ffac802d7c0 con 0x7ffac81035b0 2024-09-16T01:13:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.652+0000 7ffab77fe640 1 -- 172.21.15.17:0/3905652694 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742872 (secure 0 0 0) 0x7ffabc00de20 con 0x7ffac81035b0 2024-09-16T01:13:33.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:33 smithi154 ceph-mon[34759]: from='client.16251 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:33 smithi154 ceph-mon[34759]: pgmap v348: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/4166546755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:13:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1973410291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:13:33.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:33 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/380501598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:13:33.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:13:33.663 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 25, 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 15225, 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1687735498 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1687735498 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/1687735498", 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2024-09-16T01:02:22.004120+0000", 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540701547738038271, 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24850, 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2024-09-16T01:13:33.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.667 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-16T01:13:33.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-16T01:13:33.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-16T01:13:33.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.681 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.685 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-16T01:13:33.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:33.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.692 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-16T01:13:33.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:33.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:13:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-16T01:13:33.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.709 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-16T01:13:33.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-16T01:13:33.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-16T01:13:33.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-16T01:13:33.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-16T01:13:33.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-16T01:13:33.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.726 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.727 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:13:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:13:33.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.741 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.752 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-16T01:13:33.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.754 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:13:33.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.767 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.768 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:13:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:13:33.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:13:33.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:13:33.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:13:33.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:33.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:13:33.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:13:33.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:13:33.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:33.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.820 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.826 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.827 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:33.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-16T01:13:33.841 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-16T01:13:33.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.843 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:13:33.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:13:33.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:13:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:13:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:13:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.856 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.859 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:33.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-16T01:13:33.864 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.867 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.869 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.871 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.882 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-16T01:13:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:13:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-16T01:13:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:13:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-16T01:13:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:13:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-16T01:13:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-16T01:13:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:13:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-16T01:13:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.011 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-16T01:13:34.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.030 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.032 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.033 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.041 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.046 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.057 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.064 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.073 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.074 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.075 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.078 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.081 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-16T01:13:34.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-16T01:13:34.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:13:34.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:13:34.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.088 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.090 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24971, 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-16T01:13:34.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-16T01:13:34.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:13:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:13:34.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:13:34.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:34.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:34.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.121 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-16T01:13:34.127 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.132 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-16T01:13:34.139 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.141 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:13:34.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-16T01:13:34.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-16T01:13:34.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-16T01:13:34.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-16T01:13:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-16T01:13:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.152 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-16T01:13:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-16T01:13:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-16T01:13:34.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-16T01:13:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.159 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:13:34.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:13:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:13:34.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:13:34.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:13:34.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:13:34.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-16T01:13:34.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:13:34.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-16T01:13:34.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-16T01:13:34.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-16T01:13:34.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-16T01:13:34.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-16T01:13:34.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.201 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-16T01:13:34.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.223 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.231 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:13:34.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-16T01:13:34.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:13:34.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:13:34.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:13:34.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:13:34.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.246 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:13:34.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:13:34.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-16T01:13:34.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-16T01:13:34.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-16T01:13:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-16T01:13:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:34.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.271 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-16T01:13:34.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-16T01:13:34.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.277 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-16T01:13:34.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.286 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-16T01:13:34.291 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:13:34.292 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:13:34.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:13:34.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.299 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.307 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.308 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.316 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-16T01:13:34.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.322 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.323 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.324 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.326 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.328 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.330 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:13:34.333 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-16T01:13:34.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-16T01:13:34.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-16T01:13:34.338 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.339 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.345 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.350 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.353 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.354 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-16T01:13:34.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.356 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.359 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.360 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-16T01:13:34.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-16T01:13:34.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.364 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.365 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.369 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.372 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.375 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-16T01:13:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.387 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.397 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-16T01:13:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-16T01:13:34.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-16T01:13:34.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:34.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.409 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.411 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-16T01:13:34.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:34.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.418 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.419 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.427 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.429 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:13:34.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.435 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.436 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-16T01:13:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.439 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.440 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-16T01:13:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-16T01:13:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:13:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-16T01:13:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "restful", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_schedule" 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:13:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:13:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-16T01:13:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-16T01:13:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-16T01:13:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-16T01:13:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-16T01:13:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-16T01:13:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-16T01:13:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-16T01:13:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-16T01:13:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:13:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:13:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-16T01:13:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-16T01:13:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:13:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-16T01:13:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-16T01:13:34.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-16T01:13:34.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-16T01:13:34.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:13:34.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-16T01:13:34.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-16T01:13:34.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.605 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.610 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:13:34.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:13:34.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-16T01:13:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-16T01:13:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.616 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-16T01:13:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:13:34.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.634 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.641 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:13:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:13:34.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:13:34.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.671 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.684 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-16T01:13:34.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.693 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.709 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-16T01:13:34.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-16T01:13:34.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-16T01:13:34.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.719 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-16T01:13:34.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-16T01:13:34.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-16T01:13:34.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:13:34.727 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.732 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.743 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.744 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:13:34.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.764 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.767 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.771 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-16T01:13:34.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.778 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.780 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.789 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.796 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.803 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-16T01:13:34.811 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.812 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.815 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-16T01:13:34.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.819 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.822 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.829 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.832 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-16T01:13:34.843 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-16T01:13:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.845 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.846 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-16T01:13:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:13:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:13:34.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.860 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.869 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.870 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.875 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.877 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.882 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-16T01:13:34.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-16T01:13:34.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.894 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-16T01:13:34.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.902 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.904 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.905 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.911 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.914 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-16T01:13:34.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.921 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-16T01:13:34.923 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:13:34.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:13:34.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:13:34.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:13:34.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.945 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.949 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.954 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:13:34.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.964 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-16T01:13:34.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-16T01:13:34.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-16T01:13:34.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2024-09-16T01:13:34.972 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-16T01:13:34.973 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-16T01:13:34.974 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-16T01:13:34.975 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "squid": [ 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-16T01:13:34.976 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 83, 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1997571453 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4134320455 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 198810884 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2586035241 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1625573431 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-16T01:13:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4081806426 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-16T01:13:34.981 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 msgr2=0x7ffab00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 0x7ffab00a5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffab8005ab0 tx=0x7ffab8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 msgr2=0x7ffac8100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c970 tx=0x7ffabc00ce30 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 shutdown_connections 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ffab00a3440 0x7ffab00a5900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac810c0e0 0x7ffac8101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac81035b0 0x7ffac8100e20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 --2- 172.21.15.17:0/3905652694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffac8102c90 0x7ffac81008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 >> 172.21.15.17:0/3905652694 conn(0x7ffac80fc6a0 msgr2=0x7ffac80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 shutdown_connections 2024-09-16T01:13:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:33.658+0000 7ffacceba640 1 -- 172.21.15.17:0/3905652694 wait complete. 2024-09-16T01:13:34.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:33 smithi017 ceph-mon[31211]: from='client.16251 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:13:34.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:33 smithi017 ceph-mon[31211]: pgmap v348: 97 pgs: 97 active+clean; 5.4 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 17 op/s 2024-09-16T01:13:34.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/4166546755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:13:34.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1973410291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:13:34.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:33 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/380501598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:13:34.984 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:34 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1222142508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:13:34.984 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:34 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3905652694' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:13:34.984 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:34 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1222142508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:13:34.984 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:34 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3905652694' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:13:34.990 DEBUG:tasks.check_counter:Getting stats from a 2024-09-16T01:13:34.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-16T01:13:34.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:34 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1222142508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:13:34.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:34 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3905652694' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:13:35.272 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:35.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:35 smithi017 ceph-mon[31211]: pgmap v349: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-09-16T01:13:35.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:35 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:13:35.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:35 smithi088 ceph-mon[34093]: pgmap v349: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-09-16T01:13:35.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:35 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:13:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:35 smithi154 ceph-mon[34759]: pgmap v349: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 26 op/s 2024-09-16T01:13:35.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:35 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:13:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 53, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 105, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 11903, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 54864, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 13, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.012325016, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.003734735, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.006063331, 2024-09-16T01:13:35.758 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000580770, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 101, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017204528, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000170341 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 92, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000043046, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000467 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 2656, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 6608 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.759 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1503, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1047, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1841543, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 540774, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.129354275, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.051342378, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.091976451, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.005295399, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1049, 2024-09-16T01:13:35.760 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.057178077, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000054507 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1889, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000385725, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000204 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1511056, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 140752 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 22, 2024-09-16T01:13:35.761 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 187, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 5549, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 493385, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 11, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.016452615, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.009721544, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.004194291, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000261917, 2024-09-16T01:13:35.762 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 184, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.020590317, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000111903 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 16, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000002413, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000150 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 2160, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 458208 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.763 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 60, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001838838, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000030647 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:35.764 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000015512, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000007756 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 5, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 4, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002250816, 2024-09-16T01:13:35.765 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000562704 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 1, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 11, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 17, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 1, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 16, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 15, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 4, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 2, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 2, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 2, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 17, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 12, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 1, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 4, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-16T01:13:35.767 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 5, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 298, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 6, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:35.768 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:35.769 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 14, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 9, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 10, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2024-09-16T01:13:35.770 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:35.771 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 8, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 8, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 2, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-16T01:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 2, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 4196848, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 7, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.013648035, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001949719 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.773 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 20, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 22, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 2, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 19, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 23, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 4, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 16, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 20, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 4, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 2, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 4, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 2, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 50624, 2024-09-16T01:13:35.774 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 223520 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 8, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 5, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 26, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 1, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-16T01:13:35.775 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001999251, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000666417 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-16T01:13:35.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000251565, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000251565 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.777 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-16T01:13:35.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.781 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.783 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:35.785 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 2, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 4, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 2, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 2, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 3, 2024-09-16T01:13:35.786 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 1, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 650, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:35.787 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:35.788 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 247185, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 84, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-16T01:13:35.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 179, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 96125, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 361, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-16T01:13:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 48, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 13365, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 32, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 48, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 48, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.214997725, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004479119 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.791 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 48, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 73 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 48, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 48, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 10, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 0, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 7, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 9, 2024-09-16T01:13:35.792 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 6, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 20, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-16T01:13:35.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-16T01:13:35.794 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 93, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 13, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 9, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 9, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 20, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 1 2024-09-16T01:13:35.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:35.796 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1574, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1699177, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1574, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1574, 2024-09-16T01:13:35.797 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1699177, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:35.798 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 48, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 13365, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 48, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 13365, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:35.799 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 48, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 48, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 48, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 48, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.801 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x562e56bfe960": { 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 8, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 2544, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 8, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 7, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 2544, 2024-09-16T01:13:35.802 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:13:36.581 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-16T01:13:36.874 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-16T01:13:36.874 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-16T01:13:36.874 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=14 2024-09-16T01:13:36.874 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-09-16T01:13:36.875 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:36.875 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:36.875 DEBUG:tasks.check_counter:Getting stats from d 2024-09-16T01:13:36.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-16T01:13:36.876 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:36 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:36.876 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:36 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:36.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:36 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:36.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:36 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:36.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:36 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:36.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:36 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:37.135 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 231, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 221, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1450992, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 135744, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-16T01:13:37.609 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.042222191, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.016051834, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.036549262, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 220, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.013899528, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000063179 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:37.610 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1450992, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 135744 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 168, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 320, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 186832, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.015433265, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.010788989, 2024-09-16T01:13:37.611 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.002039628, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 165, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.019598601, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000118779 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 186832 2024-09-16T01:13:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3040, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 448, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.003600664, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000052282, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003547495, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-16T01:13:37.613 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.006317287, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002105762 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-16T01:13:37.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:37.615 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:37.616 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149017, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 31, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-16T01:13:37.617 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-16T01:13:37.618 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 233, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1418395, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 233, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 233, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1418395, 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:37.620 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:37.620 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:37.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:37.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:37.620 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:13:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:37 smithi088 ceph-mon[34093]: pgmap v350: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-16T01:13:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:37 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:13:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:37 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:13:37.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:37 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:37 smithi154 ceph-mon[34759]: pgmap v350: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-16T01:13:37.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:37 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:13:37.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:37 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:13:37.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:37 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:37 smithi017 ceph-mon[31211]: pgmap v350: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-16T01:13:37.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:37 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:13:37.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:37 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:13:37.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:37 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' 2024-09-16T01:13:38.342 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-16T01:13:38.342 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-16T01:13:38.343 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-16T01:13:38.343 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-16T01:13:38.343 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-16T01:13:38.343 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-16T01:13:38.343 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-16T01:13:38.343 DEBUG:tasks.check_counter:Getting stats from g 2024-09-16T01:13:38.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-16T01:13:38.603 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:39.089 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1025, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1013, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1742242, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 383708, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.135402692, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.056183174, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.056973930, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.023630247, 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1012, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.057556784, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000056874 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1480416, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 136304 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1486, 2024-09-16T01:13:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1648, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 382103, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 926665, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.115624471, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.036912391, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.031103779, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.038332065, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1646, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.064928030, 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000039445 2024-09-16T01:13:39.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 455968 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 6, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1629, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 1284, 2024-09-16T01:13:39.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001363137, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000066431, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001102570, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000081096, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002133411, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000533352 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-16T01:13:39.095 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3807, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.096332369, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000025304 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-16T01:13:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-16T01:13:39.097 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 1, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 0, 2024-09-16T01:13:39.098 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:39.099 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-16T01:13:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:39.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 7, 2024-09-16T01:13:39.103 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 2, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 4196455, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 4196314, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 7 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 3, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 3, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 0, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 1, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 1, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 0, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 0, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 0, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 0, 2024-09-16T01:13:39.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 48912, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 215328 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.108 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-16T01:13:39.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-16T01:13:39.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:39.115 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.116 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.117 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 3, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 2, 2024-09-16T01:13:39.118 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 2, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 2765, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:39.119 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:39.120 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:39.121 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 197490, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 56, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 179, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 8512, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 13, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 2262, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 21, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 3, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 2262, 2024-09-16T01:13:39.123 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2262, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.364985191, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000603441 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2262, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2263 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 2262, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 2262, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 0, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-16T01:13:39.124 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 1473, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 787, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-16T01:13:39.126 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 93, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 13, 2024-09-16T01:13:39.127 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 6, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 6, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 2, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 0 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-09-16T01:13:39.128 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 2511, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1884317, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 2511, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 2511, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1884317, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 2262, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 2156, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 2262, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 2156, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.131 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 2262, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 2262, 2024-09-16T01:13:39.132 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 2262, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 2262, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:39.133 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55a89994eb40": { 2024-09-16T01:13:39.134 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:39.135 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:39.136 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:13:39.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:39 smithi017 ceph-mon[31211]: pgmap v351: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 24 op/s 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-16T01:13:39.827 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:39.828 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:39.828 DEBUG:tasks.check_counter:Getting stats from j 2024-09-16T01:13:39.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-16T01:13:39.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:39 smithi088 ceph-mon[34093]: pgmap v351: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 24 op/s 2024-09-16T01:13:39.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:39 smithi154 ceph-mon[34759]: pgmap v351: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 24 op/s 2024-09-16T01:13:40.084 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:40.584 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-16T01:13:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-16T01:13:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001212522, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000204809, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 170, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 320, 2024-09-16T01:13:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 187184, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.014315561, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.010055030, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001837954, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 167, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.019186081, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000114886 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 187184 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 236, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 224, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1454304, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 136832, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-16T01:13:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.045845213, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.016331791, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.042310033, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 224, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017046076, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000076098 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1454304, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 136832 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149017, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 31, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-16T01:13:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 234, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1418525, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 234, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 234, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1418525, 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-16T01:13:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-16T01:13:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-16T01:13:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-16T01:13:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-16T01:13:40.596 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-16T01:13:41.322 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-16T01:13:41.323 DEBUG:tasks.check_counter:Getting stats from b 2024-09-16T01:13:41.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-16T01:13:41.582 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:13:41.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:41 smithi088 ceph-mon[34093]: pgmap v352: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:41.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:41 smithi154 ceph-mon[34759]: pgmap v352: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:41.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:41 smithi017 ceph-mon[31211]: pgmap v352: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:42.076 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 3177, 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 4187, 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 2441488, 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 6187659, 2024-09-16T01:13:42.077 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 20, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.307280494, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.129079198, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.165185774, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.031133924, 2024-09-16T01:13:42.078 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4186, 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.527972630, 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000126128 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:42.079 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3752, 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000835911, 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000222 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 1515616, 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 477760 2024-09-16T01:13:42.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.081 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:42.081 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 3687, 2024-09-16T01:13:42.081 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 6420, 2024-09-16T01:13:42.081 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1345341, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 7143584, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 13, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 6, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.448605819, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.180922368, 2024-09-16T01:13:42.082 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.209161911, 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.069658535, 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 6422, 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.523180236, 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000081466 2024-09-16T01:13:42.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 7587, 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001959099, 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000258 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.084 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 45760, 2024-09-16T01:13:42.085 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 129248 2024-09-16T01:13:42.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.085 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 3966, 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 3559, 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1393435, 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 15295416, 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 108, 2024-09-16T01:13:42.086 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 6, 2024-09-16T01:13:42.087 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.431997779, 2024-09-16T01:13:42.087 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.138972233, 2024-09-16T01:13:42.087 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.183890551, 2024-09-16T01:13:42.087 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.105450614, 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3553, 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.381540302, 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000107385 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.088 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:42.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3298, 2024-09-16T01:13:42.089 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000835972, 2024-09-16T01:13:42.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000253 2024-09-16T01:13:42.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.089 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 476656, 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 131184 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2024-09-16T01:13:42.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5980, 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.643533655, 2024-09-16T01:13:42.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000274838 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:42.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 14, 2024-09-16T01:13:42.093 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000318707, 2024-09-16T01:13:42.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000022764 2024-09-16T01:13:42.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.093 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 768, 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 768, 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 768, 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 3.213505835, 2024-09-16T01:13:42.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004184252 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 0, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 344, 2024-09-16T01:13:42.095 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 0, 2024-09-16T01:13:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2024-09-16T01:13:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 41, 2024-09-16T01:13:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 13, 2024-09-16T01:13:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 28, 2024-09-16T01:13:42.096 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 22, 2024-09-16T01:13:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 0, 2024-09-16T01:13:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 3, 2024-09-16T01:13:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 3, 2024-09-16T01:13:42.097 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 2, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 812, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 797, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 0, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 0, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 0, 2024-09-16T01:13:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2024-09-16T01:13:42.100 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2024-09-16T01:13:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 0, 2024-09-16T01:13:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 0, 2024-09-16T01:13:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 0, 2024-09-16T01:13:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 0, 2024-09-16T01:13:42.101 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 4, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 234, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 6, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:42.102 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 620, 2024-09-16T01:13:42.103 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 1207, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 599, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 637, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 613, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 2, 2024-09-16T01:13:42.104 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 25 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 19, 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 0, 2024-09-16T01:13:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 40, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 2, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 3, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 1, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:42.106 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2024-09-16T01:13:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:42.107 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 2474, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 2431, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 2431, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 43, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 51, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 57, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 55, 2024-09-16T01:13:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 55, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 2, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 1, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 1, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 25061936, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 25465231, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 0, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2414, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 5.220417625, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.002162559 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 0 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 35, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 36, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 1, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 20, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 20, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 0, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 41, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 42, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 1, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 3, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 20, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 17, 2024-09-16T01:13:42.110 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 57892, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 231712 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 2026, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 1, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 768, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 36, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 2, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.004306591, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000861318 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 110, 2024-09-16T01:13:42.111 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.021273009, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000193390 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2024-09-16T01:13:42.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000465888, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000155296 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.113 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2024-09-16T01:13:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 11, 2024-09-16T01:13:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001412898, 2024-09-16T01:13:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000128445 2024-09-16T01:13:42.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 8, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.011508480, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001438560 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 11, 2024-09-16T01:13:42.116 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.054367156, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004942468 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 599, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 3.051416050, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.005094183 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.005001870, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.002500935 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.117 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.002706484, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001353242 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:42.118 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.013503374, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.006751687 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.024383638, 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004876727 2024-09-16T01:13:42.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2024-09-16T01:13:42.120 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1, 2024-09-16T01:13:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000732833, 2024-09-16T01:13:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000732833 2024-09-16T01:13:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:42.121 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.122 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2024-09-16T01:13:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.123 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.124 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2024-09-16T01:13:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 8, 2024-09-16T01:13:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.020436268, 2024-09-16T01:13:42.125 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.002554533 2024-09-16T01:13:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2024-09-16T01:13:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.126 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2024-09-16T01:13:42.127 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1, 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001991296, 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001991296 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:42.128 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.129 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 2, 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 6, 2024-09-16T01:13:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 4, 2024-09-16T01:13:42.131 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 2, 2024-09-16T01:13:42.131 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2024-09-16T01:13:42.131 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 115, 2024-09-16T01:13:42.131 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 57, 2024-09-16T01:13:42.131 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 658, 2024-09-16T01:13:42.132 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:42.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:42.133 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:42.134 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:42.135 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 330770, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 129, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:42.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 179, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 171476, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 1079, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.137 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 4209, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 22366632, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 37, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 4209, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4209, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 26.611438731, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.006322508 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2024-09-16T01:13:42.138 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4209, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 4945 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 4209, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 1, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 4208, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 324, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 25, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 1, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 2415, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 177, 2024-09-16T01:13:42.139 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 522, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 50, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:42.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 599, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2024-09-16T01:13:42.141 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 93, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 13, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 12, 2024-09-16T01:13:42.142 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 12, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 817, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 0, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 15 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 1, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 1, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 1, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed_ops": 1, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 1, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:42.144 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 10826, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 4133671, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 10826, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 10826, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 4133671, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.145 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 4209, 2024-09-16T01:13:42.146 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 22366781, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 4209, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 22366781, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:42.147 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 4209, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 4209, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 4209, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 4209, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.148 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 1, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 149, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 1, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 1, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 149, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x55c44df3c960": { 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 2474, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 21270927, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 2474, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2414, 2024-09-16T01:13:42.150 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 21270927, 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:42.151 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=19 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-16T01:13:43.064 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-16T01:13:43.064 DEBUG:tasks.check_counter:Getting stats from e 2024-09-16T01:13:43.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-16T01:13:43.314 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:13:43.715 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:43 smithi088 ceph-mon[34093]: pgmap v353: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 1238, 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 792, 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 337642, 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 300207, 2024-09-16T01:13:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 8, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.107891372, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.049254015, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.063814737, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.004370899, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 790, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.054452520, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000068927 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1868, 2024-09-16T01:13:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000404958, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000216 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 28, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 212, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 6149, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 500161, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 13, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.016252992, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.008155992, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.005874909, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000186939, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 209, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.028303047, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000135421 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 47, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000011870, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000252 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 1904, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 460896 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 314, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 301, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1504391, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 181564, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 8, 2024-09-16T01:13:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.049666147, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.017045481, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.046335128, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000405245, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 301, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.033451313, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000111133 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 19, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000002226, 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000117 2024-09-16T01:13:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 1499440, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 148560 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 47, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.002149729, 2024-09-16T01:13:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000045738 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000015249, 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000007624 2024-09-16T01:13:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 6, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 4, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000634126, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000158531 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 2, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:43.825 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 11, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 0, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 16, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 0, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 16, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 13, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 4, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:43.826 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 0, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 3, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 18, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 12, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 0, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 5, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:43.827 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:43.828 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 5, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 298, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 6, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:43.829 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 1 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 12, 2024-09-16T01:13:43.830 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 8, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 10, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:43.831 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2024-09-16T01:13:43.832 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 7, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 7, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 2, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 2, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 2, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2024-09-16T01:13:43.833 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 0, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 4194304, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 4196455, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 0, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 6, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.011062184, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001843697 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 0 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 20, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 22, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 2, 2024-09-16T01:13:43.834 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 19, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 22, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 3, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 16, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 20, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 4, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 0, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 4, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 4, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 52836, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 223520 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 7, 2024-09-16T01:13:43.835 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 6, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 17, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 0, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000353922, 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000176961 2024-09-16T01:13:43.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000280204, 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000140102 2024-09-16T01:13:43.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.838 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2024-09-16T01:13:43.839 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.840 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.841 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.843 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.844 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.846 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 1, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 3, 2024-09-16T01:13:43.847 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 2, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 1, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 3, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 1, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 679, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:43.848 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:43.849 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 255495, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 89, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 88, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 1, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2024-09-16T01:13:43.851 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 179, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 86413, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 342, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2024-09-16T01:13:43.852 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 45, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 12768, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 33, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 45, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 45, 2024-09-16T01:13:43.853 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.201995759, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.004488794 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 45, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 69 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 45, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 0, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 45, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 0, 2024-09-16T01:13:43.854 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 10, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 6, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 8, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 6, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 0, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 20, 2024-09-16T01:13:43.855 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2024-09-16T01:13:43.856 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2024-09-16T01:13:43.857 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 93, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 13, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 9, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 9, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 17, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 0, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 2 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 1, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:43.858 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 0, 2024-09-16T01:13:43.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 1576, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 1688329, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 1576, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 1576, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 1688329, 2024-09-16T01:13:43.860 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:43.861 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 45, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 12768, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 45, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 12768, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2024-09-16T01:13:43.862 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 45, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 45, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 45, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 45, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2024-09-16T01:13:43.864 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x55c4cd11e960": { 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 7, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 2151, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 7, 2024-09-16T01:13:43.865 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 6, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 2151, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:43.866 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-16T01:13:43.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:43 smithi154 ceph-mon[34759]: pgmap v353: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:43.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:43 smithi017 ceph-mon[31211]: pgmap v353: 97 pgs: 97 active+clean; 5.5 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=12 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:44.688 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:44.688 DEBUG:tasks.check_counter:Getting stats from h 2024-09-16T01:13:44.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-16T01:13:44.935 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 311, 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 326, 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1511371, 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 184764, 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 11, 2024-09-16T01:13:45.503 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.051188240, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.017880041, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.045629265, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000294400, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 325, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.028253788, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000086934 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 56, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000016897, 2024-09-16T01:13:45.504 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000301 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 1505424, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 142944 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 37, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 233, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 11024, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 509001, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 11, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 6, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.017836942, 2024-09-16T01:13:45.505 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.008509494, 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.007143039, 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.000307561, 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 231, 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.031741535, 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000137409 2024-09-16T01:13:45.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 59, 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000071318, 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000001208 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 6656, 2024-09-16T01:13:45.508 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 471744 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 1233, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 793, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 334915, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 391643, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.105614336, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.049577369, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.062451600, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.004330046, 2024-09-16T01:13:45.509 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 791, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.055155105, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000069728 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 1870, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000354487, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000189 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 54, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001449060, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000026834 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:45.511 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000013027, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000006513 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 6, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 4, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001147806, 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000286951 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 2, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 11, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 16, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 16, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:45.513 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 13, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 4, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 2, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 2, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 3, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 17, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 12, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 4, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2024-09-16T01:13:45.514 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 5, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 298, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 6, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:45.515 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:45.516 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 0 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 14, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 9, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 10, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 0, 2024-09-16T01:13:45.517 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:45.518 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 6, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 6, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 2, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 0, 2024-09-16T01:13:45.519 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 2, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 2, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 0, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 4194304, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 4196314, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 0, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 5, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.009613614, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.001922722 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 0 2024-09-16T01:13:45.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 20, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 22, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 2, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 19, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 23, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 4, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 16, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 20, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 4, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 2, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 2, 2024-09-16T01:13:45.521 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 0, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 50536, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 223520 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 6, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 6, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 22, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 0, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.522 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 4, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.001147806, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000286951 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2024-09-16T01:13:45.523 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.524 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.525 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.526 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2024-09-16T01:13:45.527 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.529 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.530 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:45.531 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.532 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.534 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 2, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 3, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 1, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 2, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 3, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 1, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 662, 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:45.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:45.536 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:45.537 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2024-09-16T01:13:45.538 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 247686, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 90, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 88, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 1, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:45.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 179, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 87069, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 336, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2024-09-16T01:13:45.540 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 43, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 12496, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 28, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 43, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 43, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.226995229, 2024-09-16T01:13:45.541 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.005278958 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 43, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 66 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 43, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 0, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 43, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2024-09-16T01:13:45.542 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 10, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 5, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 8, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 6, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:45.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 20, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2024-09-16T01:13:45.544 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2024-09-16T01:13:45.545 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 93, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 13, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 8, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 8, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 16, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 0, 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 1 2024-09-16T01:13:45.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 1, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:45.547 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 1577, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 1697349, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:45.548 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 1577, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 1577, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 1697349, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:45.549 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 43, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 12496, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 43, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 12496, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.550 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 43, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 43, 2024-09-16T01:13:45.551 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 43, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 43, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:45.552 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x562fc571e960": { 2024-09-16T01:13:45.553 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 6, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 2010, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 6, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 5, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 2010, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:45.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:45.555 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-16T01:13:45.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:45 smithi088 ceph-mon[34093]: pgmap v354: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-16T01:13:45.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:45 smithi154 ceph-mon[34759]: pgmap v354: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-16T01:13:45.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:45 smithi017 ceph-mon[31211]: pgmap v354: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 19 op/s 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=14 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-16T01:13:46.265 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:46.266 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:46.266 DEBUG:tasks.check_counter:Getting stats from k 2024-09-16T01:13:46.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-16T01:13:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 794, 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 796, 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 210597, 2024-09-16T01:13:47.066 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 252556, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 2, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.076979975, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.032473810, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.018014707, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.018707009, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 794, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.031486322, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000039655 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:47.067 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 959, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 948, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 1656044, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 365619, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.108677019, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.036664196, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.056642821, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.023586223, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 947, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.041874374, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000044217 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.069 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 1482592, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 141424 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_messages": 792, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages": 960, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_bytes": 267456, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_bytes": 708588, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_total_time": 0.110604973, 2024-09-16T01:13:47.070 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_send_time": 0.036556941, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_recv_time": 0.030023235, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_running_fast_dispatch_time": 0.032645035, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 958, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.064951070, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000067798 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.071 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "msgr_send_encrypted_bytes": 458640 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "cct": { 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "total_workers": 1, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "unhealthy_workers": 0 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-MDSRank": { 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 3796, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.115424685, 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000030406 2024-09-16T01:13:47.072 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "queue_len": 0, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "complete_latency": { 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "request": 0, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "reply": 0, 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "reply_latency": { 2024-09-16T01:13:47.073 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_reply": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "forward": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_commit": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_split": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_merge": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_top": 0, 2024-09-16T01:13:47.074 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_bottom": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_pinned": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_expired": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "subtrees": 1, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_hit": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_forward": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_discover": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "traverse_lock": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "load_cent": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "q": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "exported": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "exported_inodes": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "imported": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "imported_inodes": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rfiles": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rbytes": 0, 2024-09-16T01:13:47.076 INFO:teuthology.orchestra.run.smithi088.stdout: "root_rsnaps": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:47.077 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "process_request_cap_release": 0 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_cache": { 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_try_discover": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_send_discover": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays": 0, 2024-09-16T01:13:47.078 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_created": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_enqueued": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "strays_migrated": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_started": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_completed": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_flush": 0, 2024-09-16T01:13:47.079 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "ireq_inodestats": 0 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_log": { 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evlrg": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evadd": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evex": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evtrm": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "ev": 6, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evexg": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "evexd": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "segadd": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "segex": 0, 2024-09-16T01:13:47.080 INFO:teuthology.orchestra.run.smithi088.stdout: "segtrm": 0, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "seg": 2, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "segmjr": 2, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "segexg": 0, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "segexd": 0, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "expos": 4194304, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "wrpos": 4196314, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "rdpos": 4195921, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "jlat": { 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "replayed": 6 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_mem": { 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "ino": 3, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "ino+": 3, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "ino-": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dir": 1, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dir+": 1, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dir-": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dn": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dn+": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "dn-": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "cap": 0, 2024-09-16T01:13:47.082 INFO:teuthology.orchestra.run.smithi088.stdout: "cap+": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "cap-": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "rss": 48916, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "heap": 215328 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_server": { 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_client_request": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_request": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_client_session": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "handle_peer_request": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "req_create_latency": { 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getattr_latency": { 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "req_link_latency": { 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookup_latency": { 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupino_latency": { 2024-09-16T01:13:47.085 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupname_latency": { 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.086 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "req_lssnap_latency": { 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mkdir_latency": { 2024-09-16T01:13:47.087 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mknod_latency": { 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.088 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "req_mksnap_latency": { 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "req_open_latency": { 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "req_readdir_latency": { 2024-09-16T01:13:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rename_latency": { 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.090 INFO:teuthology.orchestra.run.smithi088.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmdir_latency": { 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.091 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setattr_latency": { 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.092 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setlayout_latency": { 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "req_setxattr_latency": { 2024-09-16T01:13:47.093 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "req_symlink_latency": { 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "req_unlink_latency": { 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.094 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_sessions": { 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "session_count": 2, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "session_add": 3, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "session_remove": 1, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_open": 2, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "sessions_stale": 0, 2024-09-16T01:13:47.095 INFO:teuthology.orchestra.run.smithi088.stdout: "total_load": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "average_load": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "avg_session_uptime": 1712, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "mempool": { 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:47.096 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:47.097 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:47.098 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_bytes": 189371, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_anon_items": 51, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_bytes": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_items": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_items": 179, 2024-09-16T01:13:47.100 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:47.100 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:47.100 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:47.100 INFO:teuthology.orchestra.run.smithi088.stdout: "pgmap_items": 0, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_bytes": 8512, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_co_items": 13, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_1_items": 0, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "unittest_2_items": 0 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "objecter": { 2024-09-16T01:13:47.101 INFO:teuthology.orchestra.run.smithi088.stdout: "op_active": 0, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_laggy": 0, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send": 2285, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_send_bytes": 21, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_resend": 3, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_reply": 2285, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_latency": { 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2285, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 1.142975745, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000500208 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.102 INFO:teuthology.orchestra.run.smithi088.stdout: "op_inflight": 0, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "oplen_avg": { 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 2285, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 2286 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "op": 2285, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "op_r": 2285, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "op_w": 0, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "op_rmw": 0, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "op_pg": 0, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_stat": 1489, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_create": 0, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_read": 794, 2024-09-16T01:13:47.103 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_write": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writefull": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_writesame": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_append": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_zero": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_truncate": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_delete": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_mapext": 0, 2024-09-16T01:13:47.104 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_getxattr": 1, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_setxattr": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_call": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_watch": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_notify": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "osdop_other": 0, 2024-09-16T01:13:47.105 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_active": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_send": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_resend": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "linger_ping": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_active": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_send": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolop_resend": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_active": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_send": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "poolstat_resend": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_active": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_send": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "statfs_resend": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "command_active": 0, 2024-09-16T01:13:47.106 INFO:teuthology.orchestra.run.smithi088.stdout: "command_send": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "command_resend": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "map_epoch": 93, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "map_full": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "map_inc": 13, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_sessions": 5, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_open": 5, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_session_close": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_laggy": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_wr": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_rd": 2, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_del": 0 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "oft": { 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_objs": 0, 2024-09-16T01:13:47.107 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_updates": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "omap_total_removes": 0 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "osd-slow-ops": { 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "slow_ops_count": 0 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "purge_queue": { 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:47.108 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_executed": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 2541, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 1889324, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 2541, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:47.109 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2541, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 1889324, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 104857600, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:47.110 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 2285, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 2015, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2285, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 2015, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:47.111 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 1024, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 2285, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 2285, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 2285, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 2285, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2024-09-16T01:13:47.113 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "throttle-write_buf_throttle-0x56144f522b40": { 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "max": 3758096384, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "get_started": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "get": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "get_sum": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:47.114 INFO:teuthology.orchestra.run.smithi088.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "take": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "take_sum": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "put": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "put_sum": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "wait": { 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "avgcount": 0, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "sum": 0.000000000, 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: "avgtime": 0.000000000 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-16T01:13:47.115 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-16T01:13:47.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:47 smithi088 ceph-mon[34093]: pgmap v355: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-16T01:13:47.892 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-16T01:13:47.892 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-16T01:13:47.893 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-16T01:13:47.893 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-16T01:13:47.893 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-16T01:13:47.893 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:47.893 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:47.893 DEBUG:tasks.check_counter:Getting stats from c 2024-09-16T01:13:47.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-16T01:13:47.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:47 smithi154 ceph-mon[34759]: pgmap v355: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-16T01:13:47.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:47 smithi017 ceph-mon[31211]: pgmap v355: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-16T01:13:48.154 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1661, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1660, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 8878275, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 527066, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.180181958, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.049436191, 2024-09-16T01:13:48.702 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.058573829, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.056285685, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1659, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.073148484, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000044091 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:13:48.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 872, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 861, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 10026984, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 336890, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.105244421, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.035029625, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.061752640, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.017244631, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 860, 2024-09-16T01:13:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.040364870, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000046935 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1481936, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 139664 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 716, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 884, 2024-09-16T01:13:48.705 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 4672146, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 686509, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.080341792, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.030740464, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.019855770, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.021474034, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 881, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.043551763, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000049434 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.706 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 459456 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-16T01:13:48.707 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5117, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.137831309, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000026935 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:48.708 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 31, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 12, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 19, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 14, 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-16T01:13:48.711 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 6, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:48.712 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:48.713 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:48.714 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:48.715 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2474, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-16T01:13:48.716 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 52, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 25061936, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 25465231, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 25457526, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.717 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 2474 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 26, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 27, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 1, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 11, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 11, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 31, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 31, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-16T01:13:48.718 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 51856, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.719 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.720 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.721 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.722 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-16T01:13:48.723 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.724 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.726 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.727 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.728 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:48.729 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 2, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 6, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 4, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 5, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-16T01:13:48.730 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 3258, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:48.731 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:48.732 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:48.733 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 198225, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 56, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 179, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 126348, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 550, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.735 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2990, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 26, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 4, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2990, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2990, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.766951754, 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000590953 2024-09-16T01:13:48.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2990, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2991 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2990, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2990, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1565, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-16T01:13:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 1422, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 2, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:48.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-16T01:13:48.740 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 6, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 6, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:48.741 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3245, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 23269382, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3245, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3245, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 23269382, 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:48.743 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:48.744 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2990, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 21270937, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2990, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 21270937, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-16T01:13:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2990, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2990, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2990, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2990, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.746 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55584ef4eb40": { 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:48.748 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:48.750 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-16T01:13:49.611 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-16T01:13:49.611 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-16T01:13:49.611 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-16T01:13:49.611 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-16T01:13:49.612 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-16T01:13:49.612 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:49.612 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:49.612 DEBUG:tasks.check_counter:Getting stats from f 2024-09-16T01:13:49.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-16T01:13:49.840 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:49 smithi154 ceph-mon[34759]: pgmap v356: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-16T01:13:49.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:49 smithi088 ceph-mon[34093]: pgmap v356: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-16T01:13:49.909 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:13:49.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:49 smithi017 ceph-mon[31211]: pgmap v356: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1045, 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1032, 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1750192, 2024-09-16T01:13:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 391494, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.134296624, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.042342669, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.067245409, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.029975189, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1032, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.053558869, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000051898 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:50.391 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1485088, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 140592 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 4, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 172, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 876, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 460154, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-16T01:13:50.392 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.010837881, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.006970599, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.002041403, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000071127, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 169, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.011453732, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000067773 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.393 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 459456 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1505, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1507, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 386043, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 478597, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.112857765, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.037008338, 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.029196818, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.039401313, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1505, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.052503751, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000034886 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.395 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3878, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.105448195, 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000027191 2024-09-16T01:13:50.396 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-16T01:13:50.397 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-16T01:13:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-16T01:13:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:50.401 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-16T01:13:50.402 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:50.403 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 8, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-16T01:13:50.404 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196848, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4196707, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.405 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 8 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-16T01:13:50.406 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48468, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-16T01:13:50.407 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.409 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:50.410 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.411 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-16T01:13:50.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.412 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.412 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.412 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:50.414 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.416 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 2, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 4, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 3, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2229, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.420 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:50.422 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181343, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 47, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:50.423 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 179, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-09-16T01:13:50.424 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2296, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2296, 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-16T01:13:50.425 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2296, 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.222966590, 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000532650 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2296, 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2297 2024-09-16T01:13:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2296, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2296, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1495, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 799, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-16T01:13:50.428 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:50.429 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-16T01:13:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-16T01:13:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-16T01:13:50.432 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:50.433 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2550, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1891632, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2550, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2550, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1891632, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2296, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2549, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2296, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2549, 2024-09-16T01:13:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:50.436 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2296, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2296, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2296, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2296, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:50.437 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55f991726b40": { 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:50.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:50.440 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:50.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:50.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:50.440 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-16T01:13:51.237 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-16T01:13:51.237 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-16T01:13:51.237 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-16T01:13:51.237 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-16T01:13:51.237 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-16T01:13:51.238 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:51.238 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:51.238 DEBUG:tasks.check_counter:Getting stats from i 2024-09-16T01:13:51.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-16T01:13:51.485 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:13:51.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:51 smithi088 ceph-mon[34093]: pgmap v357: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:51.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:51 smithi154 ceph-mon[34759]: pgmap v357: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:51.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:51 smithi017 ceph-mon[31211]: pgmap v357: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:52.009 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-16T01:13:52.009 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:52.009 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1250, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 806, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 339867, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 308948, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 8, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.088464942, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.034533962, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.055686993, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.005413596, 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 806, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.049188797, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000061028 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1894, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000352719, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000186 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 20, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 188, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 4825, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 492242, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 11, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.015856707, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.007152989, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.006571382, 2024-09-16T01:13:52.012 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000287567, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 185, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.024266114, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000131168 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 10, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000001146, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000114 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.013 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 461872 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 306, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 307, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1507462, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 182811, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-09-16T01:13:52.014 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.049606687, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.017604001, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.044721467, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000145397, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 305, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.024858565, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000081503 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 45, 2024-09-16T01:13:52.015 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000010741, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000238 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1503808, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 144688 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-16T01:13:52.016 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 32, 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002257750, 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000070554 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:52.017 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000013283, 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000006641 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.018 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 1, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 1, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-16T01:13:52.019 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 16, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 16, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 13, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 4, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-16T01:13:52.020 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 3, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 10, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 5, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 1, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 4, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-16T01:13:52.021 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 5, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 298, 2024-09-16T01:13:52.022 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 6, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:52.023 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.024 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 14, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 9, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 10, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-16T01:13:52.025 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:52.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 7, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-16T01:13:52.027 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 7, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-16T01:13:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196455, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.009949424, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001658237 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.029 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 20, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 22, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 2, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 19, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 23, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 4, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 16, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 20, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 4, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-16T01:13:52.030 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 50616, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223520 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 1, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 1, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 17, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-16T01:13:52.031 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.032 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.033 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.035 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-16T01:13:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.036 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.037 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.039 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-16T01:13:52.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.041 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.042 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 689, 2024-09-16T01:13:52.044 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:52.045 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:52.046 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:52.047 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 230003, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 69, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 179, 2024-09-16T01:13:52.048 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 86333, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 332, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-16T01:13:52.049 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 43, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 12543, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 28, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 43, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 43, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.204994457, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004767312 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-16T01:13:52.050 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 43, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 65 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 43, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 43, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 6, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 8, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-16T01:13:52.051 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-16T01:13:52.052 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-16T01:13:52.053 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 8, 2024-09-16T01:13:52.054 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 8, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-16T01:13:52.055 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:52.056 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1572, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1693079, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1572, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1572, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1693079, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 43, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 12543, 2024-09-16T01:13:52.058 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 43, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 12543, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:52.059 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 43, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 43, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 43, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 43, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.060 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:52.061 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:52.064 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55c13289e960": { 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 7, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 2151, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 7, 2024-09-16T01:13:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 6, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2151, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-16T01:13:52.723 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=14 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:52.724 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:52.724 DEBUG:tasks.check_counter:Getting stats from l 2024-09-16T01:13:52.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-16T01:13:52.975 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1048, 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1037, 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1749248, 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 394560, 2024-09-16T01:13:53.610 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.145607065, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.048562327, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.068857178, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.032223180, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1036, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.063206018, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000061009 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.611 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1483136, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 142704 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 718, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 888, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 179164, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 688708, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.089007759, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.033623085, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.020540763, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.026784180, 2024-09-16T01:13:53.612 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 886, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.050101916, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000056548 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 462224 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 800, 2024-09-16T01:13:53.613 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 802, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 211680, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 254401, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.078739743, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.032205457, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.019076426, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.019729625, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 800, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.033388967, 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000041736 2024-09-16T01:13:53.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-16T01:13:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3830, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.120668299, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000031506 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.616 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-16T01:13:53.617 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-16T01:13:53.618 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-16T01:13:53.619 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:13:53.620 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-16T01:13:53.621 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-16T01:13:53.622 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-16T01:13:53.623 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 7, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196455, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4196314, 2024-09-16T01:13:53.624 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 7 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-16T01:13:53.625 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48380, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215328 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-16T01:13:53.626 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.627 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-16T01:13:53.628 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.630 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.631 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.632 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.636 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-09-16T01:13:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2749, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:13:53.639 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:13:53.640 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 189400, 2024-09-16T01:13:53.641 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 51, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 8128, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 179, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:13:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2304, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2304, 2024-09-16T01:13:53.643 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2304, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.162968214, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000504760 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2304, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2305 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2304, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2304, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-16T01:13:53.644 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1501, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 801, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:13:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-16T01:13:53.646 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 93, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 5, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 5, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-16T01:13:53.647 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.648 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2562, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1893325, 2024-09-16T01:13:53.649 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2562, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2562, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1893325, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-16T01:13:53.650 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2304, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2156, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2304, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2156, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.651 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2304, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2304, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2304, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2304, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:53.653 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55fc9d3ecb40": { 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-16T01:13:53.654 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-16T01:13:53.655 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-16T01:13:53.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:53 smithi088 ceph-mon[34093]: pgmap v358: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:53 smithi154 ceph-mon[34759]: pgmap v358: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:53.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:53 smithi017 ceph-mon[31211]: pgmap v358: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-16T01:13:54.418 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-16T01:13:54.419 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-16T01:13:54.428 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-16T01:13:54.428 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T01:13:54.429 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:13:54.450 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T01:13:54.450 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:13:54.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:13:54.819 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/3975463624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 msgr2=0x7f6d7810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/3975463624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7810bb50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009ca0 tx=0x7f6d6802a950 comp rx=0 tx=0).stop 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/3975463624 shutdown_connections 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/3975463624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d7810c170 0x7f6d7810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/3975463624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7810bb50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/3975463624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d78102d40 0x7f6d78103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/3975463624 >> 172.21.15.17:0/3975463624 conn(0x7f6d780fc7a0 msgr2=0x7f6d780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/3975463624 shutdown_connections 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.269+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/3975463624 wait complete. 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.270+0000 7f6d7f0cb640 1 Processor -- start 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.270+0000 7f6d7f0cb640 1 -- start start 2024-09-16T01:13:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d78102d40 0x7f6d7819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7810c170 0x7f6d7819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111e20 con 0x7f6d78103660 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111ca0 con 0x7f6d7810c170 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7f0cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111fa0 con 0x7f6d78102d40 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58388/0 (socket says 172.21.15.17:58388) 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 -- 172.21.15.17:0/901708130 learned_addr learned my addr 172.21.15.17:0/901708130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7ce67640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d78102d40 0x7f6d7819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d7d668640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7810c170 0x7f6d7819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 -- 172.21.15.17:0/901708130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d78102d40 msgr2=0x7f6d7819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d78102d40 0x7f6d7819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 -- 172.21.15.17:0/901708130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7810c170 msgr2=0x7f6d7819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7810c170 0x7f6d7819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 -- 172.21.15.17:0/901708130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7819f5b0 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.271+0000 7f6d77fff640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6d68005cc0 tx=0x7f6d6802f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.272+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68034040 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.272+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d680308f0 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.272+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7819f840 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.272+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68004640 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.272+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d781a7180 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.273+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7806b070 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.274+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6d68037020 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.275+0000 7f6d75ffb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 0x7f6d640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.275+0000 7f6d7ce67640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 0x7f6d640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.275+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f6d680f0ac0 con 0x7f6d78103660 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.275+0000 7f6d7ce67640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 0x7f6d640a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d600095f0 tx=0x7f6d60005f90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.279+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d680bd550 con 0x7f6d78103660 2024-09-16T01:13:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.466+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d781a7350 con 0x7f6d78103660 2024-09-16T01:13:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.467+0000 7f6d75ffb640 1 -- 172.21.15.17:0/901708130 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v93) ==== 81+0+940 (secure 0 0 0) 0x7f6d680bce50 con 0x7f6d78103660 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4120022701 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/333607551 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3770543874 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2767834487 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/944475972 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1167321081 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/930560743 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/930560743 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3062290929 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1760357677 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4138203557 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/944475972 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:55.469 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2508292996 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:55.469 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3103598954 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.469 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1301615150 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.469 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/333607551 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:listed 16 entries 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 msgr2=0x7f6d640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 0x7f6d640a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6d600095f0 tx=0x7f6d60005f90 comp rx=0 tx=0).stop 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 msgr2=0x7f6d7819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6d68005cc0 tx=0x7f6d6802f3a0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 shutdown_connections 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6d640a33b0 0x7f6d640a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7810c170 0x7f6d7819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d78103660 0x7f6d7819ab40 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 --2- 172.21.15.17:0/901708130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d78102d40 0x7f6d7819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 >> 172.21.15.17:0/901708130 conn(0x7f6d780fc7a0 msgr2=0x7f6d78101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 shutdown_connections 2024-09-16T01:13:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:55.469+0000 7f6d7f0cb640 1 -- 172.21.15.17:0/901708130 wait complete. 2024-09-16T01:13:55.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:55 smithi088 ceph-mon[34093]: pgmap v359: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-16T01:13:55.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:55 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/901708130' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:55 smithi154 ceph-mon[34759]: pgmap v359: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-16T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:55 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/901708130' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:55 smithi017 ceph-mon[31211]: pgmap v359: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-16T01:13:55.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:55 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/901708130' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:56.265 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-16T01:13:56.265 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:13:56.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:13:56.585 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- 172.21.15.17:0/1975919941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 msgr2=0x7f9bdc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 --2- 172.21.15.17:0/1975919941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc106e60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009930 tx=0x7f9bcc02a420 comp rx=0 tx=0).stop 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- 172.21.15.17:0/1975919941 shutdown_connections 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 --2- 172.21.15.17:0/1975919941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 0x7f9bdc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 --2- 172.21.15.17:0/1975919941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 0x7f9bdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 --2- 172.21.15.17:0/1975919941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc106e60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- 172.21.15.17:0/1975919941 >> 172.21.15.17:0/1975919941 conn(0x7f9bdc0fc7a0 msgr2=0x7f9bdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- 172.21.15.17:0/1975919941 shutdown_connections 2024-09-16T01:13:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- 172.21.15.17:0/1975919941 wait complete. 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 Processor -- start 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.057+0000 7f9be26a2640 1 -- start start 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 0x7f9bdc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 0x7f9bdc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc110d30 con 0x7f9bdc106a80 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc110bb0 con 0x7f9bdc100a80 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be26a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc110eb0 con 0x7f9bdc101420 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58412/0 (socket says 172.21.15.17:58412) 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 -- 172.21.15.17:0/2399306416 learned_addr learned my addr 172.21.15.17:0/2399306416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9bd3fff640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 0x7f9bdc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9bdbfff640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 0x7f9bdc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 -- 172.21.15.17:0/2399306416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 msgr2=0x7f9bdc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 0x7f9bdc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 -- 172.21.15.17:0/2399306416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 msgr2=0x7f9bdc1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 0x7f9bdc1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 -- 172.21.15.17:0/2399306416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc19d360 con 0x7f9bdc106a80 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9be0c3f640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400eaa0 tx=0x7f9bd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.058+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd400cdb0 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.059+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc19d650 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.059+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bd4005020 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.059+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40116d0 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.059+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc1a4f30 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.060+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc100ee0 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.061+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9bd40051d0 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.062+0000 7f9bd9ffb640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 0x7f9bc80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.062+0000 7f9bdbfff640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 0x7f9bc80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.062+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f9bd40cfe30 con 0x7f9bdc106a80 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.062+0000 7f9bdbfff640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 0x7f9bc80a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc000c00 tx=0x7f9bcc032c80 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.066+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bd4016030 con 0x7f9bdc106a80 2024-09-16T01:13:57.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.254+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9bdc02d7c0 con 0x7f9bdc106a80 2024-09-16T01:13:57.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.255+0000 7f9bd9ffb640 1 -- 172.21.15.17:0/2399306416 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v93) ==== 81+0+940 (secure 0 0 0) 0x7f9bd409c810 con 0x7f9bdc106a80 2024-09-16T01:13:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4120022701 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/333607551 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3770543874 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2767834487 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/944475972 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1167321081 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/930560743 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/930560743 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3062290929 2024-09-17T00:53:09.103759+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1760357677 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4138203557 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/944475972 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2508292996 2024-09-17T00:53:32.835388+0000 2024-09-16T01:13:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3103598954 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1301615150 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/333607551 2024-09-17T01:02:22.003910+0000 2024-09-16T01:13:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:listed 16 entries 2024-09-16T01:13:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 msgr2=0x7f9bc80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 0x7f9bc80a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc000c00 tx=0x7f9bcc032c80 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 msgr2=0x7f9bdc19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400eaa0 tx=0x7f9bd400ef60 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 shutdown_connections 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f9bc80a33b0 0x7f9bc80a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc106a80 0x7f9bdc19cc80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bdc101420 0x7f9bdc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 --2- 172.21.15.17:0/2399306416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc100a80 0x7f9bdc1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 >> 172.21.15.17:0/2399306416 conn(0x7f9bdc0fc7a0 msgr2=0x7f9bdc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 shutdown_connections 2024-09-16T01:13:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:13:57.257+0000 7f9be26a2640 1 -- 172.21.15.17:0/2399306416 wait complete. 2024-09-16T01:13:57.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-16T01:13:57.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:13:57.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-16T01:13:57.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[80659]: fuse finished with error 0 and tester_r 0 2024-09-16T01:13:57.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:13:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:57 smithi088 ceph-mon[34093]: pgmap v360: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:13:57.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:57 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2399306416' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:57 smithi154 ceph-mon[34759]: pgmap v360: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:13:57.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:57 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2399306416' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:57 smithi017 ceph-mon[31211]: pgmap v360: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:13:57.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:57 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2399306416' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:13:59.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:13:59 smithi088 ceph-mon[34093]: pgmap v361: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:13:59.901 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:13:59 smithi154 ceph-mon[34759]: pgmap v361: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:13:59.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:13:59 smithi017 ceph-mon[31211]: pgmap v361: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-16T01:14:01.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:01 smithi088 ceph-mon[34093]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:01.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:01 smithi154 ceph-mon[34759]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:01.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:01 smithi017 ceph-mon[31211]: pgmap v362: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:03.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:03 smithi088 ceph-mon[34093]: pgmap v363: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:03.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:03 smithi154 ceph-mon[34759]: pgmap v363: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:03.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:03 smithi017 ceph-mon[31211]: pgmap v363: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-16T01:14:03.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:14:03.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:14:03.973 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:14:04.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:14:04.001 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-16T01:14:04.061 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:14:04.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:14:04.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:14:04.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:14:04.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-16T01:14:04.221 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T01:14:04.231 INFO:tasks.cephadm:Teardown begin 2024-09-16T01:14:04.232 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:14:04.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:14:04.497 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 -- 172.21.15.17:0/1514817567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 msgr2=0x7ffa0c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 --2- 172.21.15.17:0/1514817567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c1021c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009900 tx=0x7ff9fc02a3f0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 -- 172.21.15.17:0/1514817567 shutdown_connections 2024-09-16T01:14:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 --2- 172.21.15.17:0/1514817567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 0x7ffa0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 --2- 172.21.15.17:0/1514817567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 0x7ffa0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 --2- 172.21.15.17:0/1514817567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c1021c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 -- 172.21.15.17:0/1514817567 >> 172.21.15.17:0/1514817567 conn(0x7ffa0c0fd8c0 msgr2=0x7ffa0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 -- 172.21.15.17:0/1514817567 shutdown_connections 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.000+0000 7ffa10d73640 1 -- 172.21.15.17:0/1514817567 wait complete. 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 Processor -- start 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 -- start start 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 0x7ffa0c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111e30 con 0x7ffa0c101de0 2024-09-16T01:14:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111cb0 con 0x7ffa0c106f10 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa10d73640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111fb0 con 0x7ffa0c102790 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38168/0 (socket says 172.21.15.17:38168) 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa0a59c640 1 -- 172.21.15.17:0/338035690 learned_addr learned my addr 172.21.15.17:0/338035690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa09d9b640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 0x7ffa0c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.001+0000 7ffa0ad9d640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 -- 172.21.15.17:0/338035690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 msgr2=0x7ffa0c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 0x7ffa0c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 -- 172.21.15.17:0/338035690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 msgr2=0x7ffa0c19cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 -- 172.21.15.17:0/338035690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c19d220 con 0x7ffa0c101de0 2024-09-16T01:14:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa0a59c640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc005ab0 tx=0x7ff9fc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc03f070 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9fc031d60 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c19d4b0 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc035030 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.002+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c1a4df0 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.003+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0c1032c0 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.004+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff9fc042070 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.005+0000 7ff9fb7fe640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 0x7ff9f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.005+0000 7ffa09d9b640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 0x7ff9f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.005+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7ff9fc0f0730 con 0x7ffa0c101de0 2024-09-16T01:14:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.005+0000 7ffa09d9b640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 0x7ff9f40a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c1088e0 tx=0x7ffa0000a2d0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:05.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.009+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9fc0bd110 con 0x7ffa0c101de0 2024-09-16T01:14:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.219+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa0c10a0f0 con 0x7ffa0c101de0 2024-09-16T01:14:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.220+0000 7ff9fb7fe640 1 -- 172.21.15.17:0/338035690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11966 (secure 0 0 0) 0x7ff9fc0bca10 con 0x7ffa0c101de0 2024-09-16T01:14:05.222 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:14:05.222 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-16T01:02:21:240015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:02:21.189843+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24464,24503,24472,24482,24515]},"id":1}]} 2024-09-16T01:14:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-16T01:14:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.222+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 msgr2=0x7ff9f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.222+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 0x7ff9f40a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c1088e0 tx=0x7ffa0000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.222+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 msgr2=0x7ffa0c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.222+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc005ab0 tx=0x7ff9fc003d50 comp rx=0 tx=0).stop 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 shutdown_connections 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff9f40a33b0 0x7ff9f40a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa0c102790 0x7ffa0c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 --2- 172.21.15.17:0/338035690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198270 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 >> 172.21.15.17:0/338035690 conn(0x7ffa0c0fd8c0 msgr2=0x7ffa0c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 shutdown_connections 2024-09-16T01:14:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:05.223+0000 7ffa10d73640 1 -- 172.21.15.17:0/338035690 wait complete. 2024-09-16T01:14:05.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:05 smithi088 ceph-mon[34093]: pgmap v364: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:14:05.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:05 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/338035690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:05.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:05 smithi154 ceph-mon[34759]: pgmap v364: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:14:05.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:05 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/338035690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:05 smithi017 ceph-mon[31211]: pgmap v364: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 48 KiB/s wr, 31 op/s 2024-09-16T01:14:05.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:05 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/338035690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:06.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:14:06.268 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 -- 172.21.15.17:0/2132246662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 msgr2=0x7f3ed810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 --2- 172.21.15.17:0/2132246662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed810bb50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009900 tx=0x7f3ec402a480 comp rx=0 tx=0).stop 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 -- 172.21.15.17:0/2132246662 shutdown_connections 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 --2- 172.21.15.17:0/2132246662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed810c170 0x7f3ed810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 --2- 172.21.15.17:0/2132246662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed810bb50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 --2- 172.21.15.17:0/2132246662 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed8102d40 0x7f3ed8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 -- 172.21.15.17:0/2132246662 >> 172.21.15.17:0/2132246662 conn(0x7f3ed80fc7a0 msgr2=0x7f3ed80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 -- 172.21.15.17:0/2132246662 shutdown_connections 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.746+0000 7f3edf22b640 1 -- 172.21.15.17:0/2132246662 wait complete. 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 Processor -- start 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 -- start start 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 0x7f3ed81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed810c170 0x7f3ed8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8111e60 con 0x7f3ed8103660 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8111ce0 con 0x7f3ed810c170 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edf22b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8111fe0 con 0x7f3ed8102d40 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3ed7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3ed7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38190/0 (socket says 172.21.15.17:38190) 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3ed7fff640 1 -- 172.21.15.17:0/3138159948 learned_addr learned my addr 172.21.15.17:0/3138159948 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edd7c8640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed810c170 0x7f3ed8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.747+0000 7f3edcfc7640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 0x7f3ed81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 -- 172.21.15.17:0/3138159948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 msgr2=0x7f3ed81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 0x7f3ed81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 -- 172.21.15.17:0/3138159948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed810c170 msgr2=0x7f3ed8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed810c170 0x7f3ed8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 -- 172.21.15.17:0/3138159948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed81a6810 con 0x7f3ed8103660 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3edcfc7640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 0x7f3ed81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed7fff640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006010 tx=0x7f3ec40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec403f030 con 0x7f3ed8103660 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed81a6aa0 con 0x7f3ed8103660 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ec4003800 con 0x7f3ed8103660 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4035070 con 0x7f3ed8103660 2024-09-16T01:14:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.748+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81a6f80 con 0x7f3ed8103660 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.749+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed8103120 con 0x7f3ed8103660 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.751+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3ec4031af0 con 0x7f3ed8103660 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.752+0000 7f3ed5ffb640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 0x7f3ec80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.752+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7f3ec40f08e0 con 0x7f3ed8103660 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.752+0000 7f3edcfc7640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 0x7f3ec80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.752+0000 7f3edcfc7640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 0x7f3ec80a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00baa0 tx=0x7f3ecc005d90 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.755+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ec40bd260 con 0x7f3ed8103660 2024-09-16T01:14:06.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.970+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ed81071e0 con 0x7f3ed8103660 2024-09-16T01:14:06.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.970+0000 7f3ed5ffb640 1 -- 172.21.15.17:0/3138159948 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11966 (secure 0 0 0) 0x7f3ec40bcb60 con 0x7f3ed8103660 2024-09-16T01:14:06.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:14:06.972 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-16T01:02:21:240015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2859386479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2859386479},{"type":"v1","addr":"172.21.15.17:6835","nonce":2859386479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2668055103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2668055103},{"type":"v1","addr":"172.21.15.17:6837","nonce":2668055103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:00:29.073506+0000","modified":"2024-09-16T01:02:21.189843+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24503,"mds_2":24482,"mds_3":24472,"mds_4":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14604":{"gid":14604,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2587837863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2587837863},{"type":"v1","addr":"172.21.15.17:6839","nonce":2587837863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/1776584751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1776584751},{"type":"v1","addr":"172.21.15.154:6833","nonce":1776584751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.88:6833/764220258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":764220258},{"type":"v1","addr":"172.21.15.88:6833","nonce":764220258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/3320793854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3320793854},{"type":"v1","addr":"172.21.15.154:6835","nonce":3320793854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6837/3615564777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3615564777},{"type":"v1","addr":"172.21.15.154:6837","nonce":3615564777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.88:6835/2889832205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2889832205},{"type":"v1","addr":"172.21.15.88:6835","nonce":2889832205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1732406243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1732406243},{"type":"v1","addr":"172.21.15.154:6839","nonce":1732406243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.88:6837/51927101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":51927101},{"type":"v1","addr":"172.21.15.88:6837","nonce":51927101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.17:6841/2275099611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2275099611},{"type":"v1","addr":"172.21.15.17:6841","nonce":2275099611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6839/2954076302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6838","nonce":2954076302},{"type":"v1","addr":"172.21.15.88:6839","nonce":2954076302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24464,24503,24472,24482,24515]},"id":1}]} 2024-09-16T01:14:06.973 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-16T01:14:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 msgr2=0x7f3ec80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 0x7f3ec80a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00baa0 tx=0x7f3ecc005d90 comp rx=0 tx=0).stop 2024-09-16T01:14:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 msgr2=0x7f3ed8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006010 tx=0x7f3ec40042f0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 shutdown_connections 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f3ec80a33b0 0x7f3ec80a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ed810c170 0x7f3ed8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ed8103660 0x7f3ed8100ee0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 --2- 172.21.15.17:0/3138159948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed8102d40 0x7f3ed81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 >> 172.21.15.17:0/3138159948 conn(0x7f3ed80fc7a0 msgr2=0x7f3ed80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 shutdown_connections 2024-09-16T01:14:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:06.973+0000 7f3edf22b640 1 -- 172.21.15.17:0/3138159948 wait complete. 2024-09-16T01:14:07.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:14:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:07.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:07 smithi017 ceph-mon[31211]: pgmap v365: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-16T01:14:07.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:07 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3138159948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:07.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:07 smithi088 ceph-mon[34093]: pgmap v365: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-16T01:14:07.893 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:07 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3138159948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:07.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:07 smithi154 ceph-mon[34759]: pgmap v365: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-16T01:14:07.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:07 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3138159948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:14:08.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.392+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3659946281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0102d30 msgr2=0x7fddf0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.392+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3659946281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0102d30 0x7fddf0103110 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009930 tx=0x7fdde002a420 comp rx=0 tx=0).stop 2024-09-16T01:14:08.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3659946281 shutdown_connections 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3659946281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf01082a0 0x7fddf010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3659946281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 0x7fddf0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3659946281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0102d30 0x7fddf0103110 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3659946281 >> 172.21.15.17:0/3659946281 conn(0x7fddf00fc7d0 msgr2=0x7fddf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3659946281 shutdown_connections 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3659946281 wait complete. 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 Processor -- start 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.393+0000 7fddf4aa2640 1 -- start start 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 0x7fddf0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 0x7fddf0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0111f90 con 0x7fddf01082a0 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0111e10 con 0x7fddf0102d30 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddf4aa2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0112110 con 0x7fddf01036e0 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38210/0 (socket says 172.21.15.17:38210) 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 -- 172.21.15.17:0/3397923364 learned_addr learned my addr 172.21.15.17:0/3397923364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddedd9b640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 0x7fddf0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddee59c640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 0x7fddf0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 -- 172.21.15.17:0/3397923364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 msgr2=0x7fddf0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 0x7fddf0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 -- 172.21.15.17:0/3397923364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 msgr2=0x7fddf0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 0x7fddf0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 -- 172.21.15.17:0/3397923364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf01a68a0 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddee59c640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 0x7fddf0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.394+0000 7fddeed9d640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdde800cce0 tx=0x7fdde800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.395+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f450 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.395+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf01a6b90 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.395+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdde800faa0 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.395+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8018a80 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.395+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf01a70d0 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.396+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf006a850 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.397+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdde800fc50 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.398+0000 7fdddf7fe640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 0x7fddd80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.398+0000 7fddee59c640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 0x7fddd80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.398+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8513+0+0 (secure 0 0 0) 0x7fdde80d03c0 con 0x7fddf01082a0 2024-09-16T01:14:08.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.398+0000 7fddee59c640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 0x7fddd80a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006010 tx=0x7fdde0000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:08.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.405+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdde8014030 con 0x7fddf01082a0 2024-09-16T01:14:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.583+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddf0103110 con 0x7fddf01082a0 2024-09-16T01:14:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.584+0000 7fdddf7fe640 1 -- 172.21.15.17:0/3397923364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23106 (secure 0 0 0) 0x7fdde8098030 con 0x7fddf01082a0 2024-09-16T01:14:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-16T01:14:08.586 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":93,"fsid":"d67bb9a6-73c5-11ef-bceb-c7b262605968","created":"2024-09-16T00:52:47.071991+0000","modified":"2024-09-16T01:13:12.141387+0000","last_up_change":"2024-09-16T00:59:36.773679+0000","last_in_change":"2024-09-16T00:59:13.373005+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:55:49.344475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:00:25.290298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:00:27.415501+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df210cfa-2f35-4f3b-b149-52700132d8f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6803","nonce":1660486395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6805","nonce":1660486395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6809","nonce":1660486395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1660486395},{"type":"v1","addr":"172.21.15.17:6807","nonce":1660486395}]},"public_addr":"172.21.15.17:6803/1660486395","cluster_addr":"172.21.15.17:6805/1660486395","heartbeat_back_addr":"172.21.15.17:6809/1660486395","heartbeat_front_addr":"172.21.15.17:6807/1660486395","state":["exists","up"]},{"osd":1,"uuid":"f2edb955-6522-41b5-955a-cc55dfcbc826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6801","nonce":2469077193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6803","nonce":2469077193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6807","nonce":2469077193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2469077193},{"type":"v1","addr":"172.21.15.88:6805","nonce":2469077193}]},"public_addr":"172.21.15.88:6801/2469077193","cluster_addr":"172.21.15.88:6803/2469077193","heartbeat_back_addr":"172.21.15.88:6807/2469077193","heartbeat_front_addr":"172.21.15.88:6805/2469077193","state":["exists","up"]},{"osd":2,"uuid":"83ea9ade-f366-48d6-bccb-f83f659606c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6801","nonce":634195580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6803","nonce":634195580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6807","nonce":634195580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":634195580},{"type":"v1","addr":"172.21.15.154:6805","nonce":634195580}]},"public_addr":"172.21.15.154:6801/634195580","cluster_addr":"172.21.15.154:6803/634195580","heartbeat_back_addr":"172.21.15.154:6807/634195580","heartbeat_front_addr":"172.21.15.154:6805/634195580","state":["exists","up"]},{"osd":3,"uuid":"7e314fac-8a90-4825-9461-14e0385931bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6811","nonce":920279967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6813","nonce":920279967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6817","nonce":920279967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":920279967},{"type":"v1","addr":"172.21.15.17:6815","nonce":920279967}]},"public_addr":"172.21.15.17:6811/920279967","cluster_addr":"172.21.15.17:6813/920279967","heartbeat_back_addr":"172.21.15.17:6817/920279967","heartbeat_front_addr":"172.21.15.17:6815/920279967","state":["exists","up"]},{"osd":4,"uuid":"5e9b8546-35c0-4ef7-a5ef-a48e8c9a5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6809","nonce":1483055508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6811","nonce":1483055508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6815","nonce":1483055508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1483055508},{"type":"v1","addr":"172.21.15.88:6813","nonce":1483055508}]},"public_addr":"172.21.15.88:6809/1483055508","cluster_addr":"172.21.15.88:6811/1483055508","heartbeat_back_addr":"172.21.15.88:6815/1483055508","heartbeat_front_addr":"172.21.15.88:6813/1483055508","state":["exists","up"]},{"osd":5,"uuid":"88c11364-316e-4f0b-8e9a-e81777fc1c69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6809","nonce":995559400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6811","nonce":995559400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6815","nonce":995559400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":995559400},{"type":"v1","addr":"172.21.15.154:6813","nonce":995559400}]},"public_addr":"172.21.15.154:6809/995559400","cluster_addr":"172.21.15.154:6811/995559400","heartbeat_back_addr":"172.21.15.154:6815/995559400","heartbeat_front_addr":"172.21.15.154:6813/995559400","state":["exists","up"]},{"osd":6,"uuid":"cc10686b-395d-47c7-981e-096599f67648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6819","nonce":2722817993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6821","nonce":2722817993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6825","nonce":2722817993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2722817993},{"type":"v1","addr":"172.21.15.17:6823","nonce":2722817993}]},"public_addr":"172.21.15.17:6819/2722817993","cluster_addr":"172.21.15.17:6821/2722817993","heartbeat_back_addr":"172.21.15.17:6825/2722817993","heartbeat_front_addr":"172.21.15.17:6823/2722817993","state":["exists","up"]},{"osd":7,"uuid":"f9f171b1-68c5-4ab6-94c0-13647aa06ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6817","nonce":1774608231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6819","nonce":1774608231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6823","nonce":1774608231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1774608231},{"type":"v1","addr":"172.21.15.88:6821","nonce":1774608231}]},"public_addr":"172.21.15.88:6817/1774608231","cluster_addr":"172.21.15.88:6819/1774608231","heartbeat_back_addr":"172.21.15.88:6823/1774608231","heartbeat_front_addr":"172.21.15.88:6821/1774608231","state":["exists","up"]},{"osd":8,"uuid":"9dc9ff0e-49eb-4681-a903-eb42ed1853ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6817","nonce":307626373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6819","nonce":307626373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6823","nonce":307626373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":307626373},{"type":"v1","addr":"172.21.15.154:6821","nonce":307626373}]},"public_addr":"172.21.15.154:6817/307626373","cluster_addr":"172.21.15.154:6819/307626373","heartbeat_back_addr":"172.21.15.154:6823/307626373","heartbeat_front_addr":"172.21.15.154:6821/307626373","state":["exists","up"]},{"osd":9,"uuid":"7cdac651-4624-4fac-95de-1cfce92a9be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6827","nonce":2711605096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6829","nonce":2711605096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6833","nonce":2711605096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2711605096},{"type":"v1","addr":"172.21.15.17:6831","nonce":2711605096}]},"public_addr":"172.21.15.17:6827/2711605096","cluster_addr":"172.21.15.17:6829/2711605096","heartbeat_back_addr":"172.21.15.17:6833/2711605096","heartbeat_front_addr":"172.21.15.17:6831/2711605096","state":["exists","up"]},{"osd":10,"uuid":"c69a732f-1e22-4163-9c9d-ed8bac4d6a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6825","nonce":40654334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6827","nonce":40654334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6831","nonce":40654334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":40654334},{"type":"v1","addr":"172.21.15.88:6829","nonce":40654334}]},"public_addr":"172.21.15.88:6825/40654334","cluster_addr":"172.21.15.88:6827/40654334","heartbeat_back_addr":"172.21.15.88:6831/40654334","heartbeat_front_addr":"172.21.15.88:6829/40654334","state":["exists","up"]},{"osd":11,"uuid":"19cb97fa-bfa5-4cee-8c01-9747633a2d8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6825","nonce":2457783951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6827","nonce":2457783951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6831","nonce":2457783951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2457783951},{"type":"v1","addr":"172.21.15.154:6829","nonce":2457783951}]},"public_addr":"172.21.15.154:6825/2457783951","cluster_addr":"172.21.15.154:6827/2457783951","heartbeat_back_addr":"172.21.15.154:6831/2457783951","heartbeat_front_addr":"172.21.15.154:6829/2457783951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:54:56.446256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:22.249084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:55:46.628210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:12.283540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:56:37.802617+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:03.295871+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:28.570462+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:57:54.158096+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:18.599743+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:58:44.555574+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:10.141791+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:59:35.206571+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/4120022701":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6801/333607551":"2024-09-17T01:02:22.003910+0000","172.21.15.17:0/3770543874":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/2767834487":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/1167321081":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6800/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:6801/930560743":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/3062290929":"2024-09-17T00:53:09.103759+0000","172.21.15.17:0/1760357677":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/4138203557":"2024-09-17T00:53:32.835388+0000","172.21.15.17:6800/944475972":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/2508292996":"2024-09-17T00:53:32.835388+0000","172.21.15.17:0/3103598954":"2024-09-17T01:02:22.003910+0000","172.21.15.17:0/1301615150":"2024-09-17T01:02:22.003910+0000","172.21.15.17:6800/333607551":"2024-09-17T01:02:22.003910+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.586+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 msgr2=0x7fddd80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.586+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 0x7fddd80a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006010 tx=0x7fdde0000bc0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.586+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 msgr2=0x7fddf0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.586+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdde800cce0 tx=0x7fdde800a620 comp rx=0 tx=0).stop 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 shutdown_connections 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fddd80a33b0 0x7fddd80a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf01082a0 0x7fddf0101410 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf01036e0 0x7fddf0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 --2- 172.21.15.17:0/3397923364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf0102d30 0x7fddf0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 >> 172.21.15.17:0/3397923364 conn(0x7fddf00fc7d0 msgr2=0x7fddf0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 shutdown_connections 2024-09-16T01:14:08.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:08.587+0000 7fddf4aa2640 1 -- 172.21.15.17:0/3397923364 wait complete. 2024-09-16T01:14:08.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:08 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3397923364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:14:08.918 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:08 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3397923364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:14:09.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:08 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3397923364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:14:09.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-16T01:14:09.522 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:09.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:09 smithi154 ceph-mon[34759]: pgmap v366: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:14:09.904 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:09 smithi154 ceph-mon[34759]: osdmap e94: 12 total, 12 up, 12 in 2024-09-16T01:14:09.927 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:09 smithi017 ceph-mon[31211]: pgmap v366: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:14:09.927 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:09 smithi017 ceph-mon[31211]: osdmap e94: 12 total, 12 up, 12 in 2024-09-16T01:14:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 -- 172.21.15.17:0/3570973687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d0101280 msgr2=0x7f21d010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 --2- 172.21.15.17:0/3570973687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d0101280 0x7f21d010df40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009900 tx=0x7f21c002a410 comp rx=0 tx=0).stop 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 -- 172.21.15.17:0/3570973687 shutdown_connections 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 --2- 172.21.15.17:0/3570973687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d010e480 0x7f21d0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 --2- 172.21.15.17:0/3570973687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d0101280 0x7f21d010df40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 --2- 172.21.15.17:0/3570973687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d01008d0 0x7f21d0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 -- 172.21.15.17:0/3570973687 >> 172.21.15.17:0/3570973687 conn(0x7f21d00fc7a0 msgr2=0x7f21d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 -- 172.21.15.17:0/3570973687 shutdown_connections 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.009+0000 7f21d7873640 1 -- 172.21.15.17:0/3570973687 wait complete. 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 Processor -- start 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 -- start start 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0101280 0x7f21d019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:10.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d010e480 0x7f21d019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21d01140b0 con 0x7f21d01008d0 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113f30 con 0x7f21d0101280 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d7873640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0114230 con 0x7f21d010e480 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d560f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d560f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38214/0 (socket says 172.21.15.17:38214) 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.010+0000 7f21d560f640 1 -- 172.21.15.17:0/2777124677 learned_addr learned my addr 172.21.15.17:0/2777124677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d4e0e640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0101280 0x7f21d019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d5e10640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d010e480 0x7f21d019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 -- 172.21.15.17:0/2777124677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d010e480 msgr2=0x7f21d019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d010e480 0x7f21d019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 -- 172.21.15.17:0/2777124677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0101280 msgr2=0x7f21d019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0101280 0x7f21d019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 -- 172.21.15.17:0/2777124677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d019f600 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d560f640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b4a0 tx=0x7f21cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc014070 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21cc010ac0 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc017c30 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d019f8f0 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.011+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d01a71d0 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.012+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d0100cb0 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.013+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f21cc017070 con 0x7f21d01008d0 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.014+0000 7f21c67fc640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 0x7f21bc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.014+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f21cc0cf360 con 0x7f21d01008d0 2024-09-16T01:14:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.014+0000 7f21d4e0e640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 0x7f21bc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.015+0000 7f21d4e0e640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 0x7f21bc0a58f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c0031440 tx=0x7f21c0005b50 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.017+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21cc09be30 con 0x7f21d01008d0 2024-09-16T01:14:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:09 smithi088 ceph-mon[34093]: pgmap v366: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-16T01:14:10.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:09 smithi088 ceph-mon[34093]: osdmap e94: 12 total, 12 up, 12 in 2024-09-16T01:14:10.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.231+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f21d0109670 con 0x7f21d01008d0 2024-09-16T01:14:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.233+0000 7f21c67fc640 1 -- 172.21.15.17:0/2777124677 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f21cc09b730 con 0x7f21d01008d0 2024-09-16T01:14:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 msgr2=0x7f21bc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 0x7f21bc0a58f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21c0031440 tx=0x7f21c0005b50 comp rx=0 tx=0).stop 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 msgr2=0x7f21d019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b4a0 tx=0x7f21cc00b960 comp rx=0 tx=0).stop 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 shutdown_connections 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f21bc0a3430 0x7f21bc0a58f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d010e480 0x7f21d019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21d0101280 0x7f21d019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 --2- 172.21.15.17:0/2777124677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21d01008d0 0x7f21d019a650 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 >> 172.21.15.17:0/2777124677 conn(0x7f21d00fc7a0 msgr2=0x7f21d00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 shutdown_connections 2024-09-16T01:14:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:10.237+0000 7f21d7873640 1 -- 172.21.15.17:0/2777124677 wait complete. 2024-09-16T01:14:10.623 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-16T01:14:10.232+0000 7f839a7c5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mds[69838]: -- 172.21.15.17:0/1125067497 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa74c29860 con 0x55fa74c06800 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: starting mds.a at 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mds[69449]: -- 172.21.15.17:0/2832199256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a5189fc20 con 0x560a5187d000 2024-09-16T01:14:10.624 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: starting mds.g at 2024-09-16T01:14:10.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mds[64364]: -- 172.21.15.88:0/2561596450 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5f7ce5860 con 0x55b5f7cc3000 2024-09-16T01:14:10.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: starting mds.b at 2024-09-16T01:14:10.643 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mds[64049]: -- 172.21.15.88:0/756780012 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561773adb860 con 0x561773ab9400 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: starting mds.h at 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mds[63443]: -- 172.21.15.88:0/4198636901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bc0c35d860 con 0x55bc0c33a800 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: starting mds.k at 2024-09-16T01:14:10.644 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.645 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.645 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mds[63743]: -- 172.21.15.88:0/4066220691 <== mon.2 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d5408e8680 con 0x55d5408bc800 2024-09-16T01:14:10.645 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mds[63743]: -- 172.21.15.88:0/4066220691 <== mon.2 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5408df860 con 0x55d5408bc800 2024-09-16T01:14:10.645 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: starting mds.e at 2024-09-16T01:14:10.653 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mds[64776]: -- 172.21.15.154:0/3776409385 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d9f733c20 con 0x564d9f710800 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: starting mds.f at 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mds[64472]: -- 172.21.15.154:0/2569359914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584877b5860 con 0x558487792800 2024-09-16T01:14:10.654 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: starting mds.l at 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mds[65076]: -- 172.21.15.154:0/1410777239 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c768651860 con 0x55c76862f000 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: starting mds.c at 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mds[65382]: -- 172.21.15.154:0/3131703516 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c31877860 con 0x560c31855000 2024-09-16T01:14:10.655 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: starting mds.i at 2024-09-16T01:14:10.924 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:14:10.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:14:10.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:14:10.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:14:10.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: osdmap e95: 12 total, 12 up, 12 in 2024-09-16T01:14:10.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:10 smithi017 ceph-mon[31211]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:14:10.951 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:14:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:14:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:14:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:14:11.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:14:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: osdmap e95: 12 total, 12 up, 12 in 2024-09-16T01:14:11.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:10 smithi088 ceph-mon[34093]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/2777124677' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: osdmap e95: 12 total, 12 up, 12 in 2024-09-16T01:14:11.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:10 smithi154 ceph-mon[34759]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-16T01:14:11.209 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:11.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 -- 172.21.15.17:0/559267716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100e30 msgr2=0x7ff150104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 --2- 172.21.15.17:0/559267716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100e30 0x7ff150104e80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff14000aa10 tx=0x7ff14002b720 comp rx=0 tx=0).stop 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 -- 172.21.15.17:0/559267716 shutdown_connections 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 --2- 172.21.15.17:0/559267716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1501055b0 0x7ff15010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 --2- 172.21.15.17:0/559267716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100e30 0x7ff150104e80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 --2- 172.21.15.17:0/559267716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150100480 0x7ff150100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 -- 172.21.15.17:0/559267716 >> 172.21.15.17:0/559267716 conn(0x7ff150077210 msgr2=0x7ff1500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 -- 172.21.15.17:0/559267716 shutdown_connections 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.702+0000 7ff157858640 1 -- 172.21.15.17:0/559267716 wait complete. 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 Processor -- start 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 -- start start 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff150100e30 0x7ff1500fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1501055b0 0x7ff1500fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010fc60 con 0x7ff150100480 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010fae0 con 0x7ff150100e30 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff157858640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010fde0 con 0x7ff1501055b0 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff1555f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff1555f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58662/0 (socket says 172.21.15.17:58662) 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.703+0000 7ff1555f4640 1 -- 172.21.15.17:0/3022326629 learned_addr learned my addr 172.21.15.17:0/3022326629 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff154df3640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff150100e30 0x7ff1500fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff155df5640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1501055b0 0x7ff1500fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 -- 172.21.15.17:0/3022326629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1501055b0 msgr2=0x7ff1500fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1501055b0 0x7ff1500fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 -- 172.21.15.17:0/3022326629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff150100e30 msgr2=0x7ff1500fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff150100e30 0x7ff1500fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 -- 172.21.15.17:0/3022326629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501a6900 con 0x7ff150100480 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1555f4640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b4a0 tx=0x7ff14c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c014070 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff14c010ac0 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c017c30 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1501a6bf0 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.704+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501a7150 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.705+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff150100860 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.707+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff14c017070 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.708+0000 7ff1467fc640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 0x7ff13c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.708+0000 7ff154df3640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 0x7ff13c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.708+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8943+0+0 (secure 0 0 0) 0x7ff14c0cf550 con 0x7ff150100480 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.708+0000 7ff154df3640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 0x7ff13c0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff140030550 tx=0x7ff14000a700 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.711+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff14c09be40 con 0x7ff150100480 2024-09-16T01:14:11.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:11.926+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff15010a7a0 con 0x7ff150100480 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: pgmap v368: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6838/35076055,v1:172.21.15.17:6839/35076055] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6833/1522144480,v1:172.21.15.154:6835/1522144480] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6832/1630353374,v1:172.21.15.154:6834/1630353374] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.17:6840/2042775808,v1:172.21.15.17:6841/2042775808] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6837/2355617007,v1:172.21.15.154:6839/2355617007] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.154:6836/4160236633,v1:172.21.15.154:6838/4160236633] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6832/2827686976,v1:172.21.15.88:6834/2827686976] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6835/103943120,v1:172.21.15.88:6837/103943120] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6833/615920791,v1:172.21.15.88:6836/615920791] up:boot 2024-09-16T01:14:11.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: mds.? [v2:172.21.15.88:6838/767572542,v1:172.21.15.88:6839/767572542] up:boot 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:14:11.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:14:11.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:14:11.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:11 smithi017 ceph-mon[31211]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:14:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: pgmap v368: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-16T01:14:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6838/35076055,v1:172.21.15.17:6839/35076055] up:boot 2024-09-16T01:14:12.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6833/1522144480,v1:172.21.15.154:6835/1522144480] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6832/1630353374,v1:172.21.15.154:6834/1630353374] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.17:6840/2042775808,v1:172.21.15.17:6841/2042775808] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6837/2355617007,v1:172.21.15.154:6839/2355617007] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.154:6836/4160236633,v1:172.21.15.154:6838/4160236633] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6832/2827686976,v1:172.21.15.88:6834/2827686976] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6835/103943120,v1:172.21.15.88:6837/103943120] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6833/615920791,v1:172.21.15.88:6836/615920791] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: mds.? [v2:172.21.15.88:6838/767572542,v1:172.21.15.88:6839/767572542] up:boot 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:14:12.144 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:14:12.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:14:12.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:14:12.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:14:12.145 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:11 smithi088 ceph-mon[34093]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: pgmap v368: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 56 KiB/s wr, 32 op/s 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6838/35076055,v1:172.21.15.17:6839/35076055] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6833/1522144480,v1:172.21.15.154:6835/1522144480] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6832/1630353374,v1:172.21.15.154:6834/1630353374] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.17:6840/2042775808,v1:172.21.15.17:6841/2042775808] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6837/2355617007,v1:172.21.15.154:6839/2355617007] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.154:6836/4160236633,v1:172.21.15.154:6838/4160236633] up:boot 2024-09-16T01:14:12.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6832/2827686976,v1:172.21.15.88:6834/2827686976] up:boot 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6835/103943120,v1:172.21.15.88:6837/103943120] up:boot 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6833/615920791,v1:172.21.15.88:6836/615920791] up:boot 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: mds.? [v2:172.21.15.88:6838/767572542,v1:172.21.15.88:6839/767572542] up:boot 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:14:12.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:11 smithi154 ceph-mon[34759]: from='mgr.15225 172.21.15.17:0/1942645136' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:14:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.661+0000 7ff1467fc640 1 -- 172.21.15.17:0/3022326629 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7ff14c09b740 con 0x7ff150100480 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 msgr2=0x7ff13c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 0x7ff13c0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff140030550 tx=0x7ff14000a700 comp rx=0 tx=0).stop 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 msgr2=0x7ff1500fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b4a0 tx=0x7ff14c00b960 comp rx=0 tx=0).stop 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 shutdown_connections 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7ff13c0a3430 0x7ff13c0a58f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1501055b0 0x7ff1500fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff150100e30 0x7ff1500fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 --2- 172.21.15.17:0/3022326629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff150100480 0x7ff1500fc690 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.663+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 >> 172.21.15.17:0/3022326629 conn(0x7ff150077210 msgr2=0x7ff1500fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.664+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 shutdown_connections 2024-09-16T01:14:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:12.664+0000 7ff157858640 1 -- 172.21.15.17:0/3022326629 wait complete. 2024-09-16T01:14:12.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:12 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:14:13.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:12 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:14:13.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:12 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:14:13.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:14:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: pgmap v370: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-16T01:14:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:14:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:14:13.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: Cluster is now healthy 2024-09-16T01:14:13.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:14:13.938 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:13 smithi017 ceph-mon[31211]: fsmap 12 up:standby 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: pgmap v370: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: Cluster is now healthy 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:14:14.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:13 smithi088 ceph-mon[34093]: fsmap 12 up:standby 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: pgmap v370: 97 pgs: 97 active+clean; 5.6 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: Cluster is now healthy 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3022326629' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:14:14.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:13 smithi154 ceph-mon[34759]: fsmap 12 up:standby 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1222439158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 msgr2=0x7fcd48106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1222439158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd48106cb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009930 tx=0x7fcd3802a420 comp rx=0 tx=0).stop 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1222439158 shutdown_connections 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1222439158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd48101270 0x7fcd4810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1222439158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481008d0 0x7fcd48100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1222439158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd48106cb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1222439158 >> 172.21.15.17:0/1222439158 conn(0x7fcd480fc610 msgr2=0x7fcd480fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1222439158 shutdown_connections 2024-09-16T01:14:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.188+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1222439158 wait complete. 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 Processor -- start 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 -- start start 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd481008d0 0x7fcd481981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 0x7fcd48198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48111ca0 con 0x7fcd481068d0 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48111b20 con 0x7fcd481008d0 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4d3a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48111e20 con 0x7fcd48101270 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58678/0 (socket says 172.21.15.17:58678) 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 -- 172.21.15.17:0/1095936711 learned_addr learned my addr 172.21.15.17:0/1095936711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd3ffff640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 0x7fcd48198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd47fff640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd481008d0 0x7fcd481981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 -- 172.21.15.17:0/1095936711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 msgr2=0x7fcd48198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 0x7fcd48198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 -- 172.21.15.17:0/1095936711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd481008d0 msgr2=0x7fcd481981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd481008d0 0x7fcd481981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd4cba1640 1 -- 172.21.15.17:0/1095936711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4819d170 con 0x7fcd481068d0 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.189+0000 7fcd3ffff640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 0x7fcd48198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd4cba1640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000eaa0 tx=0x7fcd4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000cdb0 con 0x7fcd481068d0 2024-09-16T01:14:14.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd40005020 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4819d460 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd400116d0 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.190+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd481a4d40 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.191+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd48100d30 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.192+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcd400051d0 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.193+0000 7fcd45ffb640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 0x7fcd340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.193+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8943+0+0 (secure 0 0 0) 0x7fcd400d0440 con 0x7fcd481068d0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.193+0000 7fcd47fff640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 0x7fcd340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.193+0000 7fcd47fff640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 0x7fcd340a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd38006010 tx=0x7fcd38000bc0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.196+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd40016030 con 0x7fcd481068d0 2024-09-16T01:14:14.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.379+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd48199520 con 0x7fcd481068d0 2024-09-16T01:14:14.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.665+0000 7fcd45ffb640 1 -- 172.21.15.17:0/1095936711 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7fcd48199520 con 0x7fcd481068d0 2024-09-16T01:14:14.667 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:14:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.668+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 msgr2=0x7fcd340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.668+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 0x7fcd340a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd38006010 tx=0x7fcd38000bc0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.668+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 msgr2=0x7fcd4819ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.668+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000eaa0 tx=0x7fcd4000ef60 comp rx=0 tx=0).stop 2024-09-16T01:14:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 shutdown_connections 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7fcd340a3430 0x7fcd340a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd481068d0 0x7fcd4819ca90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48101270 0x7fcd48198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 --2- 172.21.15.17:0/1095936711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd481008d0 0x7fcd481981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 >> 172.21.15.17:0/1095936711 conn(0x7fcd480fc610 msgr2=0x7fcd480fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 shutdown_connections 2024-09-16T01:14:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:14.669+0000 7fcd4d3a2640 1 -- 172.21.15.17:0/1095936711 wait complete. 2024-09-16T01:14:14.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:14 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:15.044 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:14 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:15.055 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:14 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:15.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:14:15.539 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:15 smithi017 ceph-mon[31211]: pgmap v371: 97 pgs: 97 active+clean; 5.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-16T01:14:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:15 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:15.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:15 smithi017 ceph-mon[31211]: osdmap e96: 12 total, 12 up, 12 in 2024-09-16T01:14:16.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/50581485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84100e20 msgr2=0x7f6a84101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/50581485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84100e20 0x7f6a84101200 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009900 tx=0x7f6a8002a480 comp rx=0 tx=0).stop 2024-09-16T01:14:16.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/50581485 shutdown_connections 2024-09-16T01:14:16.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/50581485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 0x7f6a8410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/50581485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84102570 0x7f6a841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/50581485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84100e20 0x7f6a84101200 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/50581485 >> 172.21.15.17:0/50581485 conn(0x7f6a840fc7d0 msgr2=0x7f6a840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/50581485 shutdown_connections 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.030+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/50581485 wait complete. 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 Processor -- start 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 -- start start 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84100e20 0x7f6a84198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 0x7f6a8419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84110e30 con 0x7f6a84102570 2024-09-16T01:14:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84110cb0 con 0x7f6a84102ef0 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8c0c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84110fb0 con 0x7f6a84100e20 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58698/0 (socket says 172.21.15.17:58698) 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 -- 172.21.15.17:0/3932153494 learned_addr learned my addr 172.21.15.17:0/3932153494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a8a664640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 0x7f6a8419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89e63640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84100e20 0x7f6a84198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 -- 172.21.15.17:0/3932153494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84100e20 msgr2=0x7f6a84198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84100e20 0x7f6a84198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 -- 172.21.15.17:0/3932153494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 msgr2=0x7f6a8419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 0x7f6a8419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.031+0000 7f6a89662640 1 -- 172.21.15.17:0/3932153494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8419d410 con 0x7f6a84102570 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a89662640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400d770 tx=0x7f6a7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74017070 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a740054d0 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8419d700 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74004cf0 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.032+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a841a4fe0 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.033+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a84101200 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.034+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6a74004e90 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.035+0000 7f6a7affd640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 0x7f6a700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.035+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8389+0+0 (secure 0 0 0) 0x7f6a740cf5e0 con 0x7f6a84102570 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.035+0000 7f6a89e63640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 0x7f6a700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.036+0000 7f6a89e63640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 0x7f6a700a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009230 tx=0x7f6a800058d0 comp rx=0 tx=0).ready entity=mgr.15225 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.039+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a7409b9f0 con 0x7f6a84102570 2024-09-16T01:14:16.079 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:15 smithi154 ceph-mon[34759]: pgmap v371: 97 pgs: 97 active+clean; 5.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-16T01:14:16.079 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:15 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:16.079 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:15 smithi154 ceph-mon[34759]: osdmap e96: 12 total, 12 up, 12 in 2024-09-16T01:14:16.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:15 smithi088 ceph-mon[34093]: pgmap v371: 97 pgs: 97 active+clean; 5.6 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-16T01:14:16.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:15 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/1095936711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:16.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:15 smithi088 ceph-mon[34093]: osdmap e96: 12 total, 12 up, 12 in 2024-09-16T01:14:16.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.215+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a841a51b0 con 0x7f6a84102570 2024-09-16T01:14:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.671+0000 7f6a7affd640 1 -- 172.21.15.17:0/3932153494 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7f6a7409fcf0 con 0x7f6a84102570 2024-09-16T01:14:16.673 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-16T01:14:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 msgr2=0x7f6a700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 0x7f6a700a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009230 tx=0x7f6a800058d0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 msgr2=0x7f6a841989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400d770 tx=0x7f6a7400dc30 comp rx=0 tx=0).stop 2024-09-16T01:14:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 shutdown_connections 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:6800/1687735498,v1:172.21.15.17:6801/1687735498] conn(0x7f6a700a3430 0x7f6a700a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a84102ef0 0x7f6a8419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a84102570 0x7f6a841989a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 --2- 172.21.15.17:0/3932153494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a84100e20 0x7f6a84198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.675+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 >> 172.21.15.17:0/3932153494 conn(0x7f6a840fc7d0 msgr2=0x7f6a8406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.676+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 shutdown_connections 2024-09-16T01:14:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-16T01:14:16.676+0000 7f6a8c0c7640 1 -- 172.21.15.17:0/3932153494 wait complete. 2024-09-16T01:14:16.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:16 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:17.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:16 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:17.153 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:16 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:14:17.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:17.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:17.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:17.417 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T01:14:17.421 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:14:17.439 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:14:17.456 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:14:17.471 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T01:14:17.472 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-16T01:14:17.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a 2024-09-16T01:14:17.797 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 systemd[1]: Stopping Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:17.797 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 ceph-mon[31211]: pgmap v373: 65 pgs: 65 active+clean; 577 KiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:14:17.797 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 ceph-mon[31211]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:17.797 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 ceph-mon[31211]: osdmap e97: 12 total, 12 up, 12 in 2024-09-16T01:14:18.052 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-16T01:14:17.795+0000 7f839ffd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:18.052 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-16T01:14:17.795+0000 7f839ffd0640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-16T01:14:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:17 smithi088 ceph-mon[34093]: pgmap v373: 65 pgs: 65 active+clean; 577 KiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:14:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:17 smithi088 ceph-mon[34093]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:18.143 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:17 smithi088 ceph-mon[34093]: osdmap e97: 12 total, 12 up, 12 in 2024-09-16T01:14:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:17 smithi154 ceph-mon[34759]: pgmap v373: 65 pgs: 65 active+clean; 577 KiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:14:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:17 smithi154 ceph-mon[34759]: from='client.? 172.21.15.17:0/3932153494' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:14:18.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:17 smithi154 ceph-mon[34759]: osdmap e97: 12 total, 12 up, 12 in 2024-09-16T01:14:18.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 podman[89443]: 2024-09-16 01:14:18.051419207 +0000 UTC m=+0.359200473 container died 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-16T01:14:18.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 podman[89443]: 2024-09-16 01:14:18.463520404 +0000 UTC m=+0.771301669 container cleanup 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:14:18.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 bash[89443]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a 2024-09-16T01:14:18.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service' 2024-09-16T01:14:18.979 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 podman[89457]: 2024-09-16 01:14:18.706712857 +0000 UTC m=+0.652746491 container remove 40ded1da31645c2c2148f5e6823aeb21643d9435ff2b6308a90361f7a509f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-16T01:14:18.979 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-16T01:14:18.979 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 systemd[1]: Stopped Ceph mon.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:14:18.979 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 16 01:14:18 smithi017 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.a.service: Consumed 20.436s CPU time. 2024-09-16T01:14:19.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:19.007 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-16T01:14:19.007 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-16T01:14:19.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.b 2024-09-16T01:14:19.314 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 systemd[1]: Stopping Ceph mon.b for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-b[34089]: 2024-09-16T01:14:19.311+0000 7fc16de44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-b[34089]: 2024-09-16T01:14:19.311+0000 7fc16de44640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:14:19.643 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 podman[69637]: 2024-09-16 01:14:19.435774625 +0000 UTC m=+0.232089448 container died 410fd8b94557f516491fc50387ad4f3bf0b60934feb07afbcc912356b820fb36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T01:14:20.098 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 podman[69637]: 2024-09-16 01:14:19.821272174 +0000 UTC m=+0.617586984 container cleanup 410fd8b94557f516491fc50387ad4f3bf0b60934feb07afbcc912356b820fb36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T01:14:20.098 INFO:journalctl@ceph.mon.b.smithi088.stdout:Sep 16 01:14:19 smithi088 bash[69637]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-b 2024-09-16T01:14:20.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.b.service' 2024-09-16T01:14:20.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:20.278 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-16T01:14:20.278 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-16T01:14:20.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.c 2024-09-16T01:14:20.603 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:20 smithi154 systemd[1]: Stopping Ceph mon.c for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:20.876 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c[34755]: 2024-09-16T01:14:20.602+0000 7f3cea184640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:20.876 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c[34755]: 2024-09-16T01:14:20.602+0000 7f3cea184640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:14:20.877 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:20 smithi154 podman[71417]: 2024-09-16 01:14:20.847148702 +0000 UTC m=+0.366125654 container stop 3abb8e4badd3bd81df84e224393db11d7ab07bfc53fd15faa3c5c618a26ae8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T01:14:20.877 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:20 smithi154 podman[71417]: 2024-09-16 01:14:20.876049605 +0000 UTC m=+0.395026639 container died 3abb8e4badd3bd81df84e224393db11d7ab07bfc53fd15faa3c5c618a26ae8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:14:21.472 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:21 smithi154 podman[71417]: 2024-09-16 01:14:21.261347029 +0000 UTC m=+0.780323980 container cleanup 3abb8e4badd3bd81df84e224393db11d7ab07bfc53fd15faa3c5c618a26ae8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-16T01:14:21.472 INFO:journalctl@ceph.mon.c.smithi154.stdout:Sep 16 01:14:21 smithi154 bash[71417]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mon-c 2024-09-16T01:14:21.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mon.c.service' 2024-09-16T01:14:21.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:21.753 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-16T01:14:21.753 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-16T01:14:21.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x 2024-09-16T01:14:22.128 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:14:21 smithi017 systemd[1]: Stopping Ceph mgr.x for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:22.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:14:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-16T01:14:22.125+0000 7fdd7eb4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:22.437 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:14:22 smithi017 podman[89564]: 2024-09-16 01:14:22.157705707 +0000 UTC m=+0.194996637 container died 80323d07f892ce7d6e138365ed4f649a88ec53e77da7f35394a7deb927441c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:14:22.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:14:22 smithi017 podman[89564]: 2024-09-16 01:14:22.56081723 +0000 UTC m=+0.598108195 container cleanup 80323d07f892ce7d6e138365ed4f649a88ec53e77da7f35394a7deb927441c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T01:14:22.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 16 01:14:22 smithi017 bash[89564]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-x 2024-09-16T01:14:22.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-16T01:14:23.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:23.029 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-16T01:14:23.030 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-16T01:14:23.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.y 2024-09-16T01:14:23.393 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:14:23 smithi088 systemd[1]: Stopping Ceph mgr.y for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:23.761 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:14:23 smithi088 podman[69757]: 2024-09-16 01:14:23.471913131 +0000 UTC m=+0.244890726 container died 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-16T01:14:24.062 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:14:23 smithi088 podman[69757]: 2024-09-16 01:14:23.852204497 +0000 UTC m=+0.625182081 container cleanup 22a34ba7637e2cb6fc958286bcb27877c12bf89b039dcafff52afc6d0d212e41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-16T01:14:24.063 INFO:journalctl@ceph.mgr.y.smithi088.stdout:Sep 16 01:14:23 smithi088 bash[69757]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-y 2024-09-16T01:14:24.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-16T01:14:24.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:24.309 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-16T01:14:24.309 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-16T01:14:24.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.z 2024-09-16T01:14:24.654 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:14:24 smithi154 systemd[1]: Stopping Ceph mgr.z for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:25.027 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:14:24 smithi154 podman[71537]: 2024-09-16 01:14:24.77149891 +0000 UTC m=+0.263156756 container died f37f9b331249a642350aa5097b96ce22db78d29e1b64740d6ada09205689e72b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T01:14:25.320 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:14:25 smithi154 podman[71537]: 2024-09-16 01:14:25.118018602 +0000 UTC m=+0.609676450 container cleanup f37f9b331249a642350aa5097b96ce22db78d29e1b64740d6ada09205689e72b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T01:14:25.320 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Sep 16 01:14:25 smithi154 bash[71537]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mgr-z 2024-09-16T01:14:25.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-16T01:14:25.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:25.581 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-16T01:14:25.582 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T01:14:25.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.0 2024-09-16T01:14:25.908 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:25 smithi017 systemd[1]: Stopping Ceph osd.0 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:26.187 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:25 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T01:14:25.906+0000 7fe03e49d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:26.187 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:25 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T01:14:25.906+0000 7fe03e49d640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-16T01:14:26.187 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:25 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0[42554]: 2024-09-16T01:14:25.906+0000 7fe03e49d640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:14:31.688 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:31 smithi017 podman[89688]: 2024-09-16 01:14:31.435779971 +0000 UTC m=+5.651723968 container died 79b76aed189a1a83a6dae99e8bb13743a9a5d20ddd9389f8978d984c3e6e6af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:14:32.093 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:31 smithi017 podman[89688]: 2024-09-16 01:14:31.832568967 +0000 UTC m=+6.048512957 container cleanup 79b76aed189a1a83a6dae99e8bb13743a9a5d20ddd9389f8978d984c3e6e6af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T01:14:32.093 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:31 smithi017 bash[89688]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0 2024-09-16T01:14:32.437 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89705]: 2024-09-16 01:14:32.092330836 +0000 UTC m=+0.654011177 container remove 79b76aed189a1a83a6dae99e8bb13743a9a5d20ddd9389f8978d984c3e6e6af9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:14:32.739 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.37190311 +0000 UTC m=+0.016844755 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:14:32.739 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.485245982 +0000 UTC m=+0.130187626 container create c99e1a2b6794dabcbc827c000d5d28341df19f8c626769962b1361b5dec945be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T01:14:32.739 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.738906898 +0000 UTC m=+0.383848543 container init c99e1a2b6794dabcbc827c000d5d28341df19f8c626769962b1361b5dec945be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:14:33.187 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.742405976 +0000 UTC m=+0.387347621 container start c99e1a2b6794dabcbc827c000d5d28341df19f8c626769962b1361b5dec945be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T01:14:33.188 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.846489329 +0000 UTC m=+0.491430977 container attach c99e1a2b6794dabcbc827c000d5d28341df19f8c626769962b1361b5dec945be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:14:33.188 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 16 01:14:32 smithi017 podman[89797]: 2024-09-16 01:14:32.938146745 +0000 UTC m=+0.583088397 container died c99e1a2b6794dabcbc827c000d5d28341df19f8c626769962b1361b5dec945be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T01:14:33.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T01:14:33.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:33.630 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T01:14:33.631 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T01:14:33.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.1 2024-09-16T01:14:33.948 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:33 smithi088 systemd[1]: Stopping Ceph osd.1 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:34.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T01:14:33.946+0000 7f44ea89a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:34.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T01:14:33.946+0000 7f44ea89a640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-16T01:14:34.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1[38558]: 2024-09-16T01:14:33.946+0000 7f44ea89a640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:14:39.732 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:39 smithi088 podman[69881]: 2024-09-16 01:14:39.426883252 +0000 UTC m=+5.601909202 container died 4f360c15707e180c7fd64eecc139c92c1684027692ff405c248e99e8b79663bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-16T01:14:40.133 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:39 smithi088 podman[69881]: 2024-09-16 01:14:39.830895362 +0000 UTC m=+6.005921322 container cleanup 4f360c15707e180c7fd64eecc139c92c1684027692ff405c248e99e8b79663bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-16T01:14:40.133 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:39 smithi088 bash[69881]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1 2024-09-16T01:14:40.393 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69897]: 2024-09-16 01:14:40.132473055 +0000 UTC m=+0.697751680 container remove 4f360c15707e180c7fd64eecc139c92c1684027692ff405c248e99e8b79663bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T01:14:40.737 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.346690835 +0000 UTC m=+0.015966150 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:14:40.737 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.483437152 +0000 UTC m=+0.152712473 container create c09014e9c4ca4f20cc6f38d8f46b5b41bf7e7c613d0eb4e84046cc5bf957d15b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:14:40.737 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.736336968 +0000 UTC m=+0.405612290 container init c09014e9c4ca4f20cc6f38d8f46b5b41bf7e7c613d0eb4e84046cc5bf957d15b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e) 2024-09-16T01:14:41.143 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.739667519 +0000 UTC m=+0.408942840 container start c09014e9c4ca4f20cc6f38d8f46b5b41bf7e7c613d0eb4e84046cc5bf957d15b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-16T01:14:41.143 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.828409711 +0000 UTC m=+0.497685032 container attach c09014e9c4ca4f20cc6f38d8f46b5b41bf7e7c613d0eb4e84046cc5bf957d15b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T01:14:41.143 INFO:journalctl@ceph.osd.1.smithi088.stdout:Sep 16 01:14:40 smithi088 podman[69987]: 2024-09-16 01:14:40.928279604 +0000 UTC m=+0.597554931 container died c09014e9c4ca4f20cc6f38d8f46b5b41bf7e7c613d0eb4e84046cc5bf957d15b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T01:14:41.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T01:14:41.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:41.638 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T01:14:41.638 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T01:14:41.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.2 2024-09-16T01:14:41.965 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:41 smithi154 systemd[1]: Stopping Ceph osd.2 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:42.403 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T01:14:41.963+0000 7f3fe0dbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:42.403 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T01:14:41.963+0000 7f3fe0dbb640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-16T01:14:42.404 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2[39739]: 2024-09-16T01:14:41.963+0000 7f3fe0dbb640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:14:47.647 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:47 smithi154 podman[71662]: 2024-09-16 01:14:47.333502825 +0000 UTC m=+5.498501187 container died 5e7e533022284a14339bf6a2459c152a9b4e00128e1b0fed17fad12f7cd47a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:14:47.899 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:47 smithi154 podman[71662]: 2024-09-16 01:14:47.647122174 +0000 UTC m=+5.812120536 container cleanup 5e7e533022284a14339bf6a2459c152a9b4e00128e1b0fed17fad12f7cd47a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-16T01:14:47.900 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:47 smithi154 bash[71662]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2 2024-09-16T01:14:48.153 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:47 smithi154 podman[71678]: 2024-09-16 01:14:47.899167855 +0000 UTC m=+0.562219842 container remove 5e7e533022284a14339bf6a2459c152a9b4e00128e1b0fed17fad12f7cd47a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-16T01:14:48.645 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.221704724 +0000 UTC m=+0.016196981 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:14:48.645 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.350216354 +0000 UTC m=+0.144708600 container create acd64918ee3592cb0815fa77f8f82e2e082e02b2a9ffe32fd8c125a404c55b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-16T01:14:48.904 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.644868204 +0000 UTC m=+0.439360464 container init acd64918ee3592cb0815fa77f8f82e2e082e02b2a9ffe32fd8c125a404c55b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T01:14:48.904 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.648192633 +0000 UTC m=+0.442684886 container start acd64918ee3592cb0815fa77f8f82e2e082e02b2a9ffe32fd8c125a404c55b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:14:48.904 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.744895324 +0000 UTC m=+0.539387586 container attach acd64918ee3592cb0815fa77f8f82e2e082e02b2a9ffe32fd8c125a404c55b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T01:14:48.904 INFO:journalctl@ceph.osd.2.smithi154.stdout:Sep 16 01:14:48 smithi154 podman[71769]: 2024-09-16 01:14:48.834910746 +0000 UTC m=+0.629402992 container died acd64918ee3592cb0815fa77f8f82e2e082e02b2a9ffe32fd8c125a404c55b9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-16T01:14:49.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T01:14:49.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:49.566 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T01:14:49.566 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T01:14:49.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.3 2024-09-16T01:14:49.896 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:49 smithi017 systemd[1]: Stopping Ceph osd.3 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:50.183 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:49 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T01:14:49.894+0000 7fd8baaa0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:50.183 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:49 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T01:14:49.894+0000 7fd8baaa0640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-16T01:14:50.183 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:49 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T01:14:49.894+0000 7fd8baaa0640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:14:52.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:51.834+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:52.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:52.395+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:53.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:52.819+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:53.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:53.358+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:54.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:53.849+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:54.188 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3[49448]: 2024-09-16T01:14:54.008+0000 7fd8b30ae640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.132930+0000 front 2024-09-16T01:14:29.133050+0000 (oldest deadline 2024-09-16T01:14:53.233094+0000) 2024-09-16T01:14:54.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:53 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:53.799+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:54.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:54.375+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:55.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:54.842+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:55.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:54 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:54.768+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:55.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:54 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:54.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:14:55.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:55.395+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:14:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:14:55.432+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:14:55.672 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:55 smithi017 podman[89903]: 2024-09-16 01:14:55.304679912 +0000 UTC m=+5.539975138 container died 4883c45b3114d65819656cf99bd195b45b19bdf22b20f072f1b33eebcb79b6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-16T01:14:55.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:55 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:55.810+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:55.938 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:55 smithi017 podman[89903]: 2024-09-16 01:14:55.770178598 +0000 UTC m=+6.005473816 container cleanup 4883c45b3114d65819656cf99bd195b45b19bdf22b20f072f1b33eebcb79b6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:14:55.938 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:55 smithi017 bash[89903]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3 2024-09-16T01:14:55.938 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:14:55 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:14:55.705+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:14:56.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:55.884+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:56.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:55 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:55.919+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:14:56.437 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[89929]: 2024-09-16 01:14:56.088396366 +0000 UTC m=+0.780443058 container remove 4883c45b3114d65819656cf99bd195b45b19bdf22b20f072f1b33eebcb79b6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T01:14:56.734 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.35833093 +0000 UTC m=+0.016425735 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:14:56.734 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.497595224 +0000 UTC m=+0.155690017 container create 51d3f20eb61ac7a2a0ce0d40ac26f4dacd9dea2cdfb7e68020577fb34cbc4e5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T01:14:56.893 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:14:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:14:56.459+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:14:56.894 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:56.419+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:57.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:56 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:56.877+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:14:57.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:56.893+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:57.187 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:14:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:14:56.748+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:14:57.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:56 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:56.801+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:57.188 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.733712888 +0000 UTC m=+0.391807680 container init 51d3f20eb61ac7a2a0ce0d40ac26f4dacd9dea2cdfb7e68020577fb34cbc4e5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:14:57.188 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.737338756 +0000 UTC m=+0.395433553 container start 51d3f20eb61ac7a2a0ce0d40ac26f4dacd9dea2cdfb7e68020577fb34cbc4e5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T01:14:57.188 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.850535085 +0000 UTC m=+0.508629889 container attach 51d3f20eb61ac7a2a0ce0d40ac26f4dacd9dea2cdfb7e68020577fb34cbc4e5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T01:14:57.188 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 16 01:14:56 smithi017 podman[90020]: 2024-09-16 01:14:56.936127992 +0000 UTC m=+0.594222801 container died 51d3f20eb61ac7a2a0ce0d40ac26f4dacd9dea2cdfb7e68020577fb34cbc4e5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:14:57.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T01:14:57.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:14:57.592 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T01:14:57.592 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T01:14:57.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.4 2024-09-16T01:14:57.803 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:14:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:14:57.745+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:14:57.893 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:14:57 smithi088 systemd[1]: Stopping Ceph osd.4 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:14:57.903 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:57.450+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:57.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:14:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:14:57.486+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:14:58.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:57 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:57.802+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:58.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:57 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:57.896+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:14:58.393 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:14:57 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T01:14:57.909+0000 7fc695404640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:14:58.393 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:14:57 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T01:14:57.909+0000 7fc695404640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-16T01:14:58.393 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:14:57 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T01:14:57.909+0000 7fc695404640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:14:58.403 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:57.912+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:58.881 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:58 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:58.441+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:58.881 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:14:58 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:14:58.503+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:14:59.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:58 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:58.890+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:14:59.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:58 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:58.881+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:14:59.187 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:14:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:14:58.703+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:14:59.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:58 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:58.759+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:14:59.850 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:14:59 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:14:59.457+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:14:59.851 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:14:59 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:14:59.484+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:14:59.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:14:59 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:14:59.674+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:14:59.938 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:14:59 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:14:59.780+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:00.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:14:59 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:14:59.848+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:00.343 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:14:59 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:14:59.924+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:00.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:00 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:00.343+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:00.788 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:00 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:00.458+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:00.789 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:00 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:00.462+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:00.789 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:00 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:00.462+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:00.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:00.732+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:00.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:00.647+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:00.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:00.647+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:01.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:00 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:00.893+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:01.308 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:01 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T01:15:01.018+0000 7fc691a1a640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.234578+0000 front 2024-09-16T01:14:36.234711+0000 (oldest deadline 2024-09-16T01:15:00.334740+0000) 2024-09-16T01:15:01.308 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:00 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:00.921+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:01.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:01 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:01.307+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:01.880 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:01 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:01.447+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:01.880 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:01 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:01.434+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:01.880 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:01 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:01.434+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:01.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:01 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:01.783+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:01.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:01 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:01.783+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:01.938 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:01 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:01.671+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:01.938 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:01 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:01.671+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:02.143 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:02 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4[45441]: 2024-09-16T01:15:02.016+0000 7fc691a1a640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.234578+0000 front 2024-09-16T01:14:36.234711+0000 (oldest deadline 2024-09-16T01:15:00.334740+0000) 2024-09-16T01:15:02.144 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:01 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:01.881+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:02.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:01 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:01.878+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:02.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:02 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:02.325+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:02.891 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:02.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:02.892 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:02.425+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:02.892 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:02.425+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:02.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:02 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:02.659+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:02.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:02 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:02.659+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:02.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:02 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:02.813+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:02.938 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:02 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:02.813+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:03.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:02 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:02.866+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:03.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:02 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:02.890+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:03.577 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:03 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:03.316+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:03.578 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:03 smithi088 podman[70101]: 2024-09-16 01:15:03.276455352 +0000 UTC m=+5.480773061 container died 47fd55a879e34f98cf48f86259fd3e9b04b175ac76aa441efa29c3bc6f20870c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-16T01:15:03.893 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:03 smithi088 podman[70101]: 2024-09-16 01:15:03.692700062 +0000 UTC m=+5.897017773 container cleanup 47fd55a879e34f98cf48f86259fd3e9b04b175ac76aa441efa29c3bc6f20870c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-16T01:15:03.893 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:03 smithi088 bash[70101]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4 2024-09-16T01:15:03.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:03 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:03.439+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:03.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:03 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:03.439+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:03.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:03 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:03.461+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:03.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:03 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:03.461+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:03.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:03.683+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:03.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:03.683+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:03.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:03.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:03.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:03.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:04.305 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:03 smithi088 podman[70119]: 2024-09-16 01:15:03.95269409 +0000 UTC m=+0.669894488 container remove 47fd55a879e34f98cf48f86259fd3e9b04b175ac76aa441efa29c3bc6f20870c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:04.305 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:03 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:03.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:04.306 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:03 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:03.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:04.403 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:03 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:03.918+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:04.606 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:04 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:04.332+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:04.607 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.207363616 +0000 UTC m=+0.015736667 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:04.607 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.336876857 +0000 UTC m=+0.145249944 container create 7f0e60cc7699d1c17d3ffe4bf14445ae80ec532d23846e3238e471948fa6156f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:15:04.607 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.606184805 +0000 UTC m=+0.414557848 container init 7f0e60cc7699d1c17d3ffe4bf14445ae80ec532d23846e3238e471948fa6156f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-16T01:15:04.894 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.609683715 +0000 UTC m=+0.418056766 container start 7f0e60cc7699d1c17d3ffe4bf14445ae80ec532d23846e3238e471948fa6156f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T01:15:04.894 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.689554982 +0000 UTC m=+0.497928037 container attach 7f0e60cc7699d1c17d3ffe4bf14445ae80ec532d23846e3238e471948fa6156f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T01:15:04.894 INFO:journalctl@ceph.osd.4.smithi088.stdout:Sep 16 01:15:04 smithi088 podman[70207]: 2024-09-16 01:15:04.797367512 +0000 UTC m=+0.605740556 container died 7f0e60cc7699d1c17d3ffe4bf14445ae80ec532d23846e3238e471948fa6156f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:04.903 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:04.421+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:04.903 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:04.421+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:04.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:04.442+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:04.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:04.442+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:04.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:04.644+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:04.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:04.644+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:04.938 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:04.886+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:04.938 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:04 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:04.886+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:05.327 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:04 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:04.905+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:05.327 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:04 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:04.905+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:05.402 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:04 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:04.968+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:05.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T01:15:05.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:05.464 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T01:15:05.464 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T01:15:05.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.5 2024-09-16T01:15:05.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:05 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:05.327+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:05.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:05.432+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:05.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:05.432+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:05.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:05.400+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:05.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:05.400+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:05.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 systemd[1]: Stopping Ceph osd.5 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:05.903 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:05.637+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:05.903 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:05.637+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:06.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:05.946+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:06.154 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:05.759+0000 7f3a1604f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:06.154 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:05.759+0000 7f3a1604f640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-16T01:15:06.154 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:05 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:05.759+0000 7f3a1604f640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:06.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:05.902+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:06.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:05 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:05.902+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:06.302 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:05 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:05.929+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:06.303 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:05 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:05.929+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:06.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:06 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:06.301+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:06.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:06 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:06.449+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:06.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:06 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:06.449+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:06.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:06 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:06.388+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:06.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:06 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:06.388+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:06.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:06.636+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:06.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:06.636+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:07.330 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:06 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:06.906+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:07.330 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:06 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:06.906+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:07.373 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:06 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:06.992+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:07.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:06.942+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:07.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:06.942+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:07.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:07 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:07.328+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:07.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:07.425+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:07.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:07.425+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:07.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:07.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:07.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:07.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:07.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:07.613+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:07.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:07.613+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:08.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:07 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:07.855+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:08.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:07 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:07.855+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:08.403 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:07.950+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:08.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:07 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:07.950+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:08.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:07.978+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:08.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:07 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:07.978+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:08.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:08 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:08.339+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:08.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:08 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:08.339+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:08.441+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:08.441+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:08.441+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:44.084876+0000 front 2024-09-16T01:14:44.084901+0000 (oldest deadline 2024-09-16T01:15:08.184828+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:08.411+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:08.411+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:08.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:08.411+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:08.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:08.655+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:08.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:08.655+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:09.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:08 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:08.828+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:09.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:08 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:08.828+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:09.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:08.937+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:09.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:08 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:08.937+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:09.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:08.977+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:09.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:08 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:08.977+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:09.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:09.359+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:09.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:09.359+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:09.443+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:09.443+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:09.443+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:09.402+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:09.402+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:09.904 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:09.402+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:44.084876+0000 front 2024-09-16T01:14:44.084901+0000 (oldest deadline 2024-09-16T01:15:08.184828+0000) 2024-09-16T01:15:09.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:09.643+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:09.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:09.643+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:10.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:09.859+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:10.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:09.859+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:10.143 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:09 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:09.859+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:10.370 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:09.967+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:10.370 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:09 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:09.967+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:10.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:09.958+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:10.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:09.958+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:10.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:09 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:09.958+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:10.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:10.325+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:10.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:10.325+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:10.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:10.369+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:26.880519+0000 front 2024-09-16T01:14:26.880499+0000 (oldest deadline 2024-09-16T01:14:51.580585+0000) 2024-09-16T01:15:10.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:10.369+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.282657+0000 front 2024-09-16T01:14:37.282669+0000 (oldest deadline 2024-09-16T01:14:59.582663+0000) 2024-09-16T01:15:10.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5[46614]: 2024-09-16T01:15:10.369+0000 7f3a0e65d640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:44.084876+0000 front 2024-09-16T01:14:44.084901+0000 (oldest deadline 2024-09-16T01:15:08.184828+0000) 2024-09-16T01:15:10.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:10.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:10.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:10.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:10.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:10.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:10.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:10.669+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:10.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:10.669+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:10.938 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:10.669+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:11.370 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:11 smithi154 podman[71886]: 2024-09-16 01:15:11.104114534 +0000 UTC m=+5.442016467 container died f16ee03d8eecd5369a34397fe397608fa7745a4f5f9cc66bd707bc00f818376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T01:15:11.371 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:10.956+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:11.371 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:10 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:10.956+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:11.375 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:10.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:11.375 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:10.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:11.375 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:10 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:10.901+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:11.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:10.991+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:11.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:10.991+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:11.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:10 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:10.991+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:11.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:11 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:11.374+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:11.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:11 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:11.374+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:11.653 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:11 smithi154 podman[71886]: 2024-09-16 01:15:11.468656426 +0000 UTC m=+5.806558356 container cleanup f16ee03d8eecd5369a34397fe397608fa7745a4f5f9cc66bd707bc00f818376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-16T01:15:11.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:11 smithi154 bash[71886]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5 2024-09-16T01:15:11.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:11 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:11.468+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:11.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:11 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:11.468+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:11.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:11 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:11.468+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:12.000 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:11.698+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:12.000 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:11.698+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:12.000 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:11.698+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:12.080 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:11 smithi154 podman[71902]: 2024-09-16 01:15:11.720042328 +0000 UTC m=+0.616639612 container remove f16ee03d8eecd5369a34397fe397608fa7745a4f5f9cc66bd707bc00f818376b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:15:12.081 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:11 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:11.930+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:12.081 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:11 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:11.930+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:12.333 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:11.982862187 +0000 UTC m=+0.016144697 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:12.333 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:12.087505265 +0000 UTC m=+0.120787817 container create 877043801f3d6ab1ea98b87f0ff2fca2aa0c2dc408655dccc99a22d1103e5fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T01:15:12.333 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:12.332387658 +0000 UTC m=+0.365670166 container init 877043801f3d6ab1ea98b87f0ff2fca2aa0c2dc408655dccc99a22d1103e5fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T01:15:12.390 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:11 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:11.917+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:12.390 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:11 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:11.917+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:12.390 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:11 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:11.917+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:12.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:11.999+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:12.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:11.999+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:12.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:11.999+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:12.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:12 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:12.389+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:12.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:12 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:12.389+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:12 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:12.497+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:12 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:12.497+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:12 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:12.497+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:12.335794598 +0000 UTC m=+0.369077110 container start 877043801f3d6ab1ea98b87f0ff2fca2aa0c2dc408655dccc99a22d1103e5fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:12.4155301 +0000 UTC m=+0.448812619 container attach 877043801f3d6ab1ea98b87f0ff2fca2aa0c2dc408655dccc99a22d1103e5fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T01:15:12.654 INFO:journalctl@ceph.osd.5.smithi154.stdout:Sep 16 01:15:12 smithi154 podman[71992]: 2024-09-16 01:15:12.520960586 +0000 UTC m=+0.554243098 container died 877043801f3d6ab1ea98b87f0ff2fca2aa0c2dc408655dccc99a22d1103e5fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:13.018 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:12 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:12.724+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:13.019 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:12 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:12.724+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:13.019 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:12 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:12.724+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:13.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:12 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:12.883+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:13.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:12 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:12.883+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:13.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T01:15:13.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:13.234 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T01:15:13.234 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-16T01:15:13.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.6 2024-09-16T01:15:13.287 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:13.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:13.287 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:13.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:13.287 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:13.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:13.359 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:12 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:12.932+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:13.359 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:12 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:12.932+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:13.359 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:12 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:12.932+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:13.566 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 systemd[1]: Stopping Ceph osd.6 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:13.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:13 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:13.357+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:13.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:13 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:13.357+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:13.899 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:13 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:13.477+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:13.899 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:13 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:13.477+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:13.899 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:13 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:13.477+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:13.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.565+0000 7fe949ea7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:13.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.565+0000 7fe949ea7640 -1 osd.6 97 *** Got signal Terminated *** 2024-09-16T01:15:13.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.565+0000 7fe949ea7640 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:13.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.734+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:13.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.734+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:13.938 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:13 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:13.734+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:14.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:13 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:13.898+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:14.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:13 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:13.898+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:14.332 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:13 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:13.954+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:14.332 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:13 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:13.954+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:14.332 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:13 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:13.954+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:14.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:14.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:14.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:14.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:14.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:14.017+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:14.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:14.330+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:14.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:14.330+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:14.902 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:14 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:14.487+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:14.902 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:14 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:14.487+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:14.902 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:14 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:14.487+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:15.058 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:14.705+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:15.058 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:14.705+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:15.058 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:14 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:14.705+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:15.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:14 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:14.901+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:15.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:14 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:14.901+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:15.360 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:14.955+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:15.360 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:14.955+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:15.360 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:14.955+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:15.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:15.057+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:15.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:15.057+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:15.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:15.057+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:15.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:15 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:15.358+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:15.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:15 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:15.358+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:15.897 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:15 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:15.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:15.897 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:15 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:15.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:15.897 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:15 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:15.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:16.009 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:15.746+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:16.010 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:15.746+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:16.010 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:15 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:15.746+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:16.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:15 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:15.896+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:16.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:15 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:15.896+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:16.392 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:15 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:15.989+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:16.392 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:15 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:15.989+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:16.392 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:15 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:15.989+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:16.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:16.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:16.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:16.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:16.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:16.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:16.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:16 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:16.391+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:16.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:16 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:16.391+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:16.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:16.416+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:16.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:16.416+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:16.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:16.416+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:17.187 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:16.774+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:17.188 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:16.774+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:17.188 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:16 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:16.774+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:17.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:17.010+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:17.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:17.010+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:17.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:17.010+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:17.382 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:17.030+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:17.382 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:17.030+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:17.382 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:17.030+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:17.403 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:16.945+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:17.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:16 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:16.945+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:17.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:17.380+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:17.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:17 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:17.380+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:17.678 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:17.450+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:17.678 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:17.450+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:17.679 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:17.450+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:18.043 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:17.763+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.186661+0000 front 2024-09-16T01:14:30.186807+0000 (oldest deadline 2024-09-16T01:14:54.886951+0000) 2024-09-16T01:15:18.044 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:17.763+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:37.188486+0000 front 2024-09-16T01:14:37.188351+0000 (oldest deadline 2024-09-16T01:15:00.088088+0000) 2024-09-16T01:15:18.044 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:17 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6[55920]: 2024-09-16T01:15:17.763+0000 7fe9464bd640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.389364+0000 front 2024-09-16T01:14:45.389390+0000 (oldest deadline 2024-09-16T01:15:10.088897+0000) 2024-09-16T01:15:18.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:17.901+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:18.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:17 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:17.901+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:18.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:18.071+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:18.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:18.071+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:18.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:18.071+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:18.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:18.071+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:18.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:18 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:18.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:18.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:18 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:18.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:18.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:18 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:18.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:18.865 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:18.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:18.865 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:18.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:18.865 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:18.422+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:18.893 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:18.397+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:18.893 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:18 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:18.397+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:19.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:18.863+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:19.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:18.863+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:19.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:18 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:18.863+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:19.250 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:18 smithi017 podman[90121]: 2024-09-16 01:15:18.962958125 +0000 UTC m=+5.523238284 container died f7b9e0f11765f2ce62d9e98079c87a2e5530486d91f7565bf5ead769439d5b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:19.250 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:19.019+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:19.251 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:19.019+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:19.251 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:19.019+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:19.251 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:19 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:19.019+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:19.393 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:19.361+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:19.393 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:19.361+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:19.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:19.118+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:19.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:19.118+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:19.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:19.118+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:19.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:19.118+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:19.625 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:19 smithi017 podman[90121]: 2024-09-16 01:15:19.357291858 +0000 UTC m=+5.917572014 container cleanup f7b9e0f11765f2ce62d9e98079c87a2e5530486d91f7565bf5ead769439d5b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:19.625 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:19 smithi017 bash[90121]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6 2024-09-16T01:15:19.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:19.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:19.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:19.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:19.904 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:19.448+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:19.937 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:19 smithi017 podman[90135]: 2024-09-16 01:15:19.625017097 +0000 UTC m=+0.659004728 container remove f7b9e0f11765f2ce62d9e98079c87a2e5530486d91f7565bf5ead769439d5b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T01:15:20.254 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:19 smithi017 podman[90227]: 2024-09-16 01:15:19.992484735 +0000 UTC m=+0.112777751 container create c80c39e43b7ad6ca870dca498ac62438dd68af8cd8b70ed3c3e6767690ab24ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T01:15:20.254 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:19 smithi017 podman[90227]: 2024-09-16 01:15:19.895932863 +0000 UTC m=+0.016225892 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:20.255 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:20.002+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:20.255 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:20.002+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:20.255 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:20.002+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:20.255 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:20 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:20.002+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:20.403 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:19.908+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:20.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:19.908+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:20.404 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:19 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:19.908+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:20.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:20.167+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:20.167+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:20.167+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:20.167+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:20.409+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:20.409+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:20.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:20 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:20.409+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:20.687 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:20 smithi017 podman[90227]: 2024-09-16 01:15:20.253657461 +0000 UTC m=+0.373950479 container init c80c39e43b7ad6ca870dca498ac62438dd68af8cd8b70ed3c3e6767690ab24ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:20.688 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:20 smithi017 podman[90227]: 2024-09-16 01:15:20.257130697 +0000 UTC m=+0.377423715 container start c80c39e43b7ad6ca870dca498ac62438dd68af8cd8b70ed3c3e6767690ab24ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-16T01:15:20.688 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:20 smithi017 podman[90227]: 2024-09-16 01:15:20.345245223 +0000 UTC m=+0.465538242 container attach c80c39e43b7ad6ca870dca498ac62438dd68af8cd8b70ed3c3e6767690ab24ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:15:20.688 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 16 01:15:20 smithi017 podman[90227]: 2024-09-16 01:15:20.448265898 +0000 UTC m=+0.568558924 container died c80c39e43b7ad6ca870dca498ac62438dd68af8cd8b70ed3c3e6767690ab24ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-16T01:15:20.890 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:20.460+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:20.890 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:20.460+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:20.891 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:20.460+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:21.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.6.service' 2024-09-16T01:15:21.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:21.151 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-16T01:15:21.151 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-16T01:15:21.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.7 2024-09-16T01:15:21.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:20.889+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:21.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:20.889+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:21.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:20 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:20.889+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:21.370 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:21.038+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:21.370 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:21.038+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:21.370 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:21.038+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:21.370 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:21 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:21.038+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:21.471 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:21.215+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:21.471 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:21.215+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:21.471 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:21.215+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:21.471 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:21.215+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 systemd[1]: Stopping Ceph osd.7 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.419+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.419+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.419+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.470+0000 7f574b93e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.470+0000 7f574b93e640 -1 osd.7 97 *** Got signal Terminated *** 2024-09-16T01:15:21.472 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:21 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:21.470+0000 7f574b93e640 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:21.853 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:21.447+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:21.853 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:21.447+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:21.853 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:21.447+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:22.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:21.852+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:22.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:21.852+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:22.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:21 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:21.852+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:22.371 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:22.032+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:22.372 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:22.032+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:22.372 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:22.032+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:22.372 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:22 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:22.032+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:22.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:22.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:22.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:22.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:22.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:22.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:22.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:22.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:22.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:22.370+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:22.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:22.370+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:22.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:22 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:22.370+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:22.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:22.398+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:22.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:22.398+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:22.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:22.398+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:23.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:22.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:23.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:22.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:23.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:22 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:22.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:23.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:23.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:23.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:23.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:23.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:23.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:23.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:23 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:23.043+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:23.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:23.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:23.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:23.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:23.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:23.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:23.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:23.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:23.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:23.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:23.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:23.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:23.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:23.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:23.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:23.355+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:23.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:23.355+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:23.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:23.355+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:24.381 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:23.904+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:24.381 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:23.904+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:24.381 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:23 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:23.904+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:24.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.011+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:24.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.011+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:24.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.011+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:24.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.011+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:24.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.011+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:24.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:24.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:24.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:24.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:24.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:24.393+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:24.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:24.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:24.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:24.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:24.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:24.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:24.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:24.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:24.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:24 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:24.228+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:24.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:24.380+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:24.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:24.380+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:24.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:24.380+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:25.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:24.888+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:25.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:24.888+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:25.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:24.888+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:25.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:24 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:24.888+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:25.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:25.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:25.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:25.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:25.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:24 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:24.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:25.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:25.246+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:25.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:25.246+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:25.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:25.246+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:25.246+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:25.246+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:25.401+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:25.401+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:25.401+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:25.644 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:25 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:25.401+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:15:01.102781+0000 front 2024-09-16T01:15:01.102808+0000 (oldest deadline 2024-09-16T01:15:25.203004+0000) 2024-09-16T01:15:25.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:25.366+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:25.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:25.366+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:25.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:25.366+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:26.339 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:25.903+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:26.340 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:25.903+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:26.340 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:25.903+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:26.340 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:25 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:25.903+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:26.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.005+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:26.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.005+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:26.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.005+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:26.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.005+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:26.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.005+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:26.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:26.444+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:34.998803+0000 front 2024-09-16T01:14:34.998839+0000 (oldest deadline 2024-09-16T01:14:59.698944+0000) 2024-09-16T01:15:26.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:26.444+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.700222+0000 front 2024-09-16T01:14:43.700242+0000 (oldest deadline 2024-09-16T01:15:07.800158+0000) 2024-09-16T01:15:26.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:26.444+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.701820+0000 front 2024-09-16T01:14:54.701911+0000 (oldest deadline 2024-09-16T01:15:19.401817+0000) 2024-09-16T01:15:26.643 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7[52360]: 2024-09-16T01:15:26.444+0000 7f5743f4c640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:15:01.102781+0000 front 2024-09-16T01:15:01.102808+0000 (oldest deadline 2024-09-16T01:15:25.203004+0000) 2024-09-16T01:15:26.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:26.285+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:26.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:26.285+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:26.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:26.285+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:26.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:26.285+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:26.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:26 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:26.285+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:26.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:26.338+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:26.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:26.338+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:26.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:26.338+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:27.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:26.867+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:27.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:26.867+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:27.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:26.867+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:27.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:26 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:26.867+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:27.239 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:26 smithi088 podman[70310]: 2024-09-16 01:15:26.942796055 +0000 UTC m=+5.593916642 container died 46544aeb7ec5370e0523303e762d63ede53e75b8ea15a6fa0a4d8ebd226a0ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:15:27.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.970+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:27.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.970+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:27.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.970+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:27.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.970+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:27.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:26 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:26.970+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:27.505 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:27 smithi088 podman[70310]: 2024-09-16 01:15:27.345080622 +0000 UTC m=+5.996201212 container cleanup 46544aeb7ec5370e0523303e762d63ede53e75b8ea15a6fa0a4d8ebd226a0ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-16T01:15:27.505 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:27 smithi088 bash[70310]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7 2024-09-16T01:15:27.505 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:27.237+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:27.506 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:27.237+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:27.506 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:27.237+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:27.506 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:27.237+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:27.506 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:27.237+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:27.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:27.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:27.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:27.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:27.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:27.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:27.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:27.372+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:27.893 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:27 smithi088 podman[70338]: 2024-09-16 01:15:27.504747362 +0000 UTC m=+0.558841825 container remove 46544aeb7ec5370e0523303e762d63ede53e75b8ea15a6fa0a4d8ebd226a0ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T01:15:28.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:27.841+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:28.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:27.841+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:28.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:27.841+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:28.155 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:27 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:27.841+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:28.233 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:27 smithi088 podman[70427]: 2024-09-16 01:15:27.814075036 +0000 UTC m=+0.015384370 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:28.233 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:27 smithi088 podman[70427]: 2024-09-16 01:15:27.922267186 +0000 UTC m=+0.123576505 container create b2749fcf8ec07d8a315aca5e690c320054a2c2e54fa49c9f88eba14bd7a9e44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T01:15:28.234 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:28 smithi088 podman[70427]: 2024-09-16 01:15:28.158132776 +0000 UTC m=+0.359442096 container init b2749fcf8ec07d8a315aca5e690c320054a2c2e54fa49c9f88eba14bd7a9e44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T01:15:28.234 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:28 smithi088 podman[70427]: 2024-09-16 01:15:28.161400119 +0000 UTC m=+0.362709442 container start b2749fcf8ec07d8a315aca5e690c320054a2c2e54fa49c9f88eba14bd7a9e44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:15:28.234 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:28 smithi088 podman[70427]: 2024-09-16 01:15:28.233038671 +0000 UTC m=+0.434347999 container attach b2749fcf8ec07d8a315aca5e690c320054a2c2e54fa49c9f88eba14bd7a9e44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T01:15:28.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:28.000+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:28.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:28.000+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:28.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:28.000+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:28.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:28.000+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:28.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:28 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:28.000+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.7.smithi088.stdout:Sep 16 01:15:28 smithi088 podman[70427]: 2024-09-16 01:15:28.355865001 +0000 UTC m=+0.557174322 container died b2749fcf8ec07d8a315aca5e690c320054a2c2e54fa49c9f88eba14bd7a9e44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:28 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:28.261+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:28 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:28.261+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:28 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:28.261+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:28 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:28.261+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:28.637 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:28 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:28.261+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:28.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:28.341+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:28.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:28.341+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:28.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:28.341+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:28.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:28.341+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:28.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.7.service' 2024-09-16T01:15:28.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:28.993 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-16T01:15:28.994 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-16T01:15:28.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.8 2024-09-16T01:15:29.022 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:28.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:29.022 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:28.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:29.022 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:28.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:29.022 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:28 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:28.873+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:29.323 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 systemd[1]: Stopping Ceph osd.8 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:29.324 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.322+0000 7f0f35777640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:29.324 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.322+0000 7f0f35777640 -1 osd.8 97 *** Got signal Terminated *** 2024-09-16T01:15:29.324 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.322+0000 7f0f35777640 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:29.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:29.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:29.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:29.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:29.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.009+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:29.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:29 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:29.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:29.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:29 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:29.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:29.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:29 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:29.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:29.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:29 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:29.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:29.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:29 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:29.220+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:29.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:29.332+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:29.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:29.332+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:29.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:29.332+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:29.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:29.332+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:30.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.875+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:30.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.875+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:30.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.876+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:30.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:29 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:29.876+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:30.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:30.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:30.437 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:30.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:30.438 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:29 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:29.963+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:30.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:30 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:30.232+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:30.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:30 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:30.232+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:30.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:30 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:30.232+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:30.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:30 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:30.232+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:30.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:30 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:30.232+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:30.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:30.314+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:30.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:30.314+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:30.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:30.314+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:30.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:30.314+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:31.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:30.827+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:31.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:30.827+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:31.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:30.827+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:31.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:30 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:30.827+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:31.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:30.928+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:31.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:30.928+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:31.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:30.928+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:31.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:30.928+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:31.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:30 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:30.928+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:31.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:31.247+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:31.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:31.247+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:31.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:31.247+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:31.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:31.247+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:31.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:31 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:31.247+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:31.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:31.364+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:31.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:31.364+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:31.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:31.364+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:31.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:31.364+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:32.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:31.848+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:32.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:31.848+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:32.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:31.848+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:32.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:31.848+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:32.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:31.901+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:32.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:31.901+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:32.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:31.901+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:32.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:31.901+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:32.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:31 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:31.901+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:32.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:32.256+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:32.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:32.256+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:32.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:32.256+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:32.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:32.256+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:32.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:32 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:32.256+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:32.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:32.316+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:32.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:32.316+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:32.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:32.316+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:32.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:32.316+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:32.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:32.316+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:33.153 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:32.885+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:33.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:32.885+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:33.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:32.885+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:33.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:32 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:32.885+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:33.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:32.872+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:33.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:32.872+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:33.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:32.872+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:33.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:32.872+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:33.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:32 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:32.872+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:33.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:33.212+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:33.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:33.212+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:33.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:33.212+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:33.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:33.212+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:33.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:33 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:33.212+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:33.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:33.323+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:33.653 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:33.323+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:33.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:33.323+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:33.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:33.323+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:33.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:33.323+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:34.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:33.840+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:29.417681+0000 front 2024-09-16T01:14:29.417526+0000 (oldest deadline 2024-09-16T01:14:51.717541+0000) 2024-09-16T01:15:34.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:33.840+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:45.819650+0000 front 2024-09-16T01:14:45.819698+0000 (oldest deadline 2024-09-16T01:15:07.519907+0000) 2024-09-16T01:15:34.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:33.840+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:54.521562+0000 front 2024-09-16T01:14:54.521504+0000 (oldest deadline 2024-09-16T01:15:18.021387+0000) 2024-09-16T01:15:34.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:33.840+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.522642+0000 front 2024-09-16T01:14:58.522497+0000 (oldest deadline 2024-09-16T01:15:24.422438+0000) 2024-09-16T01:15:34.154 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:33 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8[53570]: 2024-09-16T01:15:33.840+0000 7f0f2dd85640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.523215+0000 front 2024-09-16T01:15:08.523155+0000 (oldest deadline 2024-09-16T01:15:33.823240+0000) 2024-09-16T01:15:34.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:33 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:33.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:34.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:33 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:33.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:34.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:33 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:33.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:34.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:33 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:33.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:34.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:33 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:33.843+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:34.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:34.177+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:34.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:34.177+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:34.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:34.177+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:34.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:34.177+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:34.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:34 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:34.177+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:34.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:34.285+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:34.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:34.285+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:34.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:34.285+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:34.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:34.285+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:34.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:34 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:34.285+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:34.966 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:34 smithi154 podman[72103]: 2024-09-16 01:15:34.683187133 +0000 UTC m=+5.486860821 container died 520cc052561b08156855940b35dc9b6f152c0b5453179e1b1cc456177c998908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-16T01:15:35.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:34.805+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:35.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:34.805+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:35.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:34.805+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:35.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:34.805+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:35.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:34 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:34.805+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:35.239 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72103]: 2024-09-16 01:15:35.063919916 +0000 UTC m=+5.867593594 container cleanup 520cc052561b08156855940b35dc9b6f152c0b5453179e1b1cc456177c998908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:15:35.240 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 bash[72103]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8 2024-09-16T01:15:35.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:35.147+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:35.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:35.147+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:35.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:35.147+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:35.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:35.147+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:35.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:35 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:35.147+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:35.654 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72119]: 2024-09-16 01:15:35.348519779 +0000 UTC m=+0.660736501 container remove 520cc052561b08156855940b35dc9b6f152c0b5453179e1b1cc456177c998908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:35.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:35.238+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:35.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:35.238+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:35.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:35.238+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:35.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:35.238+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:35.655 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:35.238+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:35.944 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72207]: 2024-09-16 01:15:35.586439353 +0000 UTC m=+0.015908176 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:35.944 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72207]: 2024-09-16 01:15:35.691064769 +0000 UTC m=+0.120533577 container create 8ffaea36913a1280bd7d6c4a5c55674aa7e49985742fb6f1fd5408efacc894c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:35.944 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72207]: 2024-09-16 01:15:35.943614756 +0000 UTC m=+0.373083569 container init 8ffaea36913a1280bd7d6c4a5c55674aa7e49985742fb6f1fd5408efacc894c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:36.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:35 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:35.787+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:36.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:35 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:35.787+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:36.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:35 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:35.787+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:36.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:35 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:35.787+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:36.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:35 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:35.787+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:36.252 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:35 smithi154 podman[72207]: 2024-09-16 01:15:35.947213198 +0000 UTC m=+0.376682009 container start 8ffaea36913a1280bd7d6c4a5c55674aa7e49985742fb6f1fd5408efacc894c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:36.252 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:36 smithi154 podman[72207]: 2024-09-16 01:15:36.035504226 +0000 UTC m=+0.464973042 container attach 8ffaea36913a1280bd7d6c4a5c55674aa7e49985742fb6f1fd5408efacc894c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-16T01:15:36.253 INFO:journalctl@ceph.osd.8.smithi154.stdout:Sep 16 01:15:36 smithi154 podman[72207]: 2024-09-16 01:15:36.134066074 +0000 UTC m=+0.563534883 container died 8ffaea36913a1280bd7d6c4a5c55674aa7e49985742fb6f1fd5408efacc894c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-16T01:15:36.625 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:36 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:36.250+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:36.625 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:36 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:36.250+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:36.625 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:36 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:36.250+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:36.625 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:36 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:36.250+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:36.625 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:36 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:36.250+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:36.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:36.155+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:36.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:36.155+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:36.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:36.155+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:36.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:36.155+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:36.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:36 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:36.155+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:36.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.8.service' 2024-09-16T01:15:36.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:36.812 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-16T01:15:36.812 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-16T01:15:36.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.9 2024-09-16T01:15:37.128 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:36.758+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:37.128 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:36.758+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:37.128 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:36.758+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:36.758+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:36.758+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:36 smithi017 systemd[1]: Stopping Ceph osd.9 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.126+0000 7fd02051a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.126+0000 7fd02051a640 -1 osd.9 97 *** Got signal Terminated *** 2024-09-16T01:15:37.129 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.126+0000 7fd02051a640 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:37.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:37.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:37.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:37.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:37.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:37.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:37 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:37.203+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:37.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:37 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:37.206+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:37.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:37 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:37.206+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:37.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:37 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:37.206+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:37.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:37 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:37.206+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:37.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:37 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:37.206+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:38.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.729+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:38.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.729+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:38.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.729+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:38.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.729+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:38.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:37 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:37.729+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:38.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:38.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:38.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:38.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:38.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:38.644 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:38 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:38.168+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:38.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:38 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:38.172+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:38.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:38 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:38.172+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:38.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:38 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:38.172+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:38.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:38 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:38.172+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:38.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:38 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:38.172+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:39.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:38 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:38.711+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:39.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:38 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:38.711+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:39.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:38 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:38.711+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:39.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:38 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:38.711+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:39.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:38 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:38.711+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:39.643 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:39 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:39.148+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:39.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:39.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:39.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:39.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:39.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:39.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:39.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:39.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:39.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:39.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:40.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:39 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:39.705+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:40.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:39 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:39.705+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:40.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:39 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:39.705+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:40.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:39 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:39.705+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:40.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:39 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:39.705+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:40.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:40.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:40.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:40.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:40.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:40.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:40 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:40.130+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:40.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:40 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:40.225+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:40.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:40 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:40.225+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:40.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:40 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:40.225+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:40.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:40 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:40.225+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:40.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:40 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:40.225+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:41.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:40 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:40.752+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:41.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:40 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:40.752+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:41.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:40 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:40.752+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:41.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:40 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:40.752+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:41.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:40 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:40.752+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:41.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:41.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:41.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:41.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:41.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:41.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:41.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:41 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:41.138+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:41.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:41.247+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:41.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:41.247+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:41.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:41.247+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:41.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:41.247+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:41.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:41 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:41.247+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:42.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:41 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:41.735+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.600325+0000 front 2024-09-16T01:14:30.600476+0000 (oldest deadline 2024-09-16T01:14:52.900594+0000) 2024-09-16T01:15:42.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:41 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:41.735+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:35.201664+0000 front 2024-09-16T01:14:35.201633+0000 (oldest deadline 2024-09-16T01:15:01.101657+0000) 2024-09-16T01:15:42.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:41 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:41.735+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.402801+0000 front 2024-09-16T01:14:43.402949+0000 (oldest deadline 2024-09-16T01:15:09.302663+0000) 2024-09-16T01:15:42.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:41 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:41.735+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:53.304055+0000 front 2024-09-16T01:14:53.304018+0000 (oldest deadline 2024-09-16T01:15:18.604049+0000) 2024-09-16T01:15:42.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:41 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9[62565]: 2024-09-16T01:15:41.735+0000 7fd018b28640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:58.604836+0000 front 2024-09-16T01:14:58.604601+0000 (oldest deadline 2024-09-16T01:15:23.904560+0000) 2024-09-16T01:15:42.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:42.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:42.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:42.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:42.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:42.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:42.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:42 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:42.093+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:42.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:42 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:42.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:42.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:42 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:42.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:42.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:42 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:42.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:42.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:42 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:42.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:42.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:42 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:42.218+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:42.937 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:42 smithi017 podman[90343]: 2024-09-16 01:15:42.66729039 +0000 UTC m=+5.651690459 container died 14925c37b8f6ae2172cfdf15719291a0f1a9c6df30e95a7f8e0c62738d908855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T01:15:43.303 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90343]: 2024-09-16 01:15:43.034572698 +0000 UTC m=+6.018972763 container cleanup 14925c37b8f6ae2172cfdf15719291a0f1a9c6df30e95a7f8e0c62738d908855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:15:43.303 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 bash[90343]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:43.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:43.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:43 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:43.055+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:43.622 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90359]: 2024-09-16 01:15:43.302440298 +0000 UTC m=+0.631014493 container remove 14925c37b8f6ae2172cfdf15719291a0f1a9c6df30e95a7f8e0c62738d908855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:43.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:43.230+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:43.872 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90449]: 2024-09-16 01:15:43.52466042 +0000 UTC m=+0.016579187 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:43.873 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90449]: 2024-09-16 01:15:43.64468634 +0000 UTC m=+0.136605090 container create c613ad1386f49717852adf37833e4b5ed8d7cc1556d6bb712b55749640b27a9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T01:15:44.187 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90449]: 2024-09-16 01:15:43.87220698 +0000 UTC m=+0.364125730 container init c613ad1386f49717852adf37833e4b5ed8d7cc1556d6bb712b55749640b27a9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-16T01:15:44.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90449]: 2024-09-16 01:15:43.876038558 +0000 UTC m=+0.367957314 container start c613ad1386f49717852adf37833e4b5ed8d7cc1556d6bb712b55749640b27a9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e) 2024-09-16T01:15:44.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:43 smithi017 podman[90449]: 2024-09-16 01:15:43.963867941 +0000 UTC m=+0.455786707 container attach c613ad1386f49717852adf37833e4b5ed8d7cc1556d6bb712b55749640b27a9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T01:15:44.188 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 16 01:15:44 smithi017 podman[90449]: 2024-09-16 01:15:44.068237924 +0000 UTC m=+0.560156677 container died c613ad1386f49717852adf37833e4b5ed8d7cc1556d6bb712b55749640b27a9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:15:44.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:44.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:44.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:44.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:44.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:44.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:44.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:44.072+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:44.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:44 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:44.201+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:44.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.9.service' 2024-09-16T01:15:44.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:44.947 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-16T01:15:44.947 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-16T01:15:44.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.10 2024-09-16T01:15:45.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:44 smithi088 systemd[1]: Stopping Ceph osd.10 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:45.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.104+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:45.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:45 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:45.199+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:45.893 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.446+0000 7fdf52f9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:45.893 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.446+0000 7fdf52f9b640 -1 osd.10 97 *** Got signal Terminated *** 2024-09-16T01:15:45.893 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:45 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:45.446+0000 7fdf52f9b640 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:46.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:46.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:46.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:46.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:46.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:46.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:46.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:46 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:46.098+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:46.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:46 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:46.177+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:47.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:47.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:47.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:47.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:47.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:47.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:47.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:47 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:47.141+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:47.462 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:47.463 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:47.463 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:47.463 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:47.463 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:47.463 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:47 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:47.168+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:48.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:48.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:48.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:48.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:48.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:48.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:48.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:48 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:48.115+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:48.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:48 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:48.131+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:49.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:49.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:49.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:49.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:49.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:49.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:49.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:49 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:49.090+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:49.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:49 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:49.151+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:50.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:30.492812+0000 front 2024-09-16T01:14:30.492864+0000 (oldest deadline 2024-09-16T01:14:53.992797+0000) 2024-09-16T01:15:50.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:38.093720+0000 front 2024-09-16T01:14:38.093650+0000 (oldest deadline 2024-09-16T01:15:03.393743+0000) 2024-09-16T01:15:50.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:43.394329+0000 front 2024-09-16T01:14:43.394215+0000 (oldest deadline 2024-09-16T01:15:09.294129+0000) 2024-09-16T01:15:50.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-16T01:14:52.695580+0000 front 2024-09-16T01:14:52.695520+0000 (oldest deadline 2024-09-16T01:15:17.395466+0000) 2024-09-16T01:15:50.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.395875+0000 front 2024-09-16T01:14:57.395901+0000 (oldest deadline 2024-09-16T01:15:23.295986+0000) 2024-09-16T01:15:50.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:09.097229+0000 front 2024-09-16T01:15:09.097211+0000 (oldest deadline 2024-09-16T01:15:36.697402+0000) 2024-09-16T01:15:50.394 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10[59178]: 2024-09-16T01:15:50.101+0000 7fdf4b5a9640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:16.698035+0000 front 2024-09-16T01:15:16.698267+0000 (oldest deadline 2024-09-16T01:15:40.797874+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:50.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:50 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:50.113+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:51.104 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:50 smithi088 podman[70530]: 2024-09-16 01:15:50.789515895 +0000 UTC m=+5.650959721 container died d06cb70276000f005b2a5db0709ad942dd91aec75c1c47f736efcf98c730e5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:15:51.105 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70530]: 2024-09-16 01:15:51.104011533 +0000 UTC m=+5.965455357 container cleanup d06cb70276000f005b2a5db0709ad942dd91aec75c1c47f736efcf98c730e5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T01:15:51.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 bash[70530]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10 2024-09-16T01:15:51.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70545]: 2024-09-16 01:15:51.280249314 +0000 UTC m=+0.492133265 container remove d06cb70276000f005b2a5db0709ad942dd91aec75c1c47f736efcf98c730e5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:15:51.403 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:51.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:51 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:51.145+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:52.042 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70635]: 2024-09-16 01:15:51.618589376 +0000 UTC m=+0.015450851 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:52.042 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70635]: 2024-09-16 01:15:51.73094354 +0000 UTC m=+0.127805001 container create 68127e3037499254f514cf98ebc6c18a622bf4be45b9797884ec8bfdec011a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T01:15:52.042 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70635]: 2024-09-16 01:15:51.958599374 +0000 UTC m=+0.355460835 container init 68127e3037499254f514cf98ebc6c18a622bf4be45b9797884ec8bfdec011a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:52.043 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:51 smithi088 podman[70635]: 2024-09-16 01:15:51.961859423 +0000 UTC m=+0.358720893 container start 68127e3037499254f514cf98ebc6c18a622bf4be45b9797884ec8bfdec011a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:15:52.043 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:52 smithi088 podman[70635]: 2024-09-16 01:15:52.041902207 +0000 UTC m=+0.438763684 container attach 68127e3037499254f514cf98ebc6c18a622bf4be45b9797884ec8bfdec011a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:15:52.393 INFO:journalctl@ceph.osd.10.smithi088.stdout:Sep 16 01:15:52 smithi088 podman[70635]: 2024-09-16 01:15:52.149385343 +0000 UTC m=+0.546246815 container died 68127e3037499254f514cf98ebc6c18a622bf4be45b9797884ec8bfdec011a78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:52.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:52.159+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:52.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.10.service' 2024-09-16T01:15:52.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:15:52.789 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-16T01:15:52.790 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-16T01:15:52.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.11 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:52 smithi154 systemd[1]: Stopping Ceph osd.11 for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:53.131 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.129+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:53.403 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.132+0000 7faf79d33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:15:53.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.132+0000 7faf79d33640 -1 osd.11 97 *** Got signal Terminated *** 2024-09-16T01:15:53.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:53 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:53.132+0000 7faf79d33640 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:54.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:54 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:54.136+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:55.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:55 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:55.155+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:56.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:56 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:56.200+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-16T01:14:28.632899+0000 front 2024-09-16T01:14:28.632965+0000 (oldest deadline 2024-09-16T01:14:54.533029+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6804 osd.1 since back 2024-09-16T01:14:36.833959+0000 front 2024-09-16T01:14:36.834106+0000 (oldest deadline 2024-09-16T01:15:02.733983+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-09-16T01:14:46.735326+0000 front 2024-09-16T01:14:46.735306+0000 (oldest deadline 2024-09-16T01:15:07.835400+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6812 osd.4 since back 2024-09-16T01:14:57.137676+0000 front 2024-09-16T01:14:57.137646+0000 (oldest deadline 2024-09-16T01:15:27.138179+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-09-16T01:15:08.239256+0000 front 2024-09-16T01:15:08.239179+0000 (oldest deadline 2024-09-16T01:15:31.739277+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-16T01:15:17.540562+0000 front 2024-09-16T01:15:17.540501+0000 (oldest deadline 2024-09-16T01:15:42.840483+0000) 2024-09-16T01:15:57.654 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:57 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11[60105]: 2024-09-16T01:15:57.165+0000 7faf72341640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.88:6820 osd.7 since back 2024-09-16T01:15:25.041880+0000 front 2024-09-16T01:15:25.041856+0000 (oldest deadline 2024-09-16T01:15:47.341695+0000) 2024-09-16T01:15:58.759 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:58 smithi154 podman[72335]: 2024-09-16 01:15:58.489994027 +0000 UTC m=+5.504883815 container died b32d784bee42f3a99e394c5f999c590a1c111ffba175f5dd85c959e133b19cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T01:15:59.143 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:58 smithi154 podman[72335]: 2024-09-16 01:15:58.849900382 +0000 UTC m=+5.864790162 container cleanup b32d784bee42f3a99e394c5f999c590a1c111ffba175f5dd85c959e133b19cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:15:59.143 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:58 smithi154 bash[72335]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11 2024-09-16T01:15:59.404 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72351]: 2024-09-16 01:15:59.142745762 +0000 UTC m=+0.647114007 container remove b32d784bee42f3a99e394c5f999c590a1c111ffba175f5dd85c959e133b19cc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T01:15:59.746 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.460403495 +0000 UTC m=+0.112922311 container create 6977a0e8b03d1839a9cf8ed146dc4b09725af7f5314695ddd344787197c2b609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T01:15:59.746 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.363330095 +0000 UTC m=+0.015848883 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:59.746 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.670986797 +0000 UTC m=+0.323505567 container init 6977a0e8b03d1839a9cf8ed146dc4b09725af7f5314695ddd344787197c2b609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-16T01:15:59.746 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.674408919 +0000 UTC m=+0.326927696 container start 6977a0e8b03d1839a9cf8ed146dc4b09725af7f5314695ddd344787197c2b609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T01:15:59.746 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.745974709 +0000 UTC m=+0.398493480 container attach 6977a0e8b03d1839a9cf8ed146dc4b09725af7f5314695ddd344787197c2b609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:16:00.154 INFO:journalctl@ceph.osd.11.smithi154.stdout:Sep 16 01:15:59 smithi154 podman[72440]: 2024-09-16 01:15:59.860037684 +0000 UTC m=+0.512556457 container died 6977a0e8b03d1839a9cf8ed146dc4b09725af7f5314695ddd344787197c2b609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:00.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@osd.11.service' 2024-09-16T01:16:00.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:00.507 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-16T01:16:00.507 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-16T01:16:00.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.a 2024-09-16T01:16:00.812 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:00 smithi017 systemd[1]: Stopping Ceph mds.a for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:01.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: 2024-09-16T01:16:00.810+0000 7f39d0463640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:01.187 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:00 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a[69834]: 2024-09-16T01:16:00.810+0000 7f39d0463640 -1 mds.a *** got signal Terminated *** 2024-09-16T01:16:02.603 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:02 smithi017 podman[90567]: 2024-09-16 01:16:02.299264697 +0000 UTC m=+1.584195885 container died a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-16T01:16:02.603 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:02 smithi017 podman[90567]: 2024-09-16 01:16:02.602937727 +0000 UTC m=+1.887868920 container cleanup a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:16:02.937 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:02 smithi017 bash[90567]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a 2024-09-16T01:16:03.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.a.service' 2024-09-16T01:16:03.215 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:02 smithi017 podman[90581]: 2024-09-16 01:16:02.962220107 +0000 UTC m=+0.654842767 container remove a4ddbd17dd8428954889ff7d1fda5c5a07f08b0351a5c67ad5078d0fd99ec603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T01:16:03.215 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:03 smithi017 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-16T01:16:03.216 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:03 smithi017 systemd[1]: Stopped Ceph mds.a for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:16:03.216 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 16 01:16:03 smithi017 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.a.service: Consumed 2.050s CPU time. 2024-09-16T01:16:03.229 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:03.229 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-16T01:16:03.230 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-16T01:16:03.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.d 2024-09-16T01:16:03.565 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:03 smithi017 systemd[1]: Stopping Ceph mds.d for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:03.937 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d[68640]: 2024-09-16T01:16:03.563+0000 7fceab271640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:03.937 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:03 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d[68640]: 2024-09-16T01:16:03.563+0000 7fceab271640 -1 mds.d *** got signal Terminated *** 2024-09-16T01:16:05.187 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:04 smithi017 podman[90686]: 2024-09-16 01:16:04.929944271 +0000 UTC m=+1.480252651 container died 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T01:16:05.493 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:05 smithi017 podman[90686]: 2024-09-16 01:16:05.281268852 +0000 UTC m=+1.831577233 container cleanup 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T01:16:05.493 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:05 smithi017 bash[90686]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d 2024-09-16T01:16:05.748 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 16 01:16:05 smithi017 podman[90700]: 2024-09-16 01:16:05.60727419 +0000 UTC m=+0.675210632 container remove 118b4625910fcf73b57a515801dba59f8fe3ca4be71964a9cd7eac1aa2f6841f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:16:05.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.d.service' 2024-09-16T01:16:05.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:05.797 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-16T01:16:05.797 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-16T01:16:05.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.g 2024-09-16T01:16:06.077 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:05 smithi017 systemd[1]: Stopping Ceph mds.g for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:06.437 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: 2024-09-16T01:16:06.176+0000 7f36258a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:06.437 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:06 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g[69433]: 2024-09-16T01:16:06.176+0000 7f36258a0640 -1 mds.g *** got signal Terminated *** 2024-09-16T01:16:10.496 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:10 smithi017 podman[90806]: 2024-09-16 01:16:10.191938266 +0000 UTC m=+4.146757723 container died f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:10.878 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:10 smithi017 podman[90806]: 2024-09-16 01:16:10.597272363 +0000 UTC m=+4.552091808 container cleanup f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:10.878 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:10 smithi017 bash[90806]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g 2024-09-16T01:16:11.177 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 16 01:16:10 smithi017 podman[90818]: 2024-09-16 01:16:10.878056704 +0000 UTC m=+0.684410170 container remove f30a2f5b25776655ec1942d99389cc7135e5f00f3935d2fa053b6c9c8f5b4ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:16:11.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.g.service' 2024-09-16T01:16:11.229 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:11.229 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-16T01:16:11.229 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-16T01:16:11.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.j 2024-09-16T01:16:11.548 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:11 smithi017 systemd[1]: Stopping Ceph mds.j for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:11.937 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j[68245]: 2024-09-16T01:16:11.546+0000 7fe8223b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:11.937 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:11 smithi017 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j[68245]: 2024-09-16T01:16:11.546+0000 7fe8223b5640 -1 mds.j *** got signal Terminated *** 2024-09-16T01:16:13.231 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:12 smithi017 podman[90927]: 2024-09-16 01:16:12.97400711 +0000 UTC m=+1.515775200 container died 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:16:13.687 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:13 smithi017 podman[90927]: 2024-09-16 01:16:13.330161007 +0000 UTC m=+1.871929086 container cleanup 01f36a7adce2c74681e2fa39770c7d4b1f16cd562647cd6e997c486b214ea56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T01:16:13.688 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 16 01:16:13 smithi017 bash[90927]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-j 2024-09-16T01:16:13.913 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.j.service' 2024-09-16T01:16:13.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:13.947 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-16T01:16:13.947 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-16T01:16:13.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.b 2024-09-16T01:16:14.247 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:13 smithi088 systemd[1]: Stopping Ceph mds.b for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:14.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:16:14.245+0000 7f7f70515640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:14.643 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:14 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b[64360]: 2024-09-16T01:16:14.245+0000 7f7f70515640 -1 mds.b *** got signal Terminated *** 2024-09-16T01:16:18.571 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:18 smithi088 podman[70747]: 2024-09-16 01:16:18.257225795 +0000 UTC m=+4.114708542 container died 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T01:16:18.880 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:18 smithi088 podman[70747]: 2024-09-16 01:16:18.669900234 +0000 UTC m=+4.527382981 container cleanup 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:16:18.880 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:18 smithi088 bash[70747]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b 2024-09-16T01:16:19.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.b.service' 2024-09-16T01:16:19.131 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:18 smithi088 podman[70759]: 2024-09-16 01:16:18.879375722 +0000 UTC m=+0.618965713 container remove 8e7c7aea3a1b0cdba0ed380ad5c2e4d6e561a9827e69247cb63a84fcc523e138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:19.131 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:19 smithi088 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-16T01:16:19.131 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:19 smithi088 systemd[1]: Stopped Ceph mds.b for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:16:19.131 INFO:journalctl@ceph.mds.b.smithi088.stdout:Sep 16 01:16:19 smithi088 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.b.service: Consumed 9.064s CPU time. 2024-09-16T01:16:19.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:19.142 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-16T01:16:19.142 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-16T01:16:19.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.e 2024-09-16T01:16:19.393 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:19 smithi088 systemd[1]: Stopping Ceph mds.e for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:19.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: 2024-09-16T01:16:19.473+0000 7fe40a3a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:19.893 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:19 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e[63739]: 2024-09-16T01:16:19.473+0000 7fe40a3a1640 -1 mds.e *** got signal Terminated *** 2024-09-16T01:16:22.597 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:22 smithi088 podman[70867]: 2024-09-16 01:16:22.311069613 +0000 UTC m=+2.955921571 container died 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T01:16:22.892 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:22 smithi088 podman[70867]: 2024-09-16 01:16:22.740258127 +0000 UTC m=+3.385110085 container cleanup 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T01:16:22.892 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:22 smithi088 bash[70867]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e 2024-09-16T01:16:23.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.e.service' 2024-09-16T01:16:23.143 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:22 smithi088 podman[70879]: 2024-09-16 01:16:22.891497181 +0000 UTC m=+0.577011206 container remove 843658d0b44f5acd7a513e98d56ba107328949c3089ecb0afeb8c7ccd82b258d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:23.143 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:23 smithi088 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-16T01:16:23.143 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:23 smithi088 systemd[1]: Stopped Ceph mds.e for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:16:23.143 INFO:journalctl@ceph.mds.e.smithi088.stdout:Sep 16 01:16:23 smithi088 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.e.service: Consumed 2.022s CPU time. 2024-09-16T01:16:23.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:23.162 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-16T01:16:23.163 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-16T01:16:23.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.h 2024-09-16T01:16:23.486 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:23 smithi088 systemd[1]: Stopping Ceph mds.h for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:23.893 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: 2024-09-16T01:16:23.485+0000 7fa12482e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:23.893 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:23 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h[64045]: 2024-09-16T01:16:23.485+0000 7fa12482e640 -1 mds.h *** got signal Terminated *** 2024-09-16T01:16:26.578 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:26 smithi088 podman[70990]: 2024-09-16 01:16:26.303114062 +0000 UTC m=+2.916038111 container died 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:16:26.893 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:26 smithi088 podman[70990]: 2024-09-16 01:16:26.668912306 +0000 UTC m=+3.281836353 container cleanup 0e8409b82a732809b60f8958e335eee7cc99fe6064a43c5f96a4f54bf47d9cb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-16T01:16:26.893 INFO:journalctl@ceph.mds.h.smithi088.stdout:Sep 16 01:16:26 smithi088 bash[70990]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-h 2024-09-16T01:16:27.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.h.service' 2024-09-16T01:16:27.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:27.138 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-16T01:16:27.138 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-16T01:16:27.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.k 2024-09-16T01:16:27.465 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:27 smithi088 systemd[1]: Stopping Ceph mds.k for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:27.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: 2024-09-16T01:16:27.463+0000 7f4810160640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:27.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:27 smithi088 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k[63439]: 2024-09-16T01:16:27.463+0000 7f4810160640 -1 mds.k *** got signal Terminated *** 2024-09-16T01:16:30.591 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:30 smithi088 podman[71123]: 2024-09-16 01:16:30.310935633 +0000 UTC m=+2.952129231 container died 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:16:30.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:30 smithi088 podman[71123]: 2024-09-16 01:16:30.680406121 +0000 UTC m=+3.321599712 container cleanup 45fb5c3c7297711c15529bebddc13a08d19ce52eeea4983d6971c9f635a50472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T01:16:30.893 INFO:journalctl@ceph.mds.k.smithi088.stdout:Sep 16 01:16:30 smithi088 bash[71123]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-k 2024-09-16T01:16:31.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.k.service' 2024-09-16T01:16:31.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:31.108 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-16T01:16:31.108 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-16T01:16:31.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.c 2024-09-16T01:16:31.404 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:31 smithi154 systemd[1]: Stopping Ceph mds.c for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:31.665 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: 2024-09-16T01:16:31.482+0000 7fa36cea6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:31.666 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:31 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c[65071]: 2024-09-16T01:16:31.482+0000 7fa36cea6640 -1 mds.c *** got signal Terminated *** 2024-09-16T01:16:34.558 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:34 smithi154 podman[72545]: 2024-09-16 01:16:34.300017744 +0000 UTC m=+3.001795635 container died bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-16T01:16:34.904 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:34 smithi154 podman[72545]: 2024-09-16 01:16:34.656810637 +0000 UTC m=+3.358588563 container cleanup bbb9ab961e04a59099b62f7d1d238b288458fd44d36391e1de417db8162246f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T01:16:34.904 INFO:journalctl@ceph.mds.c.smithi154.stdout:Sep 16 01:16:34 smithi154 bash[72545]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-c 2024-09-16T01:16:35.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.c.service' 2024-09-16T01:16:35.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:35.114 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-16T01:16:35.115 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-16T01:16:35.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.f 2024-09-16T01:16:35.453 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:35 smithi154 systemd[1]: Stopping Ceph mds.f for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:35.904 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: 2024-09-16T01:16:35.452+0000 7fcad581d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:35.904 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:35 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f[64772]: 2024-09-16T01:16:35.452+0000 7fcad581d640 -1 mds.f *** got signal Terminated *** 2024-09-16T01:16:38.578 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:38 smithi154 podman[72679]: 2024-09-16 01:16:38.296674973 +0000 UTC m=+2.960993825 container died 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:16:38.904 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:38 smithi154 podman[72679]: 2024-09-16 01:16:38.669120775 +0000 UTC m=+3.333439625 container cleanup 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:38.904 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:38 smithi154 bash[72679]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f 2024-09-16T01:16:38.904 INFO:journalctl@ceph.mds.f.smithi154.stdout:Sep 16 01:16:38 smithi154 podman[72690]: 2024-09-16 01:16:38.786796154 +0000 UTC m=+0.486041260 container remove 1c24ccf4800b97edeb59a9492de9bfd293503a3ccc0d2cfebebc60e31b901ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:16:39.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.f.service' 2024-09-16T01:16:39.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:39.054 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-16T01:16:39.054 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-16T01:16:39.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.i 2024-09-16T01:16:39.356 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:39 smithi154 systemd[1]: Stopping Ceph mds.i for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:39.654 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: 2024-09-16T01:16:39.355+0000 7fb77a5f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:39.654 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:39 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i[65378]: 2024-09-16T01:16:39.355+0000 7fb77a5f5640 -1 mds.i *** got signal Terminated *** 2024-09-16T01:16:42.404 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:42 smithi154 podman[72796]: 2024-09-16 01:16:42.304592727 +0000 UTC m=+3.033253739 container died cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-16T01:16:42.903 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:42 smithi154 podman[72796]: 2024-09-16 01:16:42.730985416 +0000 UTC m=+3.459646417 container cleanup cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T01:16:42.904 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:42 smithi154 bash[72796]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i 2024-09-16T01:16:43.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.i.service' 2024-09-16T01:16:43.187 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:42 smithi154 podman[72809]: 2024-09-16 01:16:42.923798528 +0000 UTC m=+0.613399702 container remove cda17ad8e22b8b50aebb31e1d24d8a0edc277b39823cb2f6640f775050e2765a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T01:16:43.188 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:43 smithi154 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-16T01:16:43.188 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:43 smithi154 systemd[1]: Stopped Ceph mds.i for d67bb9a6-73c5-11ef-bceb-c7b262605968. 2024-09-16T01:16:43.188 INFO:journalctl@ceph.mds.i.smithi154.stdout:Sep 16 01:16:43 smithi154 systemd[1]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.i.service: Consumed 2.020s CPU time. 2024-09-16T01:16:43.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:43.199 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-16T01:16:43.199 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-16T01:16:43.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.l 2024-09-16T01:16:43.527 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:43 smithi154 systemd[1]: Stopping Ceph mds.l for d67bb9a6-73c5-11ef-bceb-c7b262605968... 2024-09-16T01:16:43.904 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: 2024-09-16T01:16:43.526+0000 7f1ba6a7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:16:43.904 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:43 smithi154 ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l[64468]: 2024-09-16T01:16:43.526+0000 7f1ba6a7a640 -1 mds.l *** got signal Terminated *** 2024-09-16T01:16:46.569 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:46 smithi154 podman[72916]: 2024-09-16 01:16:46.312084548 +0000 UTC m=+2.888756289 container died cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T01:16:46.903 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:46 smithi154 podman[72916]: 2024-09-16 01:16:46.643212001 +0000 UTC m=+3.219883742 container cleanup cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:16:46.904 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:46 smithi154 bash[72916]: ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l 2024-09-16T01:16:46.904 INFO:journalctl@ceph.mds.l.smithi154.stdout:Sep 16 01:16:46 smithi154 podman[72929]: 2024-09-16 01:16:46.794218347 +0000 UTC m=+0.484125427 container remove cec399b9ea1ceca79bf286017c573c6fe7b86e87da3c230ab64080367edf947c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T01:16:47.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d67bb9a6-73c5-11ef-bceb-c7b262605968@mds.l.service' 2024-09-16T01:16:47.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:16:47.046 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-16T01:16:47.047 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:16:47.257 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:16:49.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:16:50.034 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:16:52.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:16:52.703 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:16:55.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:16:55.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:16:55.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:16:55.117 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T01:16:55.119 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi017/crash 2024-09-16T01:16:55.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:16:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:16:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:16:55.164 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi088/crash 2024-09-16T01:16:55.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:16:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:16:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:16:55.257 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi154/crash 2024-09-16T01:16:55.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:16:55.295 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:16:55.295 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:16:55.296 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T01:16:55.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-16T01:16:55.336 INFO:tasks.cephadm:Compressing logs... 2024-09-16T01:16:55.337 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:16:55.379 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:16:55.381 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:16:55.406 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:: No such file or directory 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:16:55.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:16:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:: No such file or directory 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.7%gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-16T01:16:55.416 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:16:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.4% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:16:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:16:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-16T01:16:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log: 87.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log: 91.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-16T01:16:55.421 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:16:55.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log: 87.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:16:55.423 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-16T01:16:55.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-16T01:16:55.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:16:55.424 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:16:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-16T01:16:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-16T01:16:55.425 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log: 91.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-16T01:16:55.426 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:16:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-16T01:16:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose --/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log: /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-16T01:16:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.6% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-16T01:16:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T01:16:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-16T01:16:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-16T01:16:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-16T01:16:55.437 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:16:55.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-16T01:16:55.444 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-16T01:16:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:16:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:16:55.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:16:55.473 INFO:teuthology.orchestra.run.smithi088.stderr: 94.5% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-16T01:16:55.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-16T01:16:55.480 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:16:55.486 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-16T01:16:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 93.5% 94.4% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-16T01:16:55.491 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:16:55.493 INFO:teuthology.orchestra.run.smithi017.stderr: 92.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-16T01:16:55.506 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-16T01:16:55.535 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-16T01:16:55.538 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-16T01:16:55.647 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-16T01:16:55.709 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-16T01:16:55.710 INFO:teuthology.orchestra.run.smithi017.stderr: 90.3% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-16T01:16:55.822 INFO:teuthology.orchestra.run.smithi088.stderr: 92.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-16T01:16:55.899 INFO:teuthology.orchestra.run.smithi017.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-16T01:16:56.143 INFO:teuthology.orchestra.run.smithi017.stderr: 92.5% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T01:16:56.336 INFO:teuthology.orchestra.run.smithi017.stderr: 90.4% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-16T01:16:56.414 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-16T01:16:56.442 INFO:teuthology.orchestra.run.smithi017.stderr: 91.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-16T01:16:56.465 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T01:16:56.871 INFO:teuthology.orchestra.run.smithi088.stderr: 91.7% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T01:16:56.923 INFO:teuthology.orchestra.run.smithi017.stderr: 93.0% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T01:16:57.007 INFO:teuthology.orchestra.run.smithi088.stderr: 92.6% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-16T01:16:57.205 INFO:teuthology.orchestra.run.smithi088.stderr: 92.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-16T01:16:57.245 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-16T01:16:57.262 INFO:teuthology.orchestra.run.smithi017.stderr: 92.4% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-16T01:16:57.264 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-16T01:16:57.264 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m1.870s 2024-09-16T01:16:57.264 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m6.723s 2024-09-16T01:16:57.264 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.231s 2024-09-16T01:16:57.430 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-16T01:16:57.431 INFO:teuthology.orchestra.run.smithi088.stderr: 92.2% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T01:16:57.433 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-09-16T01:16:57.433 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m2.039s 2024-09-16T01:16:57.433 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m9.238s 2024-09-16T01:16:57.433 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.334s 2024-09-16T01:16:57.672 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/d67bb9a6-73c5-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T01:16:57.674 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-16T01:16:57.674 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m2.278s 2024-09-16T01:16:57.674 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m6.663s 2024-09-16T01:16:57.674 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.251s 2024-09-16T01:16:57.675 INFO:tasks.cephadm:Archiving logs... 2024-09-16T01:16:57.675 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi017/log 2024-09-16T01:16:57.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:16:58.653 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi088/log 2024-09-16T01:16:58.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:16:59.962 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi154/log 2024-09-16T01:16:59.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:17:01.036 INFO:tasks.cephadm:Removing cluster... 2024-09-16T01:17:01.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:17:01.250 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:17:01.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:17:01.725 INFO:teuthology.orchestra.run.smithi088.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:17:02.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d67bb9a6-73c5-11ef-bceb-c7b262605968 --force 2024-09-16T01:17:02.314 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d67bb9a6-73c5-11ef-bceb-c7b262605968 2024-09-16T01:17:02.597 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T01:17:02.597 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:17:02.618 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:17:02.635 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:17:02.651 INFO:tasks.cephadm:Teardown complete 2024-09-16T01:17:02.651 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:17:02.667 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:17:02.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:17:02.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:17:02.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:17:02.789 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:17:02.799 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:17:02.799 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:17:02.802 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:17:02.804 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:17:02.817 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:17:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:17:02.819 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -375us[ -358us] +/- 43ms 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 124 -295us[ -274us] +/- 49ms 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +1035us[+1035us] +/- 72ms 2024-09-16T01:17:02.821 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -350us[ -343us] +/- 43ms 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -273us[ -266us] +/- 50ms 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +1076us[+1083us] +/- 72ms 2024-09-16T01:17:02.823 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:17:02.824 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:17:02.824 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-16T01:17:02.824 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -346us[ -368us] +/- 43ms 2024-09-16T01:17:02.824 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -251us[ -251us] +/- 50ms 2024-09-16T01:17:02.824 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +1050us[+1029us] +/- 72ms 2024-09-16T01:17:02.825 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:17:02.825 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:17:02.835 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:17:02.835 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:17:02.885 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:17:02.969 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:17:03.038 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:17:03.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:17:03.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:03.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:17:03.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:03.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:17:03.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:03.195 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:17:03.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:17:03.217 INFO:teuthology.task.internal:Duration was 1849.263608 seconds 2024-09-16T01:17:03.218 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:17:03.227 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:17:03.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:17:03.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:17:03.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:17:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:17:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:17:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:17:03.680 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:17:03.680 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-16T01:17:03.680 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:17:03.703 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-09-16T01:17:03.703 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:17:03.748 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-16T01:17:03.749 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:17:03.783 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:17:03.783 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:17:03.785 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:17:03.791 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:17:03.849 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:17:03.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:17:03.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:17:03.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:17:04.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:17:06.168 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:17:06.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:17:06.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:17:06.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:17:06.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:17:06.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.514 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-16T01:17:06.516 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-09-16T01:17:06.520 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-16T01:17:06.541 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:06.589 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:06.607 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:17:06.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:17:06.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:17:06.766 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:17:06.767 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi017 2024-09-16T01:17:06.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:17:06.829 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi088 2024-09-16T01:17:06.829 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:17:06.873 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906421/remote/smithi154 2024-09-16T01:17:06.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:17:06.916 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:17:06.917 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:17:06.919 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:17:06.922 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:17:06.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:17:06.980 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:17:06.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:17:06.991 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:17:06.991 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:17:06.994 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:17:06.997 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:17:07.011 INFO:teuthology.orchestra.run.smithi017.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:17 /home/ubuntu/cephtest 2024-09-16T01:17:07.012 INFO:teuthology.orchestra.run.smithi088.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:17 /home/ubuntu/cephtest 2024-09-16T01:17:07.024 INFO:teuthology.orchestra.run.smithi154.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:17 /home/ubuntu/cephtest 2024-09-16T01:17:07.026 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:17:07.037 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:17:07.062 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1849.263608455658 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T01:17:07.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:17:07.154 INFO:teuthology.run:pass